Multifunctional composite vocal accompaniment instrument with artificial intelligence automatic composition

Abstract

The invention relates to a multifunctional composite vocal accompaniment musical instrument with artificial intelligence automatic composition, comprising a musical instrument composite device which is provided with a plurality of different musical instruments and is provided with a main melody generating unit and an accompaniment generating unit; the AI control device is provided with an AI automatic composition generating unit, the composite vocal accompaniment instrument of hardware and the AI automatic composition of software are ingeniously combined together, limitation of music theory knowledge and instrument backgrounds is avoided, unique songs can be made automatically and efficiently, and the automatic composition of the composite vocal accompaniment instrument is achieved. The problem that existing automatic arrangement software can be smoothly used only when a user has certain music theoretical knowledge is solved. Furthermore, the user can select required musical instruments to change and use according to personal preference, and songs have high music creation performance. Furthermore, the whole standard music score can be returned to a music query platform to confirm whether the standard music score has the copyright or not, return or feedback can be obtained, and the effects of pleasant condition and economic benefit are achieved.

Description

Technical Field

[0001] The present invention relates to a multi-functional composite accompaniment instrument with artificial intelligence automatic composition, and particularly to a device in which a hardware composite accompaniment instrument and software AI automatic composition are cleverly combined together. Background Art

[0002] Music is an extremely important part of human life and has various benefits such as increasing learning efficiency, relieving stress, improving the insomnia rate, and making people feel happier.

[0003] Although music is very therapeutic and liked by many people, composing music is quite difficult for those who have not received systematic music education. Among traditional composition methods, a composer must learn musical instrument skills and music theory knowledge for many years and spend a long time to complete a piece of music; therefore, it is almost impossible for amateurs to create music that complies with composition rules.

[0004] In order to improve the above deficiencies, the Taiwan, China Invention Patent No. I511123, "Musical Instrument Keyboard", discloses a keyboard with a new key arrangement, but it has no composition function. Furthermore, the Taiwan, China Invention Patent No. I471853, "Music Generation Device", discloses a music generation method that is obtained from data stored in a memory device and is not generated by a user inputting arbitrary keys. Therefore, the generated music cannot be changed according to the user's preferences and obviously needs to be improved.

[0005] Currently, many automatic composition systems have been proposed. One of the automatic composition systems uses a supervised deep learning algorithm as a model, but the above-mentioned supervised deep learning algorithm over-reuses the same melody, resulting in the produced music having the drawback of being unpleasing to the ear. In addition, there are also automatic composition based on heuristic search and automatic composition based on genetic algorithms. However, the automatic composition based on heuristic search is only applicable to the case of short music pieces, and its search efficiency exponentially decreases as the length of the music piece increases. Therefore, for longer music pieces, the feasibility of this method is poor. And the automatic composition method based on genetic algorithms also has some drawbacks of genetic algorithms, such as a large dependence on the initial population and difficulty in accurately selecting genetic operators.

[0006] In addition, most current automatic composition systems are limited to only one musical instrument, such as an electronic keyboard or a digital piano. Therefore, they are too monotonous and are less able to generate pleasant and human-liked music.

[0007] From the above description, it can be seen that in order to enable people to be unrestricted by music theory knowledge and musical instrument background and efficiently create unique music pieces by themselves, it is necessary to improve existing musical instruments and automatic composition systems so that they can produce more pleasant and human-liked music. Summary of the Invention

[0008] The main technical problem to be solved by the present invention is to overcome the above-mentioned defects existing in the prior art, and to provide a multi-functional composite accompaniment instrument with artificial intelligence automatic composition, which combines the hardware composite accompaniment instrument with the software AI automatic composition skillfully. It has the effects of being not restricted by music theory knowledge and instrument background, and can efficiently compose unique tunes by itself, and solves the problem that the existing automatic arrangement software requires users to have a certain amount of music theory knowledge to be used smoothly.

[0009] The technical solution adopted by the present invention to solve its technical problems is as follows:

[0010] A multi-functional composite accompaniment instrument with artificial intelligence automatic composition, comprising:

[0011] An instrument composite device having a long hollow body, the long hollow body forming a first surface and a second surface on the opposite side; a main melody generating unit provided on the instrument composite device, the main melody generating unit including: a first processor provided in the long hollow body; a pickup provided in the long hollow body and electrically connected to the first processor; a set of strings provided on the first surface of the long hollow body, and one end of the set of strings is connected to the pickup; a circuit board provided in the long hollow body and electrically connected to the first processor; a set of keys provided on the second surface of the long hollow body, and the bottom edge of the set of keys is located on the circuit board, and the circuit board is electrically connected to the first processor. When any one of the set of keys is pressed, it contacts the corresponding music trigger circuit on the circuit board to emit the played musical note; a first speaker provided on the instrument composite device and electrically connected to the first processor; a USB port provided on the front end face of the long hollow body and electrically connected to the first processor; an accompaniment generating unit provided at the rear end of the long hollow body, the surface of the accompaniment generating unit is provided with a plurality of buttons with different functions, and the buttons are electrically connected to the first processor for setting the desired key signature or time signature as the accompaniment melody; an AI control device having a base, a rotary joint connecting member is provided at the front end of the base for rotatably setting at the rear end of the instrument composite device, and an AI automatic composition generating unit is provided on the base, the AI automatic composition generating unit including: a second processor, which is electrically connected to the accompaniment generating unit through the rotary joint connecting member; and the second processor is further electrically connected to a touch panel, a second speaker, a wireless transmission device, an application program and a music library; and the automatic composition method includes inputting the following information on the touch panel:

[0012] a). Input the key signature, including any one selected from major and minor keys;

[0013] b). Input the time signature;

[0014] c). Input the music genre, including any one selected from folk, rock, hip-hop, enka, pop, soul, electronic music, and various music genres;

[0015] d). Input the song name, and it is optional to automatically generate the lyrics of the whole song;

[0016] e). Input several favorite songs, including at least three favorite songs. Randomly extract a melody segment corresponding to the selected music genre from the music database, and let the AI automatically analyze the melody style;

[0017] f). According to the preset composition rules, splice the key signature, the time signature, the music genre, the song name, and the favorite songs in sequence, and use the main melody generation unit and the accompaniment generation unit to automatically generate a composed song based on the melody played by the user himself;

[0018] g). Output for audition;

[0019] h). Manually modify and output the audition of the aforementioned composed song and modify it until satisfied;

[0020] i). Transmit the full score of the whole song back to the music query platform;

[0021] j). Report or give feedback.

[0022] According to the above characteristics, in a feasible embodiment of the present invention, on the first surface of the instrument composite device, one end of the set of strings is connected to the pickup, thereby forming the shape of an electric guitar.

[0023] According to the above characteristics, in a feasible embodiment of the present invention, on the second surface of the instrument composite device, the set of keys and the circuit board are used to form the shape of an electronic keyboard.

[0024] According to the above characteristics, in a feasible embodiment of the present invention, it further includes an electronic wind instrument. The front end of the electronic wind instrument has an air intake pipe, and a pressure sensor is provided inside the pipe to transmit the signal obtained from the air intake pipe to the third processor. The third processor is electrically connected to the USB connector. The USB connector protrudes from the rear end surface of the electronic wind instrument and can be inserted into the USB port of the instrument composite device to form an electrical connection with the first processor, thereby forming the shape of an electronic wind instrument.

[0025] According to the above characteristics, in a feasible embodiment of the present invention, it further includes a violin bow and a shoulder rest. The shoulder rest can be sleeved on the front end of the instrument composite device, thereby forming the shape of a violin.

[0026] Based on the above technical means, the present invention has the following advantages and characteristics that need to be clarified:

[0027] 1. The present invention is different from traditional software automatic composition methods. It combines a composite accompaniment instrument of hardware with AI automatic composition of software. That is to say, the main melody generation unit and the accompaniment generation unit can simulate an electric guitar, a violin, an electronic organ, and an electronic wind instrument, and have the composite function of the main melody and the accompaniment. Moreover, the main melody generation unit is controlled by the user to set the rhythm by himself, which is not restricted by music theory knowledge and instrument background, and can efficiently create unique tunes by itself, solving the problem that existing automatic arrangement software requires users to have a certain amount of music theory knowledge to be used smoothly.

[0028] 2. On the instrument composite device of the present invention, there are composite instruments such as an electric guitar, a violin, an electronic organ, and an electronic wind instrument. Users can choose the instruments they want to use according to their personal preferences. Compared with traditional software automatic composition methods, the present invention has higher creativity.

[0029] 3. The AI control device of the present invention is like a smart phone. In addition to being able to display the music generated by the AI automatic composition generation unit on the touch panel in the form of sheet music for the convenience of users to view, furthermore, the second speaker can be used to play the music of the tune, and the wireless transmission device can access the Internet. Cooperating with an application program (APP) and a music database, the whole standard sheet music can be transmitted back to the music query platform to check whether the melody in the song library overlaps and confirm whether it has copyright, and automatically mix the newly created song into an MV and upload it to the Internet for free audition first and then for a fee, having the effects of both pleasing the mood and economic benefits. Description of the Drawings

[0030] The present invention will be further described below in conjunction with the drawings and embodiments.

[0031] Figure 1A It is an exploded perspective view of a feasible embodiment of the present invention.

[0032] Figure 1B It is an assembled perspective view of a feasible embodiment of the present invention, which shows a schematic diagram of being used as an electric guitar or an electronic wind instrument.

[0033] Figure 2A It is a schematic diagram of the string and the pickup of the present invention.

[0034] Figure 2B It is a schematic diagram of the keys and the circuit board of the present invention.

[0035] Figure 3 It is a schematic diagram of the present invention being used as an electronic organ.

[0036] Figure 4 It is a schematic diagram of the rotatable AI control device of the present invention.

[0037] Figure 5AIt is an exploded perspective view of the present invention used as a violin.

[0038] Figure 5B It is an assembled perspective view of the present invention used as a violin.

[0039] Figure 6 It is a structural block diagram of a feasible embodiment of the present invention.

[0040] Figure 7 It is a flowchart of the automatic composition of the present invention.

[0041] Figure 8 It is a reference diagram of the usage state of one of the derivative functions of the present invention.

[0042] Figure 9 It is a reference diagram of the usage state of another derivative function of the present invention.

[0043] Description of the reference numerals in the figure:

[0044] 10 Musical instrument composite device

[0045] 11 Long hollow body

[0046] 111 First surface

[0047] 112 Second surface

[0048] 20 Main melody generation unit

[0049] 21 First processor

[0050] 22 String

[0051] 23 Pickup

[0052] 24 Keyboard

[0053] 25 Circuit board

[0054] 26 First speaker

[0055] 27 USB port

[0056] 30 Accompaniment generation unit

[0057] 31 Button

[0058] 40 AI control device

[0059] 41 Base

[0060] 411 Clamping structure

[0061] 42 Rotary joint connecting member

[0062] 43 AI automatic composition generation unit

[0063] 431 Second processor

[0064] 432 Touch panel

[0065] 433 Second speaker

[0066] 434 Wireless transmission device

[0067] 435 Application program

[0068] 436 Music library

[0069] 50 Electronic wind instrument

[0070] 51 Air intake pipe

[0071] 52 Pressure sensor

[0072] 53 Third processor

[0073] 54 USB connector

[0074] 60 Multifunctional composite karaoke instrument

[0075] 70 Special-purpose photography speaker

[0076] 71 Camera

[0077] 80 Special-purpose Bluetooth projection speaker

[0078] 81 Speaker

[0079] 82 Projection lens

[0080] 83 Projection Detailed implementation manners

[0081] The following is an illustration of the implementation manners of the present invention through specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the spirit of the present invention.

[0082] First, please refer to Figures 1A to 7 As shown, the multifunctional composite karaoke instrument 60 with artificial intelligence (AI) automatic composition of the present invention preferably includes a feasible embodiment: an instrument composite device 10 having a long and hollow body 11, and the long and hollow body 11 forms a first surface 111 and a second surface 112 on the opposite side.

[0083] A main melody generating unit 20 is provided on the instrument composite device 10, and the main melody generating unit 20 includes: a first processor 21 ( Figure 6As shown in the figure, it is arranged inside the long and hollow body 11; a pickup 23, which is arranged inside the long and hollow body 11 and is electrically connected to the first processor 21; a set of strings 22, which is arranged on the first surface 111 of the long and hollow body 11, and as Figure 2A shown, one end of the set of strings 22 is connected to the pickup 23; a circuit board 25, which is arranged inside the long and hollow body 11, and as Figure 6 shown, is electrically connected to the first processor 21.

[0084] Figure 3 is a schematic diagram of the present invention used as an electronic organ. A set of keys 24 is arranged on the second surface 112 of the long and hollow body 11, and as Figure 2B shown, the bottom edge of the set of keys 24 is located on the circuit board 25, and the circuit board 25 is electrically connected to the first processor 21. When any one of the set of keys 24 is pressed, it contacts the corresponding music trigger circuit on the circuit board 21, so as to emit the played musical sound; a first speaker 26 is arranged on the musical instrument composite device 10 and is electrically connected to the first processor 21; a USB port 27 is arranged on the front end face of the long and hollow body 11 and is electrically connected to the first processor 21.

[0085] An accompaniment generation unit 30 is arranged at the rear end of the long and hollow body 11. A plurality of buttons 31 with different functions are arranged on the surface of the accompaniment generation unit 30, and the buttons 31 are electrically connected to the first processor 21. In this embodiment, the desired key signature or time signature can be set by the different buttons 31 as the accompaniment melody, and it is paired with the main melody generation unit 20 to form the composite function of the main melody and the accompaniment.

[0086] An AI control device 40 has a base 41. A rotary joint connection member 42 is arranged at the front end of the base 41 for rotatably arranging at the rear end of the musical instrument composite device 10. In this embodiment, the rotary joint connection member 42 is an existing component and will not be elaborated here. By means of the rotary joint connection member 42 of the present invention, the AI control device 40 can rotate at the rear end of the musical instrument composite device 10, as Figure 4 shown, so that it is convenient for the user to watch or use. An AI automatic composition generation unit 43 is arranged on the base 41. In this embodiment, it is like a smart phone. It is combined with the base 41 by means of several card structures 411 and is electrically connected to the first processor 21 of the main melody generation unit 20 through the rotary joint connection member 42.

[0087] As Figure 6As shown, the AI automatic composition generation unit 43 includes: a second processor 431, which is electrically connected to the accompaniment generation unit 30 through the rotary joint connecting member 42; and the second processor 431 is further electrically connected to a touch panel 432, a second speaker 433, a wireless transmission device 434, an application program 435, and a music database 436; in this embodiment, the touch panel 432 can be used to display the musical notes of music and display the notes in a graphic or text form; the calculation process of the second processor 431 can be based on inputs such as key input, two notes, etc. Its usage settings can be but are not limited to this, for example, happy, gentle, and the other two input parameters are two notes that can be selected by the user; in the first stage of composition, the musical key is determined by three input values, the happy musical mood is the major key determined by two input notes, and the gentle mood is the minor key determined by two input notes. The rhythm of the music is also determined in the first stage of the musical key input; the second stage is to create the melody of the music. First, the rhythm corresponding to different emotions is set,

[0088] As shown in FIGS. 1 and 2 and Figure 2A As shown, in this embodiment, one end of the set of strings 22 of the first surface 111 of the musical instrument composite device 10 is connected to the pickup 23, thereby forming the form of an electric guitar.

[0089] As Figure 3 and Figure 2B As shown, in this embodiment, the second surface 112 of the musical instrument composite device 10, together with the set of keys 24 and the circuit board, forms the form of an electronic organ.

[0090] As shown in FIG. 2 and Figure 6 As shown, in this embodiment, an electronic wind instrument 50 is further included. The front end thereof has an air intake pipe 51, and a pressure sensor 52 is provided inside the pipe to transmit the signal obtained from the air intake pipe 51 to a third processor 53. The third processor 53 is electrically connected to a USB connector 54. The USB connector 54 protrudes from the rear end surface of the electronic wind instrument 50 and can be inserted into the USB port 26 of the musical instrument composite device 10 to form an electrical connection with the first processor 21, thereby forming the form of an electronic wind instrument.

[0091] As Figure 5A and Figure 5B As shown, in this embodiment, a violin bow 61 and a shoulder rest 62 are further included. The shoulder rest 62 can be sleeved on the front end of the musical instrument composite device 10, thereby forming the form of a violin.

[0092] Based on the above technical means, the automatic composition method of the present invention is as Figure 7 As shown, it includes inputting or selecting the following information on the touch panel 432 and the accompaniment generation unit 30:

[0093] a). Input key signature, including any one selected from major key signatures and minor key signatures, such as: C, G, F, D, B♭, A, E♭, etc.;

[0094] b). Input time signature, such as: 4 / 4, 2 / 4, 6 / 8, 3 / 8, 9 / 8, 12 / 8, 1 / 2, etc.;

[0095] c). Input music genre, including any one selected from folk, rock, hip-hop, enka, pop, soul, electronic music, and various music genres;

[0096] d). Input song title, such as: "Blue and White Porcelain", "Childhood", or "Descendants of the Dragon", etc., and optionally automatically generate the lyrics of the entire song;

[0097] e). Input several favorite songs, including at least three favorite songs. Randomly extract a melody segment corresponding to the selected music genre from the music database, and automatically analyze the melody style by AI;

[0098] f). According to the preset composition rules, splice the key signature, the time signature, the music genre, the song title, and the favorite songs in sequence, and use the main melody generation unit 20 and the accompaniment generation unit 30 to automatically generate a composed song from the melody played by the user himself;

[0099] g). Output for audition;

[0100] h). Manual modification, output the composed song for audition and modify it until satisfied;

[0101] i). Transmit the full score of the entire song back to the music query platform; for example, transmit it to the copyright association to query whether there is an overlap in the melody of the song library and confirm whether there is copyright to ensure no infringement;

[0102] j). Report or give feedback; if there is no overlap, it can be commissioned to the copyright association for registration and promotion, and both parties share the benefits.

[0103] Please refer to again Figure 8 As shown, the present invention has a multifunctional composite karaoke instrument 60 with artificial intelligence (AI) automatic composition. A reference diagram of the usage state of one of its derivative functions shows that it can be paired with a dedicated photography speaker 70. There is a camera 71 directly above the dedicated photography speaker 70. In this way, the wireless transmission device 434 of the AI automatic composition generation unit 43, such as wireless transmission via WiFi, Bluetooth, etc., can be used to support uploading live performances and KTV-style singing.

[0104] As shown in Figure 9As shown, the multifunctional composite singing instrument 60 with artificial intelligence (AI) automatic composition of the present invention has another derivative function of the use state reference diagram, which shows that it can be matched with a dedicated Bluetooth projection speaker (built-in beautiful voice film) 80. The dedicated Bluetooth projection speaker 80 has a speaker 81 for sound output in front, a projection lens 82 in the back, and a performer background wall projection 83, which can display the performance-related scenery, atmosphere lights and songs, so that the audience has an immersive visual beauty, and the lyrics can also be projected for everyone to sing together!

[0105] Based on the above technical means, the present invention has the following advantages and features that need to be explained:

[0106] 1. The present invention is different from the traditional software automatic composition method. It cleverly combines the hardware composite accompaniment instrument with the software AI automatic composition. That is to say, the main melody generation unit 20 and the accompaniment generation unit 30 can simulate the electronic guitar, violin, electronic keyboard, and electronic wind instrument, and have the composite function of the main melody and accompaniment. The main melody generation unit 20 is controlled by the user, which is not limited by music theory knowledge and instrument background, and can efficiently create unique music by itself, solving the problem that the existing automatic composition software requires the user to have certain music theory knowledge to use it smoothly.

[0107] 2. The composite musical instrument device 10 of the present invention has composite musical instruments such as an electronic guitar, a violin, an electronic keyboard, and an electronic wind instrument. The user can choose the desired musical instrument to use according to personal preferences. Compared with the traditional software automatic composition method, the present invention has higher creativity.

[0108] 3. The AI ​​control device 40 of the present invention is like a smart phone. In addition to displaying the music generated by the AI ​​automatic composition generation unit 43 in the form of music scores on the touch panel 432 for the convenience of users, the second speaker 433 can be used to play the music of the music. The wireless transmission device 434 can access the Internet, cooperate with the application (APP) 435 and the music database 436, and can send the standard music score of the whole song back to the music query platform to check whether there is any overlap in the melody of the song library and confirm whether it has copyright. The newly created song is automatically mixed into an MV and uploaded to the network for free trial listening and then charged, which has both the effect of entertainment and economic benefits.

[0109] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Any simple modification, equivalent change and modification made to the above embodiment based on the technical essence of the present invention still falls within the scope of the technical solution of the present invention.

Claims

1. A multifunctional composite singing instrument with artificial intelligence automatic composition, characterized in that: include: A musical instrument composite device has an elongated hollow body, the elongated hollow body forming a first surface and an opposite second surface; A main melody generating unit is provided on the musical instrument composite device, and the main melody generating unit includes: A first processor disposed within the elongated hollow body; A pickup, disposed in the elongated hollow body and electrically connected to the first processor; A set of strings, disposed on the first surface of the elongated hollow body, and one end of the set of strings is connected to the pickup; A circuit board is disposed in the elongated hollow body and is electrically connected to the first processor; A group of piano keys are arranged on the second surface of the elongated hollow body, and the bottom edge of the group of piano keys is located on the circuit board, and the circuit board is electrically connected to the first processor. When any one of the keys is pressed, it contacts the corresponding music trigger circuit on the circuit board, so that the played music sounds are emitted; A first speaker, disposed on the musical instrument composite device and electrically connected to the first processor; A USB port is disposed on the front end of the elongated hollow body and is electrically connected to the first processor; An accompaniment generating unit is arranged at the rear end of the elongated hollow body, and a plurality of buttons with different functions are arranged on the surface of the accompaniment generating unit, and the buttons are electrically connected to the first processor for setting a desired key signature or time signature as an accompaniment melody; The AI ​​control device comprises a base, a rotating joint connecting member is provided at the front end of the base, and is rotatably arranged at the rear end of the musical instrument composite device. The base is provided with an AI automatic composition generation unit, and the AI ​​automatic composition generation unit comprises: a second processor, which is electrically connected to the accompaniment generating unit via the rotary joint connecting member; and the second processor is electrically connected to the touch panel, the second speaker, the wireless transmission device, the application program and the music database; and The automatic music method includes inputting the following information on the touch panel: a). Input the key signature, including any key signature selected from major and minor keys; b). Input the time signature; c). Input the music style, including folk, rock, hip-hop, enka, pop, soul, electronic music, and any other music styles; d). Enter the song title, and the lyrics of the whole song can be automatically generated; e). Input a number of favorite songs, including at least three favorite songs, and randomly select a melody corresponding to the selected style from the music database, and the AI ​​automatically analyzes the melody style; f) according to the preset composition rules, the key signature, the time signature, the musical style, the song title and the favorite song are sequentially spliced, and the main melody generating unit and the accompaniment generating unit are used to automatically generate a song by playing the melody by the user; g). Output audition; h). Manual modification, output the above-mentioned songs for audition and modify until satisfactory; i). The standard score of the whole song is sent back to the music query platform; j).Return or feedback.

2. The multifunctional composite singing instrument with artificial intelligence automatic composition according to claim 1, characterized in that: The first surface of the musical instrument composite device is connected to the pickup via one end of the string group to form an electronic guitar shape.

3. The multifunctional composite singing accompaniment musical instrument with artificial intelligence automatic composition according to claim 1, characterized in that: The second surface of the musical instrument composite device is formed into an electronic keyboard shape by means of the group of piano keys and the circuit board.

4. The multifunctional composite singing accompaniment musical instrument with artificial intelligence automatic composition according to claim 1, characterized in that: It also includes an electronic blowpipe, which has an air sampling tube at the front end. A pressure sensor is provided inside the tube for transmitting the signal obtained by the air sampling tube to a third processor. The third processor is electrically connected to a USB connector. The USB connector is protruding from the rear end surface of the electronic blowpipe and can be inserted into the USB port of the musical instrument composite device to form an electrical connection with the first processor, thereby forming an electronic blowpipe type.

5. The multifunctional composite singing accompaniment musical instrument with artificial intelligence automatic composition according to claim 1, characterized in that: The invention also comprises a violin bow and a chin rest, and the chin rest can be sleeved on the front end of the musical instrument composite device to form a violin shape.

Images