Musical instrument playing method, device and equipment and computer readable storage medium
By implementing the instrument model display and piano keys on the electronic instrument, the problem of high learning costs of musical instruments is solved, reducing learning costs and improving learning efficiency.
Patent Information
- Application Number
- CN202411354852.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-26
- Publication Date
- 2025-01-24
AI Technical Summary
The cost of learning musical instruments is high, especially the price and maintenance cost of home entry-level pianos, which leads to higher learning costs for users.
Provides a musical instrument playing method, applied to electronic musical instruments, by displaying instrument models of various musical instruments, receiving the operation of selecting the target instrument, and receiving the pressing operation of the keys on the keyboard, and simulating the target instrument to emit corresponding audio.
It reduces the cost of learning instrument learning, and helps users practice playing by simulating the audio and playing prompts to improve learning efficiency.
Smart Images
Figure CN119360718A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method, device, equipment and computer-readable storage medium for playing a musical instrument. Background Art
[0002] Learning a musical instrument is one of the ways to cultivate hobbies, and pianos and accordions are popular choices for users. However, the cost of using musical instruments is relatively high. For example, the price of an entry-level piano for home use ranges from several thousand to tens of thousands of yuan, and the maintenance cost is high, which makes the learning cost high for users. Summary of the invention
[0003] In view of this, embodiments of the present application provide a musical instrument playing method, apparatus, device and computer-readable storage medium for reducing the user's musical instrument learning costs.
[0004] In order to achieve the above-mentioned object, in a first aspect, an embodiment of the present application provides a method for playing a musical instrument, which is applied to an electronic musical instrument, wherein the electronic musical instrument has a keyboard and a display screen, and the method comprises:
[0005] Displays instrument models of various piano instruments;
[0006] receiving an operation of selecting a musical instrument model of a target musical instrument;
[0007] A pressing operation on a key on the keyboard is received, and the target musical instrument is simulated to emit a corresponding audio.
[0008] In a possible implementation of the first aspect, the method further includes:
[0009] Before receiving the pressing operation, receiving an operation of selecting a target musical score, and displaying the target musical score and a keyboard model of the target musical instrument;
[0010] The playing prompt information is displayed on the piano model.
[0011] In a possible implementation of the first aspect, after receiving the pressing operation, the method further includes:
[0012] A hand model is displayed on the piano model, and the hand movements of the hand model and the states of the keys on the piano model match the pressing operation.
[0013] In a possible implementation of the first aspect, the keyboard model includes keys in a partial keyboard area, and the keys in the partial keyboard area include pressed keys and keys to be pressed.
[0014] In a possible implementation of the first aspect, the playing prompt information indicates at least one of the following information: a key to be pressed, a pressing force of the key to be pressed, pressing error information, and error correction information.
[0015] In a possible implementation of the first aspect, the method further includes:
[0016] After the target music score is played, the playing evaluation result is displayed.
[0017] In a possible implementation of the first aspect, the volume of the audio matches the pressing force of the pressing operation, and the electronic musical instrument senses the pressing force through a sensor on a key.
[0018] In a second aspect, an embodiment of the present application provides a musical instrument playing device, comprising:
[0019] A display module, used for displaying instrument models of various piano instruments;
[0020] A receiving module, used for receiving an operation of selecting a musical instrument model of a target musical instrument, and receiving a pressing operation acting on a key on the piano board;
[0021] The simulation module is used to simulate the target musical instrument to emit corresponding audio after receiving a pressing operation on a key on the keyboard.
[0022] In a possible implementation of the second aspect, the receiving module is further used to: before receiving the pressing operation, receive an operation of selecting a target musical score;
[0023] The display module is also used to: display the target music score and the piano model of the target musical instrument according to the operation of selecting the target music score, and display playing prompt information on the piano model.
[0024] In a possible implementation of the second aspect, the display module is further used to: display a hand model on the piano model, and the hand movements of the hand model and the states of the keys on the piano model match the pressing operation.
[0025] In a possible implementation of the second aspect, the keyboard model includes keys in a partial keyboard area, and the keys in the partial keyboard area include pressed keys and keys to be pressed.
[0026] In a possible implementation of the second aspect, the playing prompt information indicates at least one of the following information: a key to be pressed, a pressing force of the key to be pressed, pressing error information, and error correction information.
[0027] In a possible implementation of the second aspect, the display module is further used to: display a performance evaluation result after the target music score is completed.
[0028] In a possible implementation of the second aspect, the volume of the audio matches the pressing force of the pressing operation, and the electronic musical instrument senses the pressing force through a sensor on a key.
[0029] In a third aspect, an embodiment of the present application provides a musical instrument playing device, including: a memory and a processor, the memory is used to store a computer program; the processor is used to execute the method described in the first aspect or any implementation method of the first aspect when calling the computer program.
[0030] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method described in the first aspect or any one of the embodiments of the first aspect is implemented.
[0031] The musical instrument playing method provided in the embodiment of the present application includes: displaying musical instrument models of multiple musical instruments; receiving an operation of selecting a musical instrument model of a target musical instrument; receiving a pressing operation on a key on a piano board, and simulating the target musical instrument to emit a corresponding audio. The technical solution provided in the present application can reduce the cost of learning musical instruments for users.
[0032] It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 A schematic diagram of a flow chart of a first musical instrument playing method provided in an embodiment of the present application;
[0034] Figure 2 A schematic diagram of a flow chart of a second musical instrument playing method provided in an embodiment of the present application;
[0035] Figure 3 A schematic diagram of a method after receiving a pressing operation provided by an embodiment of the present application;
[0036] Figure 4 A schematic diagram of the structure of a musical instrument playing device provided in an embodiment of the present application;
[0037] Figure 5 A schematic diagram of the structure of a musical instrument playing device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0038] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.
[0039] The embodiment of the present application provides a method for playing a musical instrument, which can be applied to electronic musical instruments. Figure 1 A schematic diagram of a flow chart of a method for playing a musical instrument provided in an embodiment of the present application, such as Figure 1 As shown, the method may include the following steps:
[0040] Step S110: displaying instrument models of multiple piano-type instruments.
[0041] The method described in the embodiment of the present application can be applied to a variety of musical instruments, such as pianos, electronic keyboards, etc. Before playing, the user can select the type of instrument to be played through the various instrument models displayed on the display screen. Multiple instrument models can be displayed on the same page for intuitive viewing by the user. Each page can also display only one instrument model, and the user can switch pages by sliding operations, thereby enhancing the visual effect of the display.
[0042] Taking the display of multiple musical instrument models on the same page as an example, when the display screen displays the musical instrument models, a musical instrument model can be selected by highlighting the border to highlight it. The default selected musical instrument model can be determined based on the user's last selection result, or the user's historical selection data can be obtained, and the musical instrument model with the most historical selection times is used as the default selected musical instrument model.
[0043] Step S120: receiving an operation of selecting a musical instrument model of a target musical instrument.
[0044] The user can select the instrument model of the target instrument through a touch screen, physical buttons, and voice recognition. Taking the piano as an example, after the user completes the operation of selecting the instrument model, the operation can be responded to and the selection result can be confirmed to the user through a display page. After receiving the confirmation result, the instrument model of the target instrument can be displayed on the display page, and the user can be reminded to start playing preparations.
[0045] Step S130: receiving a pressing operation on a key on the keyboard, and simulating the target instrument to emit a corresponding audio.
[0046] The user can trigger the display page to switch from the playing preparation interface to the playing interface by clicking the start button. After obtaining the user's pressing operation on the key, the key state at each moment can be obtained according to the pressing operation data, and when the user presses the key, the corresponding audio is emitted through the sound device according to the position of the key and the pressing force.
[0047] The pressing operation may include the moment of pressing and lifting, the position of pressing and lifting, and the strength of the pressing position. The sound-emitting device may be a built-in speaker of the display screen or an external speaker of an electronic musical instrument.
[0048] See also Figure 2 Before receiving the pressing operation, the instrument playing method may further include step S140 and step S150.
[0049] S140: receiving an operation of selecting a target musical score, and displaying the target musical score and a keyboard model of the target musical instrument.
[0050] After selecting the instrument model of the target instrument, the music score corresponding to the target instrument can be screened out from the database according to the selection result and displayed, thereby eliminating the need for traditional music scores, avoiding the inconvenience of turning pages when playing, and improving the user experience. Exemplarily, after the user selects the piano, the piano score can be displayed on the display screen. The arrangement order of the piano score can be sorted by the first letter, so that it is convenient for users to find it, or it can be sorted according to the difficulty of playing the music score, so that users can choose different difficulty levels according to their own level to learn. In some embodiments, if it is detected that the user has a music score that was not played last time, the music score can also be placed on top and an unfinished mark can be displayed to facilitate the user to continue to play.
[0051] The display screen can also display the piano model of the target musical instrument. The piano model can be displayed in a partitioned manner with the target music score. For example, the target music score can be displayed in the upper half of the display page, and the piano model can be displayed in the lower half of the display page. Considering that the screen of the display screen is small and the number of keys of the piano model is large, the displayed piano model can also include only the keys in a partial piano area. The keys in the partial piano area can include pressed keys and keys to be pressed, so that the area can be magnified for user viewing. The display area of the piano model and the target music score can be scaled proportionally, and the specific display region and display area can be adjusted according to actual needs. The embodiments of the present application do not impose any special restrictions on this.
[0052] S150, displaying playing prompt information on the piano model.
[0053] When the user plays, playing prompt information can be displayed on the keyboard model. The playing prompt information can indicate at least one of the following information: the key to be pressed, the pressing force of the key to be pressed, the pressing error information, and the error correction information. The key to be pressed can be marked with a color graphic, for example, the key to be pressed on the left hand side can be represented by a green dot, and the key to be pressed on the right hand side can be represented by an orange dot.
[0054] The volume (sound volume), timbre (sound quality) and pitch (sound pitch) of the audio are matched with the pressing force of the pressing operation. During the playing process, the pressing force of the key to be pressed can be detected by the sensor on the key. Pressing error information may include early pressing time, late pressing time, inaccurate pressing force and wrong key pressing. The wrongly pressed key can be represented in red. Error correction information may include the comparison result of the pressing force and the correct pressing force, and the comparison result of the pressing moment and the correct pressing moment.
[0055] In one possible implementation, when determining whether the volume, timbre and pitch of each note meet the playing standards, the notes and the time intervals between the notes in the target score can be obtained, and the audio can be feature extracted using a machine learning method. The audio is then matched with the note sequence of the target score, and the determination is made based on the matching results.
[0056] In some embodiments, the target score can be divided into multiple sections. After determining that the number of wrong notes of the user in the same section exceeds the target threshold, the section can be determined as a key section, and feedback to the user on the display screen after the playing is completed. The target threshold can be set according to actual needs, and the embodiment of the present application does not make any special restrictions here.
[0057] It should be noted that, in some embodiments, step S130 and step S150 may be executed in a loop until the playing is completed.
[0058] See also Figure 3 After receiving the pressing operation, the instrument playing method may further include:
[0059] Step S160: display the hand model on the piano model, and the hand movements of the hand model and the states of the keys on the piano model match the pressing operation.
[0060] By displaying the hand model on the keyboard model, the user's hand position can be easily prompted. The electronic musical instrument can be based on the user's pressing operation on the keyboard. For example, when the sensor detects that the 26th key of the keyboard is pressed, the corresponding finger of the hand model can be controlled to press down, and the 26th key of the keyboard model can also be controlled to be in a pressed state. Specifically, the z-axis change of the fingers of the hand model and the 26th key in the spatial coordinates (x, y, z) can be controlled to achieve the synchronous change of the height of the fingers of the hand model and the 26th key on the z-axis with the pressing of the fingers.
[0061] The display screen can display the playing progress of the target music score. After the playing is completed, the instrument playing method can also include:
[0062] Step S170: After the target score is played, the performance evaluation result is displayed.
[0063] The evaluation result of the displayed playing may be determined according to the number of notes in the error information pressed by the user in the process of playing the target score relative to the total number of notes in the target score.
[0064] In an optional implementation, distance sensors can be provided at both ends of the piano board to detect the distance between the left and right hands of the user and the left and right ends of the piano board when the user moves to the left or right. Then, the distance between the hand model and the two ends of the piano board model is controlled to match the distance between the user's hand and the left and right ends of the piano board, so that when the user's hand moves to different positions, the hand model also moves to the corresponding position of the piano board model, thereby improving the vividness of the displayed image.
[0065] The musical instrument playing method provided by the present application is applied to an electronic musical instrument, which has a keyboard and a display screen. The method may include: displaying musical instrument models of multiple musical instruments; receiving an operation of selecting a musical instrument model of a target musical instrument; receiving a pressing operation on a key on the keyboard, and simulating the target musical instrument to emit a corresponding audio. The technical solution provided by the present application can reduce the cost of learning musical instruments for users.
[0066] Those skilled in the art will appreciate that the above embodiments are exemplary and are not intended to limit the present application. Where possible, the execution order of one or more of the above steps may be adjusted, or may be selectively combined to obtain one or more other embodiments. Those skilled in the art may select and combine any of the above steps as needed, and all those that do not depart from the essence of the present application fall within the scope of protection of the present application.
[0067] Based on the same inventive concept, as an implementation of the above method, an embodiment of the present application provides a musical instrument playing device, and the device embodiment corresponds to the aforementioned method embodiment. For ease of reading, the present device embodiment will no longer repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in this embodiment can correspond to and implement all the contents of the aforementioned method embodiment.
[0068] Figure 4 A schematic diagram of the structure of a musical instrument playing device provided in an embodiment of the present application, such as Figure 4 As shown, the device provided in this embodiment may include:
[0069] Display module 110, used to display instrument models of various piano-type instruments;
[0070] The receiving module 120 is used to receive an operation of selecting a musical instrument model of a target musical instrument, and receive a pressing operation acting on a key on the piano board;
[0071] The simulation module 130 is used to simulate the target musical instrument to emit corresponding audio after receiving a pressing operation on a key on the keyboard.
[0072] In an optional implementation, the receiving module 120 is further used to: before receiving the pressing operation, receive an operation of selecting a target musical score;
[0073] The display module 110 is also used to: display the target music score and the keyboard model of the target musical instrument according to the operation of selecting the target music score, and display playing prompt information on the keyboard model.
[0074] In a possible implementation, the display module 110 is further used to display a hand model on the piano model, and the hand movements of the hand model and the states of the keys on the piano model match the pressing operation.
[0075] In a possible implementation, the keyboard model includes keys in a partial keyboard area, and the keys in the partial keyboard area include pressed keys and keys to be pressed.
[0076] In a possible implementation, the playing prompt information indicates at least one of the following information: a key to be pressed, a pressing force of the key to be pressed, pressing error information, and error correction information.
[0077] In a possible implementation, the display module 110 is further used to display a performance evaluation result after the target score is played.
[0078] The volume of the audio matches the pressure of the pressing operation, and the electronic musical instrument senses the pressing pressure through sensors on the keys.
[0079] The musical instrument playing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0080] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0081] Based on the same inventive concept, an embodiment of the present application also provides a musical instrument playing device. Figure 5 A schematic diagram of the structure of a musical instrument playing device provided in an embodiment of the present application, such as Figure 5 As shown, the musical instrument playing device provided in this embodiment includes: a memory 210 and a processor 220, the memory 210 is used to store computer programs; the processor 220 is used to execute the method described in the above method embodiment when calling the computer program.
[0082] The musical instrument playing device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0083] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above method embodiment is implemented.
[0084] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk or a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.
[0085] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media can include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
[0086] The naming or numbering of the steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The named or numbered process steps can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.
[0087] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0088] In the embodiments provided in the present application, it should be understood that the disclosed devices / equipment and methods can be implemented in other ways. For example, the device / equipment embodiments described above are merely schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0089] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0090] In the description of this application, unless otherwise specified, " / " indicates that the objects associated with each other are in an "or" relationship, for example, A / B can represent A or B; "and / or" in this application is merely a description of the association relationship between associated objects, indicating that three relationships may exist, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.
[0091] Furthermore, in the description of this application, unless otherwise specified, "plurality" means two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0092] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0093] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein.
[0094] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.
[0095] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for playing a musical instrument, characterized in that: Applied to an electronic musical instrument, the electronic musical instrument has a keyboard and a display screen, the method comprising: Displays instrument models of various piano instruments; receiving an operation of selecting a musical instrument model of a target musical instrument; A pressing operation on a key on the keyboard is received, and the target musical instrument is simulated to emit a corresponding audio.
2. The method according to claim 1, characterized in that The method further comprises: Before receiving the pressing operation, receiving an operation of selecting a target musical score, and displaying the target musical score and a keyboard model of the target musical instrument; The playing prompt information is displayed on the piano model.
3. The method according to claim 2, characterized in that After receiving the pressing operation, the method further includes: A hand model is displayed on the piano model, and the hand movements of the hand model and the states of the keys on the piano model match the pressing operation.
4. The method according to claim 2, characterized in that: The keyboard model includes keys in a partial keyboard area, and the keys in the partial keyboard area include pressed keys and keys to be pressed.
5. The method according to claim 2, characterized in that: The playing prompt information indicates at least one of the following information: a key to be pressed, a pressing force of the key to be pressed, pressing error information, and error correction information.
6. The method according to claim 2, characterized in that The method further comprises: After the target music score is played, the playing evaluation result is displayed.
7. The method according to any one of claims 1 to 6, characterized in that: The volume of the audio matches the pressing force of the pressing operation, and the electronic musical instrument senses the pressing force through sensors on the keys.
8. A musical instrument playing device, characterized in that: include: A display module, used for displaying instrument models of various piano instruments; A receiving module, used for receiving an operation of selecting a musical instrument model of a target musical instrument, and receiving a pressing operation acting on a key on a piano board; The simulation module is used to simulate the target musical instrument to emit corresponding audio after receiving a pressing operation on a key on the keyboard.
9. A musical instrument playing device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to execute the method according to any one of claims 1 to 7 when calling the computer program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.