Playing skill analysis method and system
By generating skill-based sheet music and skill thumbnails, the problem of beginners having difficulty understanding piano playing techniques is solved, the accuracy and adaptability of playing techniques are improved, and artistic expression is enhanced.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-10
- Publication Date
- 2026-03-10
AI Technical Summary
Beginners often struggle to understand the performance techniques on the sheet music, and current technology is unable to meet the demands of displaying complex performance techniques, resulting in insufficient artistic expression.
By acquiring notes associated with performance techniques, the score is expanded based on the score category attributes, adjacent musical attributes, and user characteristics. The expansion is performed using technique rules and baseline musical attributes, and technique thumbnails are provided for easy user operation.
It improves the accuracy and scene adaptability of performance technique display, helps beginners better understand and perform complex performance techniques, and enhances artistic expression.
Smart Images

Figure CN121640968A_ABST
Abstract
Description
[0001] Divisional application The present application is a divisional application of the Chinese patent application for invention with the application number 202511286164.X and the application date of September 10, 2025, and the invention name of a performance skill display method and system. TECHNICAL FIELD
[0002] The present application relates to the field of performance skill display, in particular to a performance skill analysis method and system. BACKGROUND
[0003] Piano performance is a comprehensive activity combining logical thinking and image thinking, brain power and physical strength, skill and artistry. Generally, especially for beginners, it is difficult for beginners to understand how to perform the performance skill on the music score without professional guidance, resulting in insufficient artistic expression and infectiousness of piano performance. At present, the existing technology also attempts to propose some methods to improve the performance effect.
[0004] For example, the patent application CN110299049A discloses an intelligent display method and device for electronic music score, wherein the method comprises: setting the music score to be played by the user, extracting the music score content, obtaining the note, tone and performance skill note annotation in the music score, and performing frequency spectrum analysis on the skill note; dividing the music score into sentences, clustering the music sentences; for the music sentences of the same category, presetting similar colors and different color depths; highlighting the differences between the notes in the music sentences under the same category; identifying the notes played by the user at the current moment and corresponding the notes to the music score; identifying the music sentence played by the user, when the notes played by the user are different from the music notes, judging the user's intention and reminding the user with different contents; identifying the performance effect of the skill note played by the user, and changing the skill note level on the music score according to the different proficiency of the user to each skill note.
[0005] It can be seen that the technical route adopted in the prior art is mainly: by dividing the music score into sentences and clustering, identifying the notes and skill notes played by the user, dynamically adjusting the skill note level, solving the problems of similar music sentence difference recognition and skill difficulty adjustment in instrument practice.
[0006] However, for beginners, due to the lack of music theory knowledge, it is difficult to adapt to the complex performance skill display requirements by only updating the performance skill level according to the correct or incorrect performance of the user. SUMMARY
[0007] The present application aims to provide a performance skill display method and system, which partially solves or alleviates the above-mentioned deficiencies in the prior art, and can greatly improve the accuracy and scene adaptability of performance skill display.
[0008] To solve the above-mentioned technical problems, the present application specifically adopts the following technical solutions: The first aspect of the present application is to provide a performance skill display method, comprising: S100, obtaining a note associated with a performance skill in a current score; S101, determining a first skill rule of the performance skill according to first background information; wherein the first background information is used to represent the category attribute of the score; S102, determining an adjustment interval of the performance skill according to second background information; wherein the second background information is used to represent the musical attribute of the adjacent section of the note, and the musical attribute includes one or more of the following: time value, dynamics, pitch; S103, correcting the first skill rule according to the adjustment interval to obtain a second skill rule; S104, determining a reference musical attribute according to third background information; the third background information is used to represent the musical attribute of the note; S105, generating a skill development score of the performance skill using the second skill rule and the reference musical attribute; wherein the first skill rule and / or the second skill rule is used to define the development range of at least one of the musical attributes. In some embodiments, further comprising: In the display area of the note, there is a skill thumbnail icon corresponding to the note; each skill thumbnail icon corresponds to at least one skill development score; If a user triggers an operation signal on the skill thumbnail icon, the skill thumbnail icon is expanded into a skill development score.
[0009] In some embodiments, S105 further comprises: Obtaining user group characteristics and scene requirements; Generating a development rule of the skill development score according to the user group characteristics and / or the scene requirements, the development rule including at least one target analysis rule of the musical attribute; Updating the second skill rule according to the development rule to obtain a target skill rule; Generating the skill development score according to the target skill rule and the reference musical attribute.
[0010] In some embodiments, generating a development rule of the skill development score according to the user group characteristics and / or the scene requirements further comprises: Generating a skill completion difficulty according to the user group characteristics and / or the scene requirements; The unfolding rules are determined based on the difficulty of completing the aforementioned techniques; including: Determine whether the difficulty of completing the skill is greater than or equal to a preset difficulty threshold; If so, then generate the first expansion rule; If not, then generate a second expansion rule; The expansion range of the music attribute adjusted by the first expansion rule is greater than that of the second expansion rule.
[0011] In some embodiments, it also includes: The user group characteristics are updated based on skill completion, including: Get the user's first skill completion rate for the first cycle before the preset time; Obtain the user's second skill completion rate in the second cycle after the preset time; Calculate the difference in completion between the second skill completion rate and the first skill completion rate; The user group characteristics are updated based on the completion difference.
[0012] In some embodiments, the category attribute includes at least one of style attribute, creation date attribute, and tone attribute.
[0013] In some embodiments, it also includes: The display width of the expanded score is smaller than the line width in the current score.
[0014] In some embodiments, the step of generating the expansion rules for the skill expansion score based on the user group characteristics and / or the scenario requirements further includes: Select at least one target music attribute based on the user group characteristics and / or the scenario requirements; The expansion rules for determining the target music attributes are based on the characteristics of the user group and / or the requirements of the scenario.
[0015] A second aspect of the present invention is to provide a performance technique display system, the system comprising: The note acquisition module is used to retrieve notes associated with playing techniques in the current score; The first skill rule determination module is used to determine the first skill rule of the performance skill based on the first background information; wherein, the first background information is used to characterize the category attribute of the musical score; The adjustment range determination module is used to determine the adjustment range of the playing technique based on the second background information; wherein, the second background information is used to characterize the musical attributes of adjacent musical segments of the note, and the musical attributes include one or more of the following: duration, dynamics, and pitch; The second skill rule determination module is used to modify the first skill rule according to the adjustment range to obtain the second skill rule; A baseline music attribute determination module is used to determine baseline music attributes based on third background information; the third background information is used to characterize the music attributes of the note. The technique expansion score generation module is used to generate a technique expansion score of the performance technique using the second technique rule and the baseline music attribute; wherein, the first technique rule and / or the second technique rule are used to define the expansion range of at least one of the music attributes. In some embodiments, the system is used for: In the display area of the musical note, there are corresponding skill thumbnails for the musical note; each skill thumbnail corresponds to at least one expanded musical score of the skill. If a user triggers an operation signal on the skill thumbnail, the skill thumbnail is expanded into a skill expansion score. Attached Figure Description
[0016] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.
[0017] Figure 1 An example diagram illustrating the technique of unfolding musical scores according to an embodiment of the present invention; Figure 2 Another example diagram illustrating the technique of unfolding musical scores according to an embodiment of the present invention; Figure 3 An example diagram illustrating the generation of target skill rules provided in an embodiment of the present invention; Figure 4 This is a flowchart illustrating a performance technique display method according to an embodiment of the present invention. Figure 5 This is a schematic diagram of the structure of a performance technique display system provided in an embodiment of the present invention; Figure 6 This is a flowchart illustrating the rule constraint process in an exemplary embodiment of the present invention. Detailed Implementation
[0018] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.
[0019] In this document, suffixes such as "module" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves.
[0020] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
[0021] In this document, "and / or" includes any and all combinations of one or more of the listed related items.
[0022] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.
[0023] In this specification, certain embodiments may be disclosed in a range-bound format. It should be understood that this "range-bound" description is merely for convenience and brevity and should not be construed as a rigid limitation on the disclosed range. Therefore, the description of a range should be considered as having specifically disclosed all possible subranges and the individual numerical values within those ranges. For example, a description of the range 1-6 should be considered as having specifically disclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., and the individual numbers within those ranges, such as 1, 2, 3, 4, 5, and 6. This rule applies regardless of the breadth of the range.
[0024] Definition of noun: Trill is an ornamental playing technique, also known as an ornament, which refers to the rapid, even alternation between a note and the note a second above (or occasionally below) it, creating a continuous undulating effect.
[0025] Glissando refers to the rapid, continuous sliding of the fingers along the keys, allowing a series of adjacent pitches (usually white keys or notes arranged in a specific key) to be sounded in a smooth, seamless sequence, creating a smooth, flowing, or brilliant auditory effect through the continuous transition of pitches.
[0026] Legato refers to a playing technique in which adjacent notes are played smoothly without noticeable gaps, maintaining a seamless transition in tone and dynamics by connecting the fingers smoothly and naturally with each other. It is usually marked with an arc above or below the note. The core is to achieve a "seamless connection" between notes by moving the fingers in advance and touching the keys, creating a lyrical and coherent melodic line.
[0027] An appoggiatura is a decorative note marked as a small note before the main note. It usually occupies a small portion of the main note's value (such as a sixteenth note or a thirty-second note). It needs to be played quickly and lightly before immediately transitioning to the main note. It adds a lively decorative effect to the melody through a brief pitch build-up. Its pitch is usually a second interval from the main note or a chord tone within the key. When marked, it is attached to the left of the main note as a slash or a small note.
[0028] Turn is an ornamentation technique, usually divided into forward turn and reverse turn. It refers to the rapid alternation of adjacent pitches before and after the tonic. A forward turn is a continuous alternation of "the second above the tonic → the tonic → the second below the tonic → the tonic", while a reverse turn is played in the order of "the second below the tonic → the tonic → the second above the tonic → the tonic". The overall duration is short and compact. By fluctuating the pitch around the tonic, it adds a delicate ornamentation and classical charm to the melody. Its speed and dynamics need to be flexibly controlled in accordance with the style of the music and the context of the musical phrase.
[0029] Staccato is a short, sharp note produced by quickly striking and releasing the key with the finger, usually indicated by a small dot above or below the note. The core of this technique is to compress the note value to about half (or less) of its original value, creating a bright, light, and articulate effect. When playing, it requires quick fingertip application and natural wrist cushioning to avoid excessive resonance interference. It is often used in lively and dynamic musical passages to enhance the rhythmic feel and expressiveness through clear gaps between notes.
[0030] Example 1: Please see Figure 4 This application provides a method for displaying performance skills, including: S100: Retrieves notes in the current score that are associated with playing techniques; S101, determine the first technique rule of the performance technique based on the first background information; wherein, the first background information is used to characterize the category attribute of the musical score; S102, determine the adjustment range of the playing technique based on the second background information; wherein, the second background information is used to characterize the musical attributes of adjacent musical segments of the note, and the musical attributes include one or more of the following: duration, dynamics, and pitch; S103, the first skill rule is modified according to the adjustment range to obtain the second skill rule; S104, determine the baseline musical attribute based on the third background information; the third background information is used to characterize the musical attribute of the note; S105, using the second technique rule and the baseline music attribute to generate a technique expansion score of the performance technique; wherein, the first technique rule and / or the second technique rule are used to define the expansion range of at least one of the music attributes.
[0031] There are many types of piano playing techniques, including glissando, legato, vibrato, appoggiatura, echo, sustained notes, staccato, dynamic emphasis, diminuendo / crescendo, syncopation, and staccato.
[0032] Preferably, the corresponding positions of notes in the score associated with performance techniques are displayed with corresponding technique thumbnails; please refer to [link to relevant documentation]. Figure 1 , Figure 1 The “tr” (vibrato) in the text is the abbreviation icon for the vibrato playing technique corresponding to that note.
[0033] In some embodiments, a first technique rule for performance techniques can be determined based on first background information. The first background information is typically used to characterize the category attributes of the score.
[0034] In some embodiments, the first background information may characterize at least one of the following category attributes of the score: style, year of composition, tonality, etc.
[0035] In some embodiments, a note marked with a technique abbreviation icon (i.e., an ornament) can be expanded into one or more notes (or expanded notes) using technique rules to generate a technique expansion score. In some embodiments, the analysis result of the technique can be determined according to the technique analysis rules; further, the expansion range of the expanded notes can be determined according to the technique rules.
[0036] In some embodiments, the same ornament can be assigned different first technique rules based on different score category attributes. For example, for ornaments in Baroque scores, taking trills as an example, based on the principle that ornaments begin with the note above, the trill technique in the Baroque score can be interpreted as the target note and its second above it (e.g., if the tonic is C, the trill begins at D), with a relatively long duration. As another example, in Classical scores, based on the principle that ornaments begin with the main note, the trill technique in the Classical score can be interpreted as starting from the main note (e.g., if the tonic is C, the trill begins at C), with a relatively short duration.
[0037] It should be noted that there may be multiple ways to analyze ornaments (i.e., performance techniques), and the rules for analysis are flexible and varied. Therefore, traditional analysis methods require a very high level of music theory knowledge from the user.
[0038] To address this issue and enable reliable automated analysis of ornaments using computers, this invention provides a method for progressively constraining (or adjusting) technical rules based on category attributes (such as musical style), adjacent musical phrases, and the musical attributes of the notes corresponding to the ornaments. This progressive constraint method effectively alleviates or avoids problems that may arise during the automated analysis of ornaments, such as significant stylistic or tonal differences or fluctuations between the analysis result (i.e., the final technical development score) and the original score. See also... Figure 6 As shown. The technical approach adopted by the skill rules proposed in this invention is to adjust the scope of musical attributes to both satisfy the performance effect and the user's skill level through progressive background information constraints.
[0039] It should be understood that technique rules and technique analysis rules are concepts at different levels. Technique rules are used to determine the scope, or range of values, of at least one musical attribute; technique analysis rules are used to determine the different types of techniques and effects that are analyzed.
[0040] In this article, the technique rules can be used to determine the expansion range of the technique expansion score. The expansion range is used to define the expansion range of at least one expansion note. The expansion range is used to define / select the optional range of musical attributes of the expansion note, such as defining the optional range of the duration, dynamics, and pitch of at least one expansion note.
[0041] In this invention, the expansion range can preferably be constrained by different angles such as fluctuation range, length boundary, and / or width boundary.
[0042] Among them, the fluctuation range can refer to the changing trend of a specific type of musical attribute determined by the skill type (for example, vibrato is the alternation of pitches between adjacent second notes, where alternation can be a changing trend); the length boundary can refer to the duration of playing the skill (for example, the duration of playing a vibrato skill once); the width boundary can refer to the range of values of at least one musical attribute (for example, the range of pitches between the maximum and minimum pitch values).
[0043] In some embodiments, the width boundary can refer to the range between the maximum and minimum values of a musical attribute; or it can refer to the range between the maximum and minimum values of a musical attribute allowed when playing a single note.
[0044] Specifically, taking vibrato as an example, the analysis results of the vibrato performance technique can be obtained from the style of the score according to the rules of technique analysis; among them, the analysis results can include: the alternation speed between second notes, the duration of a single note, the duration of playing the technique, and other requirements that must be followed when playing the technique.
[0045] It should be understood that, because each type of technique is played differently, the analysis results can vary depending on the type of technique. For example, unlike vibrato, the analysis results for staccato techniques can include the duration of a single note, the interval between notes, and the duration of the technique.
[0046] In some embodiments, the technique parsing rules for the musical attributes of different types of techniques can be obtained from a preset technique parsing method mapping table, which is not limited here.
[0047] The technique analysis rule mapping table includes at least the following: performance techniques and their corresponding technique analysis rules. Different technique analysis rules are used to characterize the different results that different techniques should produce. The analysis results for different types of techniques are not entirely the same, and there can be overlap in the analysis results. (For example, the analysis result for vibrato may include: the alternation speed between second intervals, the duration of a single note, and the duration of the technique; while the analysis result for staccato may include: the duration of a single note, the interval between notes, and the duration of the technique.)
[0048] For example, taking the style of the musical score as the primary background information, the vibrato technique for a slow-tempo score can be played differently from that for a fast-tempo score (specifically, the pitch, duration, dynamics, or other musical attributes may differ).
[0049] Furthermore, the first technique rule for determining performance techniques based on the first background information can be to determine the range of expansion of the expanded notes based on the different category attributes of the score (i.e., the first background information).
[0050] In some embodiments, the second background information may characterize the musical properties of adjacent musical segments associated with notes of playing skills.
[0051] In some embodiments, the adjustment range of the performance technique can be determined based on the second background information. That is, based on the first technique rule, the range can be adjusted according to the context of the score, so that the technique expansion score converges from the level that adapts to the whole score to the local level that adapts to the context.
[0052] For example, after determining the first technique rule, the adjustment range can be further determined based on the musical attributes of the adjacent musical segments of the notes corresponding to that technique, thereby modifying the first technique rule.
[0053] For example, the range of duration and / or dynamics can be identified as a range to be corrected (e.g., duration range of 0.03-0.1 seconds, and / or dynamics range of 30-60 dB). Further, the adjustment range can be determined based on the duration and dynamics of adjacent musical phrases (e.g., the average duration of adjacent phrases, i.e., duration adjustment range of 0.05-0.08 seconds, and / or the average dynamics of adjacent phrases, i.e., dynamics adjustment range of 40-50 dB). Thus, the first technique rule can be corrected from an initial range with high freedom (i.e., the performer can freely improvise) to a range with high adaptability (consistent with both the score category attributes and the musical attributes of adjacent phrases; for example, correcting the duration range from 0.03-0.1 seconds to 0.05-0.08 seconds, which conforms to the adjustment range).
[0054] In some embodiments, the adjustment interval can be generated by determining the musical attributes that should be displayed in the technique development score based on the musical attributes of adjacent musical phrases, so that the musical attributes in the technique development score match the musical attributes of adjacent musical phrases. Matching can mean that the difference between the two is less than a preset difference. For example, the time value in the technique development score should not differ too much from the time value of the last note of the preceding adjacent musical phrase and / or the first note of the following adjacent musical phrase; otherwise, it will result in an abrupt sound in the technique performance.
[0055] The preset difference can be used to determine whether the difference between an adjacent musical phrase and a corresponding musical attribute (such as a time value) in the technical expansion score is large or small. It can be preset by the user. For example, if the user has high requirements for the performance of the technique, the preset difference can be lowered, so that the musical attributes of the technical expansion score are closer to the musical attributes of the adjacent musical phrases.
[0056] In some embodiments, modifying the first technique rule according to the adjustment range may include: selecting an expansion range of musical attributes that matches the musical attributes of adjacent musical phrases within the expansion range corresponding to the first technique rule, so that the technique performance conforms to both the score category and the musical attributes of adjacent musical phrases. For example, the expansion range of the note value can be understood as the range between the maximum and minimum note values in the expanded score of the technique, or as the range between the minimum and maximum note values allowed for playing a single note.
[0057] It should be understood that the musical attributes of adjacent musical phrases can refer to at least one of the following: duration, dynamics, or pitch. Preferably, the range of adjacent musical phrases can be a phrase within an adjacent measure, or it can be a larger range (e.g., an adjacent section) or a smaller range (e.g., an adjacent note), without limitation here.
[0058] It should be noted that this invention uses the musical attributes of adjacent musical segments as adjustment intervals, aiming to make the technical rules simultaneously meet the requirements of overall coherence and local precision based on the dynamic continuity of the music itself.
[0059] In some embodiments, the first technique rule can be modified according to the adjustment range. For example, the first technique rule can be narrowed down to a second technique rule that satisfies the adjustment range (e.g., at a specific playing speed). Modifying the first technique rule can refer to modifying at least one musical attribute of the first technique rule.
[0060] Specifically, taking vibrato as an example, according to the second technique rule, the further analysis result of the vibrato playing technique can be obtained from at least one musical attribute; among which, the analysis result may include: the alternation speed between second notes, the duration of a single note, the duration of playing the technique, and other requirements that must be followed when playing the technique.
[0061] It should be understood that, due to the constraints of the adjustment interval, the expansion range of the analytical result obtained according to the second technique rule is smaller than that of the first technique rule.
[0062] In some embodiments, the base musical attributes of the score for a technique-based performance can be determined based on third background information of the note. The third background information refers to the musical attributes of the note associated with the performance technique, including pitch, duration, and dynamics.
[0063] In other words, the baseline musical properties of extended notes can be determined by the musical properties of notes marked with playing techniques.
[0064] It should be understood that by using notes associated with performance techniques, the scope of the expanded notes can be further determined, so that the score of the expanded technique conforms to the musical attributes of the note, and further avoids the problem of the technique sounding abrupt.
[0065] In some embodiments, the first skill rule and / or the second skill rule can be used to define the parsing rules for at least one musical attribute.
[0066] In some embodiments, based on first background information (e.g., the key is C major), the first technique rule for the vibrato playing technique here is the repeated alternation between do and re; based on second background information (e.g., the musical context is a fast scale, influenced by adjacent phrases, the technique here usually requires increased speed), the time value expansion range corresponding to the first technique rule can be increased or decreased, thereby modifying the first technique rule into a second technique rule, that is, determining the second technique rule as the alternation of second notes at a specific speed (which can be understood as double speed or slow speed, that is, modifying the original time value expansion range to the expansion range that conforms to the adjustment range, wherein the case of decreasing the time value expansion range can be referred to Figure 2Furthermore, a technical expansion score can be generated based on the baseline musical attributes (i.e., at least one of the musical attributes of the note itself, such as pitch, duration, dynamics, etc.) and the second technical rule (the expansion range of the expanded note), such as... Figure 1 .
[0067] In some embodiments, generating a skill-expanded score of performance techniques using a second skill rule and a baseline music attribute may include the steps of: determining a target display object (e.g., an expanded note or other musical notation) based on the baseline music attribute; determining the expansion range of the target display object based on the second skill rule; and generating the skill-expanded score based on the target display object and the expansion range.
[0068] In some embodiments, it also includes: In the display area of the musical note, there are corresponding skill thumbnails for the musical note; each skill thumbnail corresponds to at least one expanded musical score of the skill. If a user triggers an operation signal on the skill thumbnail, the skill thumbnail is expanded into a skill expansion score.
[0069] In some embodiments, the display area for the musical notes includes corresponding thumbnail icons for note techniques, such as... Figure 1 The “tr” in the text is the abbreviation icon for the vibrato technique.
[0070] It should be understood that each skill thumbnail can correspond to at least one skill expansion score. That is to say, each skill thumbnail can correspond to multiple skill expansion scores. Only one skill expansion score can be displayed, or all skill expansion scores can be displayed according to user needs; there is no limitation here.
[0071] In some embodiments, if a user triggers an operation signal on the skill thumbnail, the skill thumbnail can be expanded into a skill expansion score. That is, the skill expansion score can be displayed to the user only after the user triggers the operation signal, thereby avoiding a cluttered interface caused by too many skill expansion scores when playing too many skills.
[0072] In some embodiments, S105 further includes: Obtain user group characteristics and scenario requirements; The expansion rules for the skill expansion score are generated based on the user group characteristics and / or the scenario requirements, and the expansion rules include at least one of the target parsing rules for the music attribute; Among them, the target parsing rule can be used to determine the scope of a music attribute.
[0073] The second skill rule is updated according to the expansion rule to obtain the target skill rule; The skill expansion score is generated based on the target skill rules and the baseline music attributes.
[0074] In some embodiments, user group characteristics may include the user's playing level, and / or the user's style preference, and / or the user's familiarity with the current score, etc.
[0075] In some embodiments, scenario requirements may include the type of the current playing scenario, and / or the error tolerance of the current scenario and / or the completion requirements of the current scenario for the user's playing.
[0076] In some embodiments, the expansion rules for skill-based musical scores can be generated based on user groups and / or scenario requirements.
[0077] In some embodiments, generating the expansion rules for the skill expansion score based on the user group characteristics and / or the scenario requirements may further include: Select at least one target music attribute based on the user group characteristics and / or the scenario requirements; The expansion rules for determining the target music attributes are based on the characteristics of the user group and / or the requirements of the scenario.
[0078] In some embodiments, the expansion rule is used to determine whether to further parse the target music attributes, and how to further parse them. In some embodiments, updating the second technique rule according to the expansion rule may include: further parsing the target musical attribute according to the target parsing rule based on the generated technique expansion score, and updating the expansion range of the target musical attribute; not further parsing other musical attributes that are not target musical attributes, and maintaining their original expansion range. The updated second technique rule, i.e., the target technique rule, can be determined based on the updated expansion range of the target musical attribute and the original expansion range of the non-target musical attributes. Please refer to [link to relevant documentation]. Figure 3 .
[0079] In some embodiments, generating a skill expansion score based on target skill rules and baseline music attributes may include: determining the expansion range of expansion notes based on target skill rules, generating expansion notes based on baseline music attributes, and generating a skill expansion score based on expansion notes and their corresponding expansion ranges.
[0080] In some embodiments, the method of further analysis of the target musical attribute can be determined according to the actual performance situation. For example, the user can preset the practice focus of a certain musical attribute.
[0081] In some embodiments, user group characteristics can be at least one music-related attribute associated with the user. Correspondingly, the music-related attribute can be defined as the target music attribute. Here, the music-related attribute refers to an attribute in which the user's current skill is relatively weak. For example, when the music-related attribute is dynamics, it means that the user has a weak ability to control dynamics, and the subsequent rules for expanding the dynamics dimension can be relaxed to a certain extent.
[0082] For example, taking user group characteristics as an example, if the frequency of errors in playing time values recently is higher than the preset error frequency, it indicates that the user has poor control over playing time values. In this case, time value (i.e., the music attribute to focus on) can be regarded as a target music attribute.
[0083] The preset error frequency is used to determine whether the user's error frequency is high or low. The preset error frequency can be the average of the user's daily error frequency. Specifically, the error frequency can be the ratio of the number of incorrect notes played by the user in the current piece of music to the total number of notes.
[0084] For example, taking user group characteristics combined with scenario requirements as an example, if the user needs to perform live (scenario requirements), it means that the performance skills need to be as infectious as possible. In the process of daily practice, the user is already very familiar with the pitch of the score (user group characteristics), so the duration and dynamics can be used as the target musical attributes accordingly.
[0085] The user group characteristics and / or scenario requirements can be input by the user or evaluated based on the user's daily performance behavior; no restrictions are imposed here.
[0086] Specifically, taking the determination of time value as the target musical attribute as an example, the expansion rules of the musical attribute of time value can be determined according to the characteristics of the user group, that is, the expansion range of time value in the score can be determined according to the characteristics of the user group.
[0087] Specifically, taking vibrato as an example, if the duration is determined to be the target musical attribute, the expansion rule refers to increasing or decreasing the duration expansion range of the expanded notes based on the skill expansion score, thereby generating an updated skill expansion score. Then, while ensuring that the skill expansion score does not deviate from the analysis rules, the analysis rules are selectively and adaptively supplemented.
[0088] In some embodiments, the expansion rule refers to the skill parsing rule generated by user group characteristics and / or scenario requirements, used to update the second skill rule, and capable of improving the adaptability of the skill expansion score.
[0089] In some embodiments, the second skill rule can be updated according to the expansion rule to obtain the target skill rule, thereby regenerating a new skill expansion score based on the target skill rule and the baseline music attributes.
[0090] It should be noted that the first and / or second skill rules have different functions from the expansion rules: the former emphasizes the skill rules set according to the inherent characteristics of the score and notes themselves; while the latter emphasizes another layer of constraint rules on the skill rules to adapt to the personalized and dynamic needs of different users and scenarios.
[0091] In other words, this invention establishes a collaborative development rule for performance techniques through a dual set of skill rules and development rules. This balance between fixed and dynamic elements effectively ensures the basic correctness of the developed score while significantly enhancing its adaptability. Specifically, the collaborative development rule includes at least the following layers of meaning: 1) Using skill rules as the basic constraint for developing performance techniques ensures that the developed score does not deviate from the category attributes of the score and the musical attributes of the notes; 2) Development rules represent the potential needs of skill performance. This rule allows the developed score to better suit the personalized needs of the actual playing process (for example, when the user is a beginner, the development range of the developed score can be updated according to the development rules, i.e., reducing the difficulty of performance and preventing the user from being unable to complete the technique due to insufficient performance level); 3) Skill rules and development rules work together. On the one hand, skill rules ensure that the developed score conforms to the basic rules, while on the other hand, the introduction of development rules generates more subtle variables in the fixed techniques, which are more conducive to improving the user's performance expression, allowing the skill interpretation to escape the predicament of distortion or rigidity.
[0092] From another perspective, this invention actually provides a rule adjustment scheme for restrictively adjusting the second skill rule based on user group characteristics or scenario requirements.
[0093] For example, some beginners, or performers who are not very familiar with the current score, may find it difficult to fully perform some advanced techniques. To address this, this invention expands (or lowers the standard) the scope of some musical attributes in the second technique rules to a certain extent, based on user group characteristics or scenario requirements, while controlling the scope of other musical attributes (i.e., maintaining the standard level as much as possible). Thus, by partially adjusting (or partially expanding) the second technique rules, the difficulty of performance for users can be reduced, making it easier for them to achieve their goals. Furthermore, even with the lowered standard, a certain degree of musical appeal can still be maintained (i.e., the musical characteristics of special techniques can be relatively fully demonstrated).
[0094] In other words, this rule-based adjustment scheme, which restricts certain musical attributes, is actually more conducive to users practicing and performing relatively completely, rather than being unable to complete the task due to excessive difficulty.
[0095] Furthermore, especially for beginners or amateur users, this restrictive adjustment scheme makes it easier for users to achieve their practice goals, guiding them to gradually improve their skills from low to high difficulty.
[0096] In some embodiments, it may further include: The difficulty of completing the skill is generated based on the characteristics of the user group and / or the requirements of the scenario. The unfolding rules are determined based on the difficulty of completing the aforementioned techniques; including: Determine whether the difficulty of completing the skill is greater than or equal to a preset difficulty threshold; If so, then generate the first expansion rule; If not, then generate a second expansion rule; The expansion range of the fluctuation range of the music attribute adjusted by the first expansion rule is greater than that of the second expansion rule.
[0097] In some embodiments, the skill completion difficulty can be generated based on user group characteristics and / or scenario requirements, and the skill completion difficulty is used to assess the difficulty for users to complete the skill.
[0098] Furthermore, the expansion rules can be determined based on the difficulty of completing the skill. Specifically, when the difficulty of completing the skill is greater than or equal to a preset difficulty threshold, a first expansion rule can be generated; when the difficulty of completing the skill is less than the preset difficulty threshold, a second expansion rule can be generated. The expansion range determined by the first expansion rule is larger than that determined by the second expansion rule.
[0099] In some embodiments, a preset difficulty threshold can be used to determine whether the difficulty of completing a skill is high or low for the current user, thereby determining how to update the expansion rules. For example, the preset difficulty threshold can be obtained based on the average level of all users, or it can be determined based on the current user's actual skill level. The difficulty of completing a skill can be determined based on whether the difficulty level of the musical score (e.g., high / medium / low difficulty) matches the user's playing level (e.g., high / medium / low level). For example, if the difficulty level of the musical score is much higher than the user's playing level, the skill can be considered high; conversely, if the difficulty level of the musical score is much lower than the user's playing level, the skill can be considered low.
[0100] The difficulty level of the sheet music can be determined based on user ratings, and the user's performance level can be determined based on user input.
[0101] It should be understood that distinguishing between two types of development rules based on the difficulty of completing the skill is beneficial for further determining the scope of development rules based on the actual completion situation, thereby making the playing of ornaments more in line with the user's real needs and greatly improving scene adaptability.
[0102] It should be understood that the core purpose of determining different levels of expansion rules is to provide users with different degrees of freedom in playing techniques. Specifically, the greater the difficulty of completing the technique, the greater the range of expansion of the notes, and the more space users have to choose.
[0103] It should be noted that the present invention aims to provide users with a reference method for skillful performance, that is, users can adaptively select a certain value within the range based on their own situation. For example, if the time value range is 0.03-0.08 seconds, users can choose to play 0.05 seconds.
[0104] In some embodiments, it also includes: The user group characteristics are updated based on skill completion, including: Get the user's first skill completion rate in the first cycle within a preset time period; Obtain the user's second skill completion rate during the second cycle of the preset time period; Calculate the difference in completion between the second skill completion rate and the first skill completion rate (or the difference in completion rate). The user group characteristics and the expansion rules are updated based on the completion difference.
[0105] In some embodiments, setting a preset time can facilitate periodic monitoring of changes in the user's skill completion rate.
[0106] For example, the preset time can be one month or one week, and the specific duration of the preset time and the first cycle and the second cycle can be set according to the user's own needs, which is not limited here.
[0107] In some embodiments, the method includes the steps of: if the completion difference is greater than or equal to a preset completion difference, then increasing the user group feature to a first user group feature; reducing the expansion rule to a third expansion rule; if the completion difference is less than the preset completion difference, then decreasing the user group feature to a second user group feature; and expanding the expansion rule to a fourth expansion rule.
[0108] Among them, the mapping relationship between the completion difference, or the completion difference (e.g., 50%) and the user group characteristics (rapid progress) can be preset in advance.
[0109] It should be understood that skill completion rate and skill completion difficulty are different concepts. Skill completion rate is the degree to which the user actually completes the skill, which can be the ratio of the actual completion value to the expected completion value, such as 80%; while skill completion difficulty can be a predicted value of completion difficulty generated based on the characteristics of the user group and / or the requirements of the scenario, such as difficult or easy.
[0110] For example, the skill completion rate can be calculated by determining the skill completion rate based on the ratio between the actual performance value and the expected completion value (or standard value, which can be obtained from master performance data) of each type of musical attribute. For instance, if the actual performance value of a time value is 0.1 seconds and the standard performance value is 0.5 seconds, then the completion rate of the time value in the corresponding skill is 20%. Furthermore, the average completion rate of multiple musical attributes can be used as the skill completion rate.
[0111] Optionally, updating user group characteristics based on skill completion may include: obtaining the user's first skill completion in the first period before a preset time; obtaining the user's second skill completion in the second period after the preset time; determining whether the difference in completion between the second skill completion and the first skill completion is greater than or equal to a preset completion difference; if so, increasing the user group characteristics and correspondingly narrowing the expansion rule to the third expansion rule; if not, decreasing the user group characteristics and correspondingly expanding the expansion rule to the fourth expansion rule.
[0112] In other words, the present invention also provides a mechanism for updating user group characteristics based on whether there has been a significant change in skill completion. This mechanism can periodically assess whether the user's level of playing ornaments has significantly improved, thereby further determining how to update the expansion rules.
[0113] In some embodiments, the completion difference can be calculated as follows: Completion difference = Second skill completion - First skill completion. It should be understood that both the first skill completion and the second skill completion refer to the skill completion of the same playing technique.
[0114] Specifically, the completion difference reflects the user's progress in playing the same playing technique at different times, or the change in playing level.
[0115] In some embodiments, when the completion difference is greater than or equal to a preset completion difference, the user group characteristics can be improved, and the expansion rules, or the corresponding expansion scope, can be reduced. When the completion difference is less than the preset completion difference, the user group characteristics can be reduced, and the expansion rules, or the corresponding expansion scope, can be expanded.
[0116] The preset completion difference can be used to determine whether the user's completion difference is large or small in different periods. It can be determined based on the user's progress; for example, if the user's progress is small, the preset completion difference can be lowered.
[0117] The magnitude of a user's progress can be determined by whether the frequency of errors made by the user while playing the same piece of music has significantly decreased. For example, a significant decrease in the error frequency is identified as a large improvement.
[0118] In some embodiments, it may further include: The width of the expanded score is smaller than the line width in the current score.
[0119] It should be understood that the expanded score of a technique, as a reference score for technique performance, has a display width smaller than the line width of the current score. This is beneficial for distinguishing and displaying expanded scores of techniques and avoiding user confusion.
[0120] Please see Figure 5 The present invention also provides a performance technique display system. The system includes: The note acquisition module is used to retrieve notes associated with playing techniques in the current score; The first skill rule determination module is used to determine the first skill rule of the performance skill based on the first background information; wherein, the first background information is used to characterize the category attribute of the musical score; The adjustment range determination module is used to determine the adjustment range of the playing technique based on the second background information; wherein, the second background information is used to characterize the musical attributes of adjacent musical segments of the note, and the musical attributes include one or more of the following: duration, dynamics, and pitch; The second skill rule determination module is used to modify the first skill rule according to the adjustment range to obtain the second skill rule; A baseline music attribute determination module is used to determine baseline music attributes based on third background information; the third background information is used to characterize the music attributes of the note. The technique expansion score generation module is used to generate a technique expansion score of the performance technique using the second technique rule and the baseline music attribute; wherein, the first technique rule and / or the second technique rule are used to define the expansion range of at least one of the music attributes. In some embodiments, the system is used for: In the display area of the musical note, there are corresponding skill thumbnails for the musical note; each skill thumbnail corresponds to at least one expanded musical score of the skill. If a user triggers an operation signal on the skill thumbnail, the skill thumbnail is expanded into a skill expansion score.
[0121] It should be understood that the system can be configured in a server to perform the steps described in any of the embodiments of the aforementioned performance skill display method.
[0122] It should be noted that, in this document, the term "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0123] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a computer terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.
[0124] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.
Claims
1. A performance skill analysis method characterized by comprising: The method comprises the following steps: acquiring a note associated with a playing skill in a current score; determining a first skill rule of the playing skill according to first background information, wherein the first background information is used to represent a category attribute of the score; determining an adjustment interval of the playing skill according to second background information, wherein the second background information is used to represent a music attribute of a neighboring section of the note, and the music attribute comprises one or more of the following: time value, dynamic, pitch; correcting the first skill rule according to the adjustment interval to obtain a second skill rule; determining a reference music attribute according to third background information, wherein the third background information is used to represent the music attribute of the note; generating an expansion rule of a skill expansion score according to user group characteristics and / or scene requirements, which comprises the following steps: selecting at least one target music attribute according to the user group characteristics and / or the scene requirements; determining the expansion rule of the target music attribute according to the user group characteristics and / or the scene requirements; updating the second skill rule according to the expansion rule; generating a skill expansion score of the playing skill by using the second skill rule and the reference music attribute, wherein the first skill rule and / or the second skill rule are used to define an expansion range of at least one of the music attributes; wherein the user group characteristics comprise a playing level of the user, and / or a style preference of the user, and / or a familiarity of the user with the current score, and / or at least one music attribute of interest associated with the user, wherein the music attribute of interest is used to define the target music attribute; and the scene requirements comprise a type of current playing scene, and / or a fault tolerance degree of the current scene, and / or a completion requirement of the current scene for the user's playing.
2. The method of claim 1, wherein The user group characteristics and / or the scene requirements are obtained by user input.
3. The method of claim 1, wherein The user group characteristics and / or the scene requirements are obtained by evaluating the user's daily playing behavior.
4. The method of claim 1, wherein Further comprising: in a display area of the note, a skill thumbnail icon corresponding to the note; if an operation signal triggered by the user on the skill thumbnail icon is identified, the skill thumbnail icon is expanded into the skill expansion score.
5. The method of claim 4, wherein Each of the skill thumbnail icons corresponds to at least one of the skill expansion scores.
6. The method of claim 1, wherein Generating the expansion rule of the skill expansion score according to the user group characteristics and / or the scene requirements further comprises: generating a skill completion difficulty according to the user group characteristics and / or the scene requirements; determining the expansion rule according to the skill completion difficulty, which comprises: determining whether the skill completion difficulty is greater than or equal to a preset difficulty threshold; if yes, generating a first expansion rule; if no, generating a second expansion rule; wherein the expansion range of the music attribute adjusted by the first expansion rule is greater than that of the second expansion rule.
7. The method of claim 1, wherein the playing skill analysis is performed by a computer. Further comprising: updating the user group characteristics according to the skill completion degree, which comprises: acquiring a first skill completion degree of the user in a first period of a preset time; acquiring a second skill completion degree of the user in a second period of the preset time; calculating a skill proficiency difference between the second skill proficiency and the first skill proficiency; updating the user group feature according to the skill proficiency difference.
8. The method of claim 1, wherein the playing technique is analyzed based on the pitch and the tempo. The category attribute includes at least one of a style attribute, a creation year attribute, and a tonality attribute.
9. The method of claim 1, wherein the playing skill analysis is performed by a computer. The display width of the skill development score is less than the line width in the current score.
10. A performance skill analysis system characterized by comprising: Comprise: The note acquisition module is used for acquiring the note associated with the playing skill in the current score; The first skill rule determination module is used for determining the first skill rule of the playing skill according to the first background information; wherein the first background information is used for representing the category attribute of the score; The adjustment interval determination module is used for determining the adjustment interval of the playing skill according to the second background information; wherein the second background information is used for representing the music attribute of the adjacent section of the note, and the music attribute includes one or more of the following: time value, dynamic, and pitch; The second skill rule determination module is used for correcting the first skill rule according to the adjustment interval to obtain the second skill rule; The reference music attribute determination module is used for determining the reference music attribute according to the third background information; and the third background information is used for representing the music attribute of the note; The system is also used for generating the development rule of the skill development score according to the user group and / or the scene requirement; which comprises: selecting at least one target music attribute according to the user group feature and / or the scene requirement; wherein: determining the development rule of the target music attribute according to the user group feature and / or the scene requirement; Updating the second skill rule according to the development rule; The skill development score generation module is used for generating the skill development score of the playing skill by using the second skill rule and the reference music attribute; wherein the first skill rule and / or the second skill rule is used for defining the development range of at least one music attribute. The user group feature includes the playing level of the user, and / or the style preference of the user, and / or the familiarity of the user with the current score, and / or at least one music attribute associated with the user; and the scene requirement includes the type of the current playing scene, and / or the fault tolerance of the current scene, and / or the completion requirement of the current scene to the user playing.
Citation Information
Patent Citations
Intelligent presentation method for electronic music score
CN110299049A