Distribution method of playing fingering, computer equipment and storage medium

Abstract

The invention relates to the field of intelligent playing, in particular to a playing fingering distribution method, computer equipment and a storage medium, and the method comprises the steps: obtaining a music score to be played; based on the first time window, performing sliding analysis on a pitch sequence of the music score to be played, and determining a context feature of each note; based on the context features and preset fingering constraints, determining a fingering sequence of the music score to be played, the fingering sequence including a target fingering of each note; the preset fingering constraints comprise teaching presentation constraints. Diversified teaching presentation constraints are introduced to carry out adaptation screening on fingering, so that a fingering sequence which conforms to playing specifications and is matched with the skill level of a user is provided, meanwhile, the definition of follow-up fingering visual presentation is improved, more efficient and intuitive playing guidance is achieved, and the learning threshold is greatly reduced.

Description

Technical Field

[0001] This application relates to the field of intelligent performance, and more particularly to a method for assigning fingerings, a computer device, and a storage medium. Background Technology

[0002] In music education for keyboard instruments such as the piano and electronic keyboard, fingering is the crucial bridge connecting musical notation with actual playing actions, and a core element of the teaching and practice process. Traditional sheet music often includes fingering suggestions for some notes, but learners still need to infer many intermediate notes themselves, which poses a significant cognitive burden for beginners. Therefore, intelligent fingering assignment has become a key technological requirement for improving the efficiency and experience of digital music education.

[0003] For example, patent application CN116912929A discloses a method for generating personalized piano fingering for different groups of people. The steps are as follows: collecting finger data of the performer, including finger span, force, and sensitivity; establishing a fingering comfort index based on the performer's finger data; using a temporal difference control reinforcement learning algorithm as a learning network for training; extracting note sequences from the MIDI file of a new piece of music, inputting them into the trained learning network, and generating fingering sequences.

[0004] For example, patent application CN109871467A discloses an automatic piano fingering annotation method based on a decision hidden Markov model, including the following steps: establishing a digital piano score representation set with annotated fingerings; extracting the pitch sequence of notes and the corresponding fingering sequence from the score; mapping the fingering annotation process to a hidden Markov chain that randomly generates an unobservable random sequence of fingering states, and then generating an observed note from each fingering state to produce a random sequence of notes, thus establishing a hidden Markov model; estimating the fingering transition probability and note observation probability of the decision hidden Markov model using the maximum likelihood estimation method; and for the input note sequence to be annotated, using the trained transition probability and observation probability parameters, combined with the decision function, and the Viterbi algorithm, backtracking to obtain the optimal fingering path.

[0005] However, current fingering assignments only focus on performance feasibility, neglecting the hand abilities and cognitive levels of beginners, which severely limits their practical use and lacks teaching adaptability. Summary of the Invention

[0006] The main objective of this application is to provide a method for assigning fingerings in musical performance, a computer device, and a storage medium. To solve the aforementioned technical problems, this application specifically adopts the following technical solution: The first aspect of this application is to provide a method for assigning fingerings in a performance, the method comprising: S201, Obtain the sheet music to be played; S202, Based on the first time window, perform sliding analysis on the pitch sequence of the score to be played to determine the contextual features of each note; S203, based on the context features and preset fingering constraints, determine the fingering sequence of the score to be played, wherein the fingering sequence includes the target fingering for each note; The preset finger placement constraints include teaching presentation constraints; wherein, the teaching presentation constraints include at least one of the following conditions: a. In any musical score segment within a second time window, the number of finger types playing notes is less than or equal to the first type threshold, and / or the number of finger switching is less than or equal to the second switching threshold; b. The finger combination belongs to the set of allowed finger combinations based on the user's skill level; c. In any third time window of the musical score segment, the preset number of times that adjacent notes with different pitches and consecutive time are assigned to the same finger is less than or equal to the third number threshold.

[0007] A second aspect of this application is to provide a computer device, the device comprising: Memory, used to store computer programs; A processor is configured to execute the computer program and, in executing the computer program, implement the steps of the fingering assignment method for playing instruments as provided in any embodiment of this application.

[0008] A third aspect of this application is that a computer-readable storage medium is also provided, the computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the steps of the fingering assignment method for playing instruments provided in any embodiment of this application.

[0009] Beneficial effects: This application provides a method for assigning fingerings, a computer device, and a storage medium. Specifically, it provides an intelligent fingering generation mechanism that balances performance feasibility, teaching effectiveness, and user-friendliness. By introducing diverse teaching presentation constraints to adapt fingerings, it provides fingering sequences that conform to performance standards and match the user's skill level. Simultaneously, it improves the clarity of subsequent visual presentations of fingerings, achieving more efficient and intuitive performance guidance.

[0010] Especially for beginners and amateurs, even when faced with complex classic pieces, they can successfully complete the performance with simplified fingering that maintains musical recognizability, greatly reducing the learning threshold and enhancing their sense of accomplishment and motivation to continue practicing.

[0011] Specifically, the teaching presentation constraints provide multi-level filtering conditions: Condition a: Limits the number of finger types used and the number of finger switches between adjacent notes. This effectively avoids frequent finger changes and multi-finger alternation, limits the difficulty of fingering, and prevents screen flickering, denseness, or chaos caused by overly complex fingering information in the fingering visualization interface. It improves visual stability, allowing users to more clearly track and execute the currently used finger, and enhances the readability and guidance efficiency of subsequent fingering visualization presentations.

[0012] Condition b: Dynamically adapt the allowed finger placement set based on the user's skill level. By adjusting the allowed finger placement set, a minimalist and stable finger placement sequence can be generated for beginners, while retaining more challenging technique combinations for advanced learners, flexibly adapting to different skill levels and learning goals.

[0013] Condition c: Restricts the use of the same finger for consecutive different pitches, which is a reverse constraint on condition a. It prevents the use of highly repetitive fingerings due to an excessive preference for minimal fingerings with few switching times and a single finger type. This avoids staccato and uneven key contact caused by insufficient finger lifting or sliding, thus ensuring the quality of the performance.

[0014] Furthermore, when the fingering sequence cannot meet the constraints of instructional presentation, its original structure exceeds the teaching scope suitable for the current user's skill level. Visualizing such fingering can easily cause cognitive overload and reduce practice efficiency. In this case, complex segments are intelligently deleted or replaced, and the fingering allocation is updated synchronously to adapt to the user's skill level. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of this application; for those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0016] Figure 1 This is a schematic flowchart of a method for simplifying musical scores provided in an embodiment of this application; Figure 2 This is a schematic diagram of the original musical score provided in an embodiment of this application; Figure 3 This is a schematic diagram of the original musical score after simplification of its tonality, provided in an embodiment of this application. Figure 4 This is a schematic diagram of a simplified spectrum provided in an embodiment of this application; Figure 5 This is a schematic diagram of a simplified spectrum provided in an embodiment of this application; Figure 6 This is a schematic diagram of another simplified spectrum provided in an embodiment of this application; Figure 7 This is a schematic flowchart illustrating a method for allocating fingerings for playing instruments, as provided in an embodiment of this application. Figure 8 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0018] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0019] In this document, suffixes such as “module,” “part,” or “unit” used to denote elements are used only for illustrative purposes and have no specific meaning in themselves. Therefore, “module,” “part,” or “unit” can be used interchangeably.

[0020] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0021] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," and "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0022] In this document, the term “and / or” includes any and all combinations of one or more of the listed related items.

[0023] In this article, the term "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0024] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0025] In this article, musical scores (or scores) record performance information such as note sequences and rhythm information, which convey musical content through a regular combination of graphics and symbols.

[0026] Taking the piano as an example, the sheet music used on the piano is usually in the form of a staff. The staff consists of five equidistant parallel horizontal lines. Each line and the space between them, from bottom to top, is called the first line, second line, third line, fourth line, fifth line, and first space, second space, third space, fourth space. If there are not enough lines and spaces, additional lines and spaces can be added above or below the staff. These are called ledger first line, ledger first space, ledger first line, ledger first space, etc. Notes can be placed on lines or spaces, each position corresponding to a specific pitch. The actual pitch of these pitches is determined by the clef used (such as the treble clef or bass clef). Combining the clef, key signature, accidentals, and the vertical position of the note on the staff, the exact pitch of each note can be uniquely determined. The shape and duration of the notes are used to express rhythm and duration information.

[0027] In this article, the melody part refers to the sequence of notes in the score that carries the main melody line and has a strong auditory dominance; the accompaniment part refers to the sequence of notes that provides harmonic support and rhythmic background. Taking the piano as an example, it often uses double staffs, consisting of the treble clef (also known as the upper staff) and the bass clef (also known as the lower staff), connected by curly braces. Usually, the melody part is located on the treble clef and played by the right hand, while the accompaniment part is usually located on the bass clef and played by the left hand.

[0028] In this article, note names refer to the letter names used to represent specific pitches. In the Western music system, the note names of the basic pitches are represented by the following seven Latin letters: C, D, E, F, G, A, and B.

[0029] In this article, a keyboard refers to a musical instrument input device with multiple keys arranged in pitch order. Taking a standard 88-key piano as an example, including white and black keys, its keyboard covers a wide range from A0 (lowest note) to C8 (highest note), which can be divided into 9 groups: 7 complete octaves and 2 incomplete registers located at the low and high ends respectively. From the low to the high registers, they are: 1st octave, 1st octave, 2nd octave, 3rd octave, and 4th octave; the incomplete registers are 2nd octave and 5th octave. A complete octave refers to the sequence of pitches starting from a certain natural note (usually C) and ending 12 semitones above it (i.e., the octave higher with the same note name, such as C'), forming a functional pitch unit.

[0030] In this article, a chord unit (or simply chord) is a sonic structure composed of three or more different pitches stacked according to a certain interval relationship. The most basic triad consists of the root, third, and fifth: the root is the foundation of the chord, determining its name and tonality; the third is a third above the root, determining whether the chord is a major or minor third; the fifth is usually a perfect fifth, enhancing the stability of the chord. Based on this, sevenths, ninths, etc., can be added to form seventh chords, ninth chords, and other extended chords. Furthermore, each note has a different functional role in the chord; for example, the root and third form the core of the chord, while other notes have auxiliary or decorative functions.

[0031] Chords are distinguished by their groups, which differentiate notes with the same note name but located at different octaves (e.g., C in the first octave and C in the second octave). In actual musical practice, the root note's pitch can be determined by its group. For example, in C major, the root note of the "I tonic chord" is I (i.e., C), and its group can be the second octave. Therefore, C in the second octave is the actual root note pitch for performance.

[0032] In this article, a note event refers to a group of notes that sound simultaneously and / or whose sound interval is less than a preset interval threshold.

[0033] In this article, beat position refers to the precise time coordinate of a note within the measure structure of a musical score, which is determined by the measure number, beat number, and subdivision of beat position.

[0034] Currently, digital sheet music mainly serves professional or semi-professional users who already have a certain ability to read sheet music, providing them with convenient access and performance support. However, it generally ignores the differences in cognition and skills faced by beginners and amateur enthusiasts at different stages of music learning in teaching scenarios.

[0035] On the one hand, the staff itself contains a large number of abstract symbol systems, such as key signatures, time signatures, accidentals, slurs, and ornaments. These elements require long-term training to understand and apply, and beginners and amateurs have limited professional skills, making them prone to cognitive overload when faced with complete scores, leading to a strong sense of frustration. On the other hand, beginners and amateurs often have a strong interest in learning well-known pieces (such as Beethoven's "Für Elise" and Chopin's "Nocturnes"), but these works often have high technical barriers, such as involving a wide range of pitches, complex rhythmic combinations, or requiring precise finger control, far exceeding their current skill level. This makes it difficult for users to actually start practicing, making it hard to translate their strong desire to learn into actual practice.

[0036] It is evident that existing digital sheet music has not yet broken through the inherent limitations of traditional sheet music, still maintaining a high barrier to entry and use, failing to effectively support the actual needs of music teaching, and seriously weakening its value and user experience in popular music education.

[0037] This application embodiment determines the user's sheet music application needs based on the user's learning objectives at different learning stages and their corresponding cognitive and skill levels (fingering, sight-reading, etc.), preferences, and habits. Through diversified and adaptive digital sheet music, it dynamically adapts to the user's personalized sheet music application needs, providing the user with playable content in the sheet music, thus providing a step-by-step learning path and upgrading the sheet music from a static information carrier into an interactive teaching tool that can adaptively evolve with the user's ability.

[0038] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0039] This application provides a method for simplifying musical scores, a computer device, and a storage medium. It constructs a simplification logic with differentiated voice parts at the note level, realizing multi-level and fine-grained adjustment of the degree of simplification. It can adapt to the application needs of different users' skill levels and practice goals, so that the simplified score takes into account both musical integrity and performance adaptability.

[0040] Please see Figure 1 , Figure 1 This is a schematic flowchart illustrating a method for simplifying musical scores provided in an embodiment of this application, such as... Figure 1 As shown, this application provides a method for simplifying musical scores.

[0041] S101, retrieve the original sheet music, which includes the accompaniment and melody parts.

[0042] Specifically, the original score can be divided into parts in advance. For example, the two types of parts can be identified and marked from the score by information such as part markings, register distribution, or division of performance roles.

[0043] Please see Figures 2 to 6 As shown, Figure 2 This is a schematic diagram of the original musical score provided in an embodiment of this application; Figure 3 This is a schematic diagram of the original musical score after simplification of its tonality, provided in an embodiment of this application. Figure 4 This is a schematic diagram of a simplified spectrum provided in an embodiment of this application; Figure 5 This is a schematic diagram of a simplified spectrum provided in an embodiment of this application; Figure 6 This is a schematic diagram of another simplified spectrum provided in the embodiments of this application.

[0044] like Figures 2 to 6 The double-line staff shown has the melody part on the treble clef, played by the right hand, while the accompaniment part is usually on the bass clef, played by the left hand. However, there are exceptions, such as... Figures 2 to 6 In the last line of the middle section, the treble clef contains both the melody and accompaniment parts.

[0045] In some embodiments, to lower the performance threshold, step S102 further includes: transposing the original score to a preset key to obtain a preliminarily simplified original score. The preset key can be flexibly set and dynamically updated according to the user's skill level and practice goals; specific transposition processing can be found in relevant technical documents.

[0046] In some embodiments, a preset key is selected based on the user's skill level, and a simplified score is dynamically matched to that skill. For example, for beginners, the score is uniformly transposed to C major or A minor, both keys primarily using white keys with lower requirements for black keys, effectively reducing fingering complexity and the burden of reading music. As the user's skill level improves, more complex keys can be gradually selected, introducing key signature recognition, black key usage, and cross-finger operations, until the original key of the score is restored. Figure 2 As shown, based on the flats marked at the beginning of each line of the score, the original score is in E-flat major. The original score is then transposed to C major, as follows: Figure 3 As shown, the key signature is not marked on each line of the score, which corresponds to C major.

[0047] In some embodiments, the degree of simplification refers to the extent to which original notes are deleted or retained during the simplification process of the musical score. The method further includes: adjusting the number of the first retained notes and / or the second retained notes according to the degree of simplification; wherein, the higher the degree of simplification, the fewer the number of the first retained notes and / or the second retained notes, the simpler the simplified score, and the easier it is to play; the lower the degree of simplification, the more the number of the first retained notes and / or the second retained notes, the more complex the simplified score, and the corresponding increase in the difficulty of playing.

[0048] Among them, retained notes can be understood as the retention of a specific note in the score, or the retention of the pitch corresponding to a specific note, used to generate simplified scores. The corresponding number of retained notes is the number of retained notes.

[0049] Specifically, multiple levels of simplification can be set, with each level precisely corresponding to the number of notes retained. For example, in the first-level minimalist mode, only one note is retained, or it can be understood as retaining the same note name only once; in the second-level basic mode, two notes can be retained, specifically two different note names or the same note name retained twice; in the third-level advanced mode, three or more notes can be retained, specifically multiple different note names and / or the same note name retained multiple times. Furthermore, the melody and accompaniment parts can be configured with the same or different simplification levels, fully adapting to the user's learning stage, left-hand skill differences, and practice goals, achieving personalized sheet music adaptation. It should be noted that due to the possibility of repeated notes, when two or more notes are retained, the pitches of the retained notes may be the same, such as retaining the root note of two chords.

[0050] For example, for beginners, each voice part can retain only one note, starting with the most crucial single-note framework. As skill level improves, the number of retained notes can be gradually increased to guide the learning of richer harmonic and melodic details. Another example is for users with stronger left-hand playing abilities, where the melody part can be simplified to a higher degree than the accompaniment part. For instance, the accompaniment part can use the third level, retaining three notes, while the melody part retains only one note, achieving personalized adaptation based on individual differences and hand characteristics, breaking through the limitations of traditional one-size-fits-all simplification.

[0051] S102, extract chord units from the accompaniment part based on a preset chord extraction algorithm; generate a simplified target accompaniment part based on the beat position of the chord unit and the first retained note in each chord unit; wherein, the first retained note includes the root note in each chord unit.

[0052] Specifically, chord extraction algorithms refer to algorithms that identify a group of notes that sound at the same or similar start time from a multi-note sequence and group them into a chord unit. For details, please refer to relevant technical documentation. For each chord unit, based on music theory and the position of each pitch in the interval structure, the functional roles of each note within it can be identified, such as the root, fifth, third, etc. Combining the time signature of the score (e.g., 4 / 4 time), the start time and duration of the notes it contains, its beat position can be accurately determined, including the starting beat position (e.g., the first beat) and the number of beats occupied (e.g., two beats).

[0053] Extract at least the root note from each chord unit as the first retained note, and reorganize it according to the original chord unit's beat position to generate the target accompaniment part. For example, if the first retained note is a single note, place it at the beginning of the chord unit and set its duration according to the number of beats occupied; for example, if the time signature is 4 / 4, it occupies 2 beats and is played as a half note. For example, if the first retained note consists of two notes, they can be played simultaneously at the beginning of the chord unit (i.e., double-stop accompaniment), placing both notes at the beginning of the chord unit and setting their duration according to the number of beats occupied; or, they can be placed sequentially according to the total chord duration (i.e., short-interval alternation); for example, if the time signature is 4 / 4, it occupies 2 beats, placing the two notes on the first and second beats respectively, and using quarter notes. For example, if three or more notes are retained, they are organized as simple arpeggios, played sequentially from the beginning of the chord unit within the original duration range.

[0054] Therefore, while strictly maintaining the original rhythmic structure, a target accompaniment part is formed with a consistent rhythmic structure but a reduced number of notes or a lower performance difficulty, thus reducing the difficulty of left-hand performance.

[0055] by Figure 3 The following example illustrates the simplification of the accompaniment using the first two measures of the lower staff (bass staff) in the transposed score. The original note sequence in the first line is written in solfège as "6 3 6 3 5 2 5 2 4 1 45 6 5 2". Based on a preset chord extraction algorithm, three chord units are identified: the first chord unit "6 3 6 3" and the second chord unit "5 2 5 2" in the first measure, and the third chord unit "4 1 4 5 65 2" in the second measure.

[0056] The sheet music is in 4 / 4 time, with four beats per measure, and each beat consisting of a quarter note. For example... Figure 3 As shown, the first chord unit "6 3 6 3" consists of four eighth notes, and its beat position is the first two beats of the first measure; as Figure 4As shown, the simplified version retains the root note located in the first space of the bass clef, presented as a half note, placed on the first beat of the chord unit, in the first two beats of the first measure. For example... Figure 3 As shown, the second chord unit "5 2 5 2" consists of four eighth notes, and its beat position is the last two beats of the first measure; as Figure 4 As shown, the simplified version retains the root note located on the first line of the bass clef, presented as a half note, placed on the third beat of the chord unit, with the beat position being the last two beats of the first measure.

[0057] like Figure 3 As shown, the third chord unit "4 1 4 5 6 5 2" in the second measure consists of six eighth notes and one quarter note, with a beat position of four beats for the entire measure; as Figure 4 As shown, the simplified version retains the root note located in the first space below the bass clef, presented as a whole note, placed on the first beat of the chord unit, occupying the entire measure for four beats.

[0058] In some embodiments, when the extracted chord unit includes both a first part of notes in a measure of type I in the bass clef and a second part of notes in a measure of type II in the treble clef, the second part of notes belonging to the chord unit in the type II measure is deleted, and a rest of corresponding duration is added to its original position to ensure that the total duration of the measure meets the time signature requirements. The target number of beats corresponding to the chord unit is calculated by combining the deleted non-chord notes in the type II measure and the time signature of the measure. The first retained note is placed at the starting beat position of the chord unit in the bass clef, and its duration is set according to the target number of beats.

[0059] like Figure 3 As shown, the chord units in the last line of the score span three consecutive measures across the bass and treble clefs, and the first measure of the treble clef contains other independent notes (i.e., non-chord notes) in addition to chord tones. Figure 4 As shown, the simplified target accompaniment retains the non-chordal notes in the first measure (considered as content to be played by the user), while the remaining chordal notes are replaced with rests of corresponding durations. In the second and third measures, since all notes belong to chordal units, the entire measure is replaced with a whole rest, considered as not requiring user performance. Furthermore, non-chordal notes occupy only one measure with a time signature of 4 / 4, and the target accompanies 4 beats. The starting beat of the chordal unit in the bass clef is the first beat of the first measure in the bass clef. Therefore, a whole note is generated at the corresponding position in the bass clef based on the pitch of the first retained note, with its duration covering the entire first measure. The second and third measures are rests.

[0060] In some embodiments, as the simplification level decreases, the first retained note may further include any one or more other notes in the chord to gradually restore the harmony of the original score and increase the complexity of the simplified score. Here, "other notes" refers to all notes within the same chord unit except the root note.

[0061] For example, at the first level, each chord retains only one root note (i.e., only one root note), presented as a single note; at the second level, two notes can be retained, with two notes of different pitches (such as the root note and the fifth note) sounding simultaneously as a double-note accompaniment or two notes of the same note name (such as the root note being retained twice) alternating with short intervals; at the third level or higher, multiple retained notes or multiple retentions of the same note name can be organized into simple arpeggios, played sequentially within the time value of the original chord, forming a smooth and clear chord effect.

[0062] In some embodiments, different groups of performance difficulty and root note retention rules in different musical contexts are preset. When there are multiple root notes of different groups that can be selected in a chord, they can be flexibly selected according to the performance difficulty and root note retention rules of different groups. For example, in the first level, the group with lower performance difficulty is selected first, such as retaining the root note of the small octave in the accompaniment part. For another example, when the melody part of the same period in the score has a higher pitch range and is too far away from the small octave, the root note of the first or second small octave in the accompaniment part can be retained.

[0063] In some embodiments, when the first retained note includes multiple notes, a target accompaniment part conforming to chord values ​​is generated based on the multiple notes and a preset chord structure. In this case, the target accompaniment part may use the same note combinations as the original score, but it is not a direct copy of the complex texture in the original score; rather, it is a simplified version automatically generated based on the preset chord structure.

[0064] The preset chord structure refers to a set of basic chord types (such as major triads, minor triads, etc.) and their standard interval rules built into the system. Depending on the user-defined simplification level, different types of retained notes can be selected (such as root only, root and fifth, or complete three-note structure), and then a harmonically reasonable and easy-to-play accompaniment part is generated based on the first retained note, the basic chord type, and the standard interval rules. For example... Figure 3 As shown, taking the second section's "4 1 4 5 6 5 2" as an example, in the second level, the root note 4 and other notes 1 are retained. When the basic chord type is double-note accompaniment, a double-note accompaniment composed of 1 and 4 is generated. If it is the third level, the root note 4 and other notes 1 and 6 are retained. When the basic chord type is simple arpeggio, it can be organized into a simple arpeggio form of "4 1 4 6 1" according to the preset chord structure and played sequentially within the original chord duration.

[0065] In some embodiments, the target number of first retained tones in each chord unit is determined based on the current simplification level; the retention priority is set according to the functional role of each tone in the harmonic structure of each type of chord unit; and the corresponding tone is selected from the chord unit as the first retained tone based on the retention priority and the target number. The retention priority can be predetermined based on music theory. For example, for common triads, the priority from high to low is: root, fifth, third. When the target number is 1, the root is selected; when the target number is 2, the root and fifth are selected; and when the target number is greater than or equal to 3, the third is included.

[0066] In some embodiments, if the number of the first retained notes does not match the number of notes required for the basic chord type, the missing notes are supplemented according to the standard interval composition rules and the first retained notes to generate a chord that conforms to the basic chord type. The standard interval composition rules are preset; for example, in C major, the C-G combination defaults to supplementing E as a major third to automatically infer and add the missing third, thereby reconstructing a complete triad structure.

[0067] For example, if the first retained note includes the root note and the fifth note, and the preset chord structure corresponding to the chord unit is a triad, then according to the standard interval composition rules, a third note is completed based on the root note and the fifth note to generate a complete triad structure, and the target accompaniment part is generated based on the complete triad structure.

[0068] Thus, while strictly preserving the original rhythmic structure and time value distribution, a target accompaniment part is generated that is concise, has clear harmonic function, and is suitable for different musical scores.

[0069] S103, based on the start time of the notes, extract several independent note events from the melody part; based on the beat position of the note events and the second retained tone in each note event, generate a simplified target melody part; wherein, the second retained tone includes the highest note in each note event.

[0070] Specifically, the melody is segmented based on the start time of the notes. A group of notes that sound simultaneously and / or whose time interval between sounding is less than a preset threshold is identified as an independent note event. Each note event corresponds to a specific beat position and duration. At least the highest note is extracted from each note event as the second retained note. These retained notes are then reorganized according to the beat position and duration of the original event to generate a simplified target melody. This effectively maintains the clarity and recognizability of the main melody line while preserving the original rhythmic structure, thus avoiding the blurring of the melody outline or the loss of the core musical expression due to excessive deletion.

[0071] In some embodiments, the second retained tone includes only the highest note in each note event.

[0072] by Figure 3 The simplification of the melody is illustrated using the first two measures of the treble clef (the upper staff) of the transposed score as an example.

[0073] like Figure 3 As shown, there are 2 note events in the first measure and 4 note events in the second measure. Given that the original melody contains polyphonic harmonies, the highest note from each note event is selected as the sole retained note, as follows: Figure 5 As shown, the two note events in the first measure retain the highest notes located on the first ledger line and the first ledger space of the treble clef, respectively; in the second measure, the four note events retain the highest notes located on the fourth space, fourth line, third space, and third space of the treble clef, respectively, while notes of other pitches are omitted. This preserves the most prominent treble lines, which are most decisive for the melody's outline, effectively avoiding confusion for beginners or a burden on their playing caused by retaining too many inner voice notes, while maintaining the recognizability and fluency of the main melody.

[0074] In some embodiments, if a lower level of simplification is used, the second highest note or other constituent notes may also be retained. The method further includes: the second retained note also includes any one or more other notes in the note event. Here, other notes refer to all notes within the same note event except the highest note.

[0075] S104 generates a simplified score corresponding to the original score based on the target melody part and / or the target accompaniment part.

[0076] Specifically, steps S102 and / or S103 can be selected based on the desired level of simplification to obtain the target melody part and / or the target accompaniment part. For example, using... Figure 3 Taking the transposed score as an example, step S102 can yield the following result: Figure 4 The simplified score after simplifying the accompaniment part is shown; executing step S103 will yield the following: Figure 5 The simplified score after simplifying the melody parts is shown; by performing steps S102 and S103, the following can be obtained: Figure 6 The simplified spectra shown are for two types of voice parts with a high degree of simplification.

[0077] It should be understood that, in the embodiments of this application, at least the root note is retained for the accompaniment part to maintain the basic auditory feel and structure of the harmony; for the melody part, at least the highest note is retained to maintain the clarity and recognizability of the melody line. For example, the simplified score retains at least the note located at the top of the staff (i.e., the visually highest note). Thus, the most prominent high-pitched melody line and main harmonic support in auditory perception are retained, and the rhythmic structure of the original score is inherited as much as possible, reducing the complexity of performance while maintaining the musical expressiveness of the original piece as much as possible.

[0078] Meanwhile, the note-level precision processing mechanism makes score simplification more flexible and controllable. The number of retained notes can be dynamically adjusted according to the user's score application needs, enabling multi-level difficulty transitions from a minimalist framework to near-original scores within the same piece. Furthermore, this adjustment can be applied independently to different voices, supporting asymmetrical adjustments to the difficulty of left-hand and right-hand playing, achieving personalized adaptation tailored to individual players and hand characteristics, breaking through the limitations of traditional one-size-fits-all simplification.

[0079] In some embodiments, the user’s historical performance data is obtained, and an initial simplification level is determined based on the historical performance data, the initial simplification level being associated with an initial number of the first retained notes and / or the second retained notes.

[0080] Specifically, the system collects and analyzes users' past performance records in advance, extracting historical performance data. This historical performance data refers to multi-dimensional information recorded over a long period of use, reflecting the user's skill level, learning goals, and preferred habits. Examples include the accuracy of notes and rhythmic stability for each hand; mastery of different technique types (such as arpeggios, staccato, and black keys); success rate at different simplification levels; and records of the user's preference for adjusting the difficulty of different parts, such as frequently setting the right hand to level one and the left hand to level two.

[0081] Based on historical performance data, the system can determine each user's personalized sheet music application needs. When loading new sheet music, it assigns different initial simplification levels to the melody and accompaniment parts to generate or update simplified scores, achieving an asymmetrical adaptation that is "different for each person and for each player." The resulting simplified scores avoid oversimplification that would lose its challenge and fail to serve its purpose as practice, while also preventing excessive difficulty that would make it hard for users to follow along. While preserving the core melodic lines and harmonic structure, it ensures that users are always in a practice range that matches their skill level, allowing them to enjoy the pleasure of playing during practice.

[0082] In some embodiments, real-time performance data of a user is acquired, and a target simplification level is determined based on the real-time performance data, the target simplification level being associated with the target number of the first retained note and / or the second retained note.

[0083] Specifically, real-time performance data is used to reflect the immediate performance during the current performance. By comparing the real-time collected performance data with standardized performance data, it can identify problems such as consecutive wrong notes, rhythmic deviations, excessively slow tempos, or performance interruptions. This allows it to determine if the user is experiencing difficulty with a specific hand part in a particular musical phrase, and only that part is dynamically simplified to generate or update a simplified score, while other parts remain at their original difficulty. For example, only the melody part of a certain musical fragment might be reduced from two notes to one note.

[0084] By leveraging real-time performance data feedback, the simplification of the score can be further optimized. The system dynamically seeks the most suitable number of retained notes under the current performance conditions, providing users with a flexible learning range that allows them to practice and improve their skills without being overly frustrated.

[0085] In some embodiments, transposition processing is automatically selected or triggered based on historical performance counts and / or real-time performance data, and adapted to the corresponding preset key. For example, if a user has a low level of proficiency with staccato and black keys, the key is uniformly transposed to C major, and the simplified score is updated accordingly.

[0086] This application also provides a mechanism for generating and playing auxiliary scores. Based on the close and clear temporal relationships between notes, it intelligently converts simplified notes that are not played by the user into auxiliary notes and precisely binds them to the retained notes actually played by the user. Since the simplification logic is built on note-level precision, the triggering timing of the auxiliary notes can be strictly synchronized with the user's playing, forming a natural, smooth, and auditoryally complete follow-along automatic accompaniment. This not only fills the auditory gaps caused by simplification, enhancing the integrity and recognizability of the music, but also ensures that the auxiliary notes do not overshadow the main music, maintaining a user-driven playing experience.

[0087] In some embodiments, an identifiable musical score fragment is obtained from the original score, the identifiable musical score fragment including at least one musical identifier feature; if the simplified score is missing any musical identifier feature in the identifiable musical score fragment, at least one auxiliary note is determined based on the missing musical identifier feature and the retained note of the identifiable musical score fragment in the simplified score, and an auxiliary score is generated based on the auxiliary note; wherein, the auxiliary score is configured to be played automatically during user performance.

[0088] Among them, the identified musical score fragments are highly recognizable sections of a piece of music that play a decisive role in the style or memorability of the work, such as the main melody phrase or classic harmonic progressions. Correspondingly, the musical identifier features are the core musical elements in the identified musical score fragments, including specific pitch combinations, chords, etc., which can be specific notes or combinations of notes. Identified musical score fragments and musical identifier features of a piece of music can be marked in advance.

[0089] Specifically, by comparing musical identifier features and the retained notes of the identified musical score fragments in the simplified score, it is determined whether any key notes have been lost due to simplification, such as the deletion of some notes in a specific pitch combination. The deleted notes are then set as auxiliary notes. Based on these auxiliary notes, an auxiliary score is generated and automatically played when the user actually performs, thus adapting to the user's score application needs while improving the overall recognizability and expressiveness of the music.

[0090] In some embodiments, the playing of the auxiliary score can be achieved by a smart piano automatically controlling the key presses through its built-in mechanical device, faithfully reproducing the timbre and touch of the original piece; or by using electronic devices with audio synthesis and MIDI triggering capabilities (such as tablets, mobile phones, digital audio workstations, or dedicated teaching terminals) to generate and play the corresponding auxiliary sound audio in real time according to the playing progress of the retained notes while the user plays the simplified score. Regardless of whether physical sound generation or digital audio methods are used, the auxiliary score is strictly synchronized with the user's actual playing sequence of the target retained notes, resulting in a natural auditory fusion and rhythmic consistency. This not only completes the musical information omitted due to simplification, enhancing the overall integrity and expressiveness of the performance, but also ensures that the user is always in a leading position in the performance.

[0091] In some embodiments, a differentiated simplification strategy is employed, the method comprising: simplifying the identified musical score fragment based on a first simplification level; simplifying the remaining musical score fragments based on a second simplification level; wherein the second simplification level is higher than the first simplification level; when real-time performance data is detected to not meet a preset standard, increasing the simplification level of the corresponding musical score fragment and updating the simplified score; based on the difference between the simplified score before and after the update, identifying the notes omitted due to the increased simplification level as auxiliary notes, and generating or updating an auxiliary score based on the auxiliary notes.

[0092] Specifically, the first level of simplification is applied to the marked musical score fragments, retaining more notes to maintain their musical characteristics; while the second level of simplification is applied to the remaining unmarked musical score fragments to reduce the overall practice burden. The first and second levels of simplification can be preset and flexibly configured according to the inherent characteristics of different musical scores, such as their type, voice function, and musical expression focus.

[0093] For example, the degree of simplification can be determined based on the structural and expressive characteristics of the music itself. For instance, for a lyrical piece with a clear melodic line at its core, its main melody has high recognizability and emotional expression. In this case, the degree of simplification of the melodic part in the first and second simplification levels can be set lower. For example, the first simplification level retains the highest note and two other notes, while the second simplification level retains the highest note and the second highest note, in order to maintain the integrity of the melody.

[0094] During performance, by comparing real-time performance data with standardized performance data, the system identifies musical segments that do not meet preset standards (such as consecutive wrong notes, rhythmic deviations, excessively slow tempos, or interruptions). It then dynamically increases the simplification level of these segments (e.g., reducing the number of retained notes or adjusting to a simpler key), and updates the simplified score in real time. The system compares the updated and revised simplified scores, using the newly removed notes as auxiliary notes (i.e., notes requiring auxiliary performance) to generate or update auxiliary scores. Subsequent automatic accompaniment completes the score, avoiding any impact on the complete expression of the musical characteristics. This maintains a low performance threshold while ensuring the overall auditory effect and expressiveness of the music. The preset standards can include preset performance accuracy, performance tempo, etc., and the adjustment range of the preset standards and simplification level can be pre-set and adjusted.

[0095] In some embodiments, to achieve a natural integration of auxiliary notes with the user's performance, the method includes: determining the target retained note to which each auxiliary note is attached based on the temporal relationship of each note in the original score during the performance process; and determining the timing of automatic performance of the auxiliary note according to the user's performance progress of the target retained note in the simplified score.

[0096] Specifically, the temporal relationships between notes in the original score are analyzed, that is, the logical connections between notes in the original score in the time dimension, including simultaneous sounding, sequential order, rhythmic counterpoint, etc. Based on this, a target reserved note is assigned as the trigger basis for each auxiliary note, which can be the root note in the same chord, the highest note in the same note event, or the highest note in the previous note event.

[0097] During performance, the system monitors in real time the user's keystrokes on the target sustained note, as well as rhythmic deviations, performance fluency, speed, and other performance styles from past performances, to predict the optimal triggering time for the auxiliary note. For example, if the auxiliary note is the fifth note of a chord, and the target sustained note is the root note of that chord, then when the user presses the root note, the fifth note is triggered simultaneously to form the chord. If the user's performance is slightly delayed, the auxiliary note is also delayed accordingly, ensuring that the two are strictly aligned audibly, forming a close and natural follow-along automatic accompaniment, avoiding mechanical misalignment or the auxiliary note overshadowing the main note.

[0098] In some embodiments, a neural network model is pre-trained using training data, which includes simplified and auxiliary spectra and is pre-labeled with binding and timing relationships between auxiliary and retained notes. This allows the trained neural network model to predict the target retained note to which the auxiliary note should be bound and its optimal triggering time based on the input simplified and auxiliary spectra.

[0099] This application also provides a method for assigning fingerings, a computer device, and a storage medium. Specifically, it provides an intelligent fingering generation mechanism that takes into account performance feasibility, teaching effectiveness, and user-friendliness, so that fingering assignment not only serves the performance itself, but also takes into account teaching clarity and learning experience.

[0100] Please see Figure 7 , Figure 7 This is a schematic flowchart illustrating a method for assigning fingerings in a performance, as provided in an embodiment of this application. Figure 7 As shown in the figure, this application provides a method for assigning fingerings for playing instruments.

[0101] S201, retrieve the sheet music to be played.

[0102] The score to be played can be the original score without processing, or a simplified score generated by the score simplification method in the aforementioned embodiments (such as steps S101 to S104). In practical applications, if the user is a beginner or has pre-selected a simplification mode, the input is a simplified score generated according to their skill level, vocal preferences, and other personalized needs; if the user has a higher skill level or wishes to challenge the original version, the original score is loaded directly.

[0103] S202, based on the first time window, perform sliding analysis on the pitch sequence of the score to be played to determine the contextual features of each note.

[0104] Specifically, the first time window refers to the time or range of notes that slide on the pitch sequence, such as the sliding time range covering the current note and several notes before and after it. The first time window is used to analyze the pitch sequence in the score to be played note by note to determine the contextual features of the notes in the local musical context.

[0105] In some embodiments, the contextual features include interval span and / or melodic trend.

[0106] The interval span refers to the pitch distance between two adjacent notes, which can be expressed in semitones (i.e., the key difference on a keyboard). Specifically, it can be determined by the pitch difference between adjacent notes (such as MIDI pitch values). For example, when the note sequence is "C4-D4", the MIDI pitches are 60 and 62 respectively, with an interval span of 2 semitones, which is a minor second (i.e., adjacent keys); when the note sequence is "C4-E4", the MIDI pitches are 60 and 64 respectively, with an interval span of 4 semitones, which is a major third; when the note sequence is "C4-C5", the MIDI pitches are 60 and 72 respectively, with an interval span of 12 semitones, which is an octave. Specific division rules can be found in relevant technical documents and will not be elaborated upon here.

[0107] The ascending / descending trend refers to the change in pitch over time, that is, the pitch direction of each subsequent note relative to the preceding one in a note sequence, used to reflect the direction of the melodic line. For example, in the note sequence "C4, D4, E4", the pitch changes by +2, +2, and the overall trend is ascending; in the note sequence "G4, F4, E4", the pitch changes by -2, -2, and the overall trend is descending; in the note sequence "C4, C4, D4", the pitch changes by 0, +2, and the trend is parallel then ascending.

[0108] In some embodiments, the contextual features may further include rhythm density, i.e., the time interval between adjacent notes; and the structural position of the musical phrase, such as the beginning, transition, or end.

[0109] S203, based on the context features and preset fingering constraints, determine the fingering sequence of the score to be played, wherein the fingering sequence includes the target fingering for each note.

[0110] Specifically, the playing actions between adjacent notes are modeled based on contextual features to generate multiple candidate fingering sequences that are musically logically valid and technically feasible. For details on the generation method, please refer to relevant technologies. These candidate fingering sequences are then filtered based on preset fingering constraints to determine the target fingering sequence that conforms to performance standards and matches the user's skill level.

[0111] In some embodiments, the preset fingering constraints include instructional presentation constraints. It should be understood that instructional presentation constraints refer to fingering selection conditions set from the perspective of how users acquire, understand, and execute fingering techniques. These conditions are based on the user's current skill level and are not directly derived from ergonomics or musical logic.

[0112] It should be noted that the alternative fingering sequences are theoretically feasible. For example, multiple notes produced at the same time will not be assigned to the same finger, and the fingering switching between adjacent notes conforms to the natural structure and movement patterns of the human hand. However, practical feasibility is limited by the user's current skill level. Therefore, it is necessary to further adapt or simplify the sequences based on the user's skill level. For example, candidate fingering sequences can be selected by sliding within a time window for subsequent filtering or optimization.

[0113] In some embodiments, the instructional presentation constraints include at least one of the following conditions: a. In any musical score segment within a second time window, the number of finger types playing notes is less than or equal to the first type threshold, and / or the number of finger switching is less than or equal to the second switching threshold; b. The finger combination belongs to the set of allowed finger combinations based on the user's skill level; c. In any third time window of the musical score segment, the preset number of times that adjacent notes with different pitches and consecutive time are assigned to the same finger is less than or equal to the third number threshold.

[0114] For condition a, by limiting the number of finger types used within any second time window and the number of finger switching between adjacent notes, the visual presentation of fingering is optimized and the cognitive load is reduced.

[0115] The second time window is a preset local range, such as the performance duration of 4 consecutive notes or 5 seconds. Based on the second time window, candidate fingering sequences are slidably selected from the alternative fingering sequences to evaluate the fingering complexity that the user needs to process in a short time.

[0116] Each fingering combination explicitly specifies the hand (e.g., left or right hand) and the specific finger (e.g., index finger) used to play the corresponding note. Taking piano playing as an example, the finger numbers are: 1 (thumb), 2 (index finger), 3 (middle finger), 4 (ring finger), and 5 (little finger), applicable to both hands. Correspondingly, the number of finger switching operations refers to the number of times the finger number changes between adjacent notes; there are a total of 10 finger types for both hands, and the number of finger types refers to the total number of finger types actually used.

[0117] For example, assuming the second time window length is four consecutive notes, the candidate fingering sequence is 1-2-2-3 under the right hand, with two switching times, namely 1-2 and 2-3, and the number of finger types is 3, namely the three fingers of the right hand: 1 (thumb), 2 (index finger), and 3 (middle finger).

[0118] The first type threshold and the second switching threshold can be flexibly set and dynamically changed according to the user's skill level and the length of the second time window. Assuming the second time window length is four consecutive notes, beginners can set the first type threshold to 2 types of fingers and the second switching threshold to 2 switching times, thereby prioritizing the generation of stable and highly repeatable fingerings and avoiding visual confusion and operational stress caused by frequent finger switching or simultaneous use of multiple fingers. As the user's skill level improves, the thresholds can be appropriately relaxed to retain necessary technical training content.

[0119] Suppose that the candidate fingering sequences include "1-2-3-4" (using 4 types of fingers, switching 3 times), "1-2-1-2" (using 2 types of fingers, switching 3 times), and "1-1-2-2" (using 2 types of fingers, switching only once) for the right hand, the "1-1-2-2" scheme can be preferred for beginners, as it has the fewest switching times and fewer types of fingers.

[0120] It should be understood that for fingering techniques involving frequent finger changes and multiple finger alternations, the interface, in order to fully convey the fingering information, will present elements in the image as rapidly flashing, blinking, dense, or chaotic. This can easily create a cognitive burden for beginners and amateur players with limited skill levels. Especially in fast passages with continuous key changes and constant finger switching, condition a can maintain visual stability, reduce the requirements for the user's reaction speed and accuracy, and allow the user to more clearly track and execute the currently used finger. This improves the readability and guidance efficiency of the visual fingering, and has high application value.

[0121] For condition b, the allowed finger placement set is dynamically adapted based on the user's skill level. By adjusting the allowed finger placement set, a minimalist and stable finger placement sequence can be generated for beginners, while more challenging technique combinations are reserved for more advanced learners, flexibly adapting to users' different skill levels and learning goals.

[0122] Specifically, historical performance data includes the user's mastery of different fingering techniques (such as finger placement, finger crossing, and finger skipping), representing their skill level in fingering. Based on this mastery level, different sets of allowed fingerings can be dynamically adjusted. For example, the allowed set includes fingerings the user has already mastered or needs to practice in the next learning stage. Beginners are only allowed to use stable combinations with finger placement, few finger changes, and small leaps, and are prohibited from finger crossing or large jumps; while more advanced learners are allowed to use standard fingerings with complex techniques such as finger crossing, finger skipping, and rapid position changes. Therefore, the selected fingering combination belongs to the allowed set corresponding to the user's current skill level.

[0123] For condition c, restricting the use of the same finger for consecutive different pitches can create a reverse constraint on condition a, preventing the fingering sequence from excessively favoring extremely simple fingerings with few switching times and a single finger type, and thus avoiding the use of highly repetitive fingerings. This avoids staccato and uneven key contact caused by insufficient finger sliding or lifting, ensuring the quality of performance.

[0124] The third time window is a preset local range, such as a musical phrase or a 10-second performance duration. Based on the third time window, candidate fingering sequences are slidably selected from the alternative fingering sequences to evaluate the performance quality within this time period. The second time window and the third time threshold can be flexibly set according to the user's skill level.

[0125] For example, the threshold for the third number is set to 0, which completely prohibits such assignments to ensure the professionalism and clarity of the fingering.

[0126] For example, when targeting beginners or amateurs, in order to reduce the overall fingering complexity (such as avoiding frequent finger changes), the judgment criteria can be appropriately relaxed, such as setting the second time window to one musical phrase and the third count threshold to 2 times. As the user's skill level improves, the judgment criteria can be appropriately tightened, such as widening the second time window to two musical phrases, and / or lowering the third count threshold to 1 time.

[0127] In some embodiments, multiple candidate fingering sequences are quantitatively scored according to conditions a, b, and c to obtain a comprehensive score for each candidate fingering sequence. This includes: quantitatively scoring the generated multiple candidate fingering sequences according to conditions a, b, and c to obtain a score for each condition; calculating the comprehensive score for each candidate fingering sequence according to preset weights (e.g., a: 0.4, b: 0.3, c: 0.3) and the condition scores, and preferentially selecting the fingering sequence with the highest comprehensive score and / or a comprehensive score exceeding a preset scoring threshold as the target fingering sequence. Specifically, scoring rules are preset for each condition. For example, condition a: the fewer the number of finger types or finger switching times, the higher the score; no points are deducted when the number of finger types used is less than or equal to the first type threshold or the second switching threshold, and points are deducted for each additional type or switching; condition b: the higher the matching degree between the fingering combination and the allowed fingering set, the higher the score; condition c: the fewer the preset number of switching attempts, the higher the score; no points are deducted when the number of switching attempts is less than or equal to the third number threshold, and points are deducted for each additional switching attempt.

[0128] In some embodiments, the preset weight configurations between the conditions enabled in the teaching presentation constraints can be dynamically adjusted under different application scenarios to adapt to diverse teaching objectives and user needs. For example, in the application scenario where beginners experience famous pieces, only conditions a and b are enabled, and the weight of condition a is greater than that of condition b (e.g., a:0.7, b:0.3), emphasizing the feasibility of performance and weakening the requirements for teaching objectives and performance quality; while in the advanced skill training scenario, conditions a, b, and c are enabled simultaneously, and the weight of condition b is increased to support targeted reinforcement of specific fingerings.

[0129] It should be understood that condition a is primarily based on the inherent difficulty of the fingering itself and the clarity of its visual presentation, tending to generate minimalist fingering sequences with fewer switching operations and a single finger type, in order to reduce graphic complexity and improve the follow-up efficiency for beginners. Condition b focuses on the match between the fingering and the user's individual ability, prioritizing fingering types with high success rates in the user's past performances or those currently in training goals (such as having mastered finger crossing or practicing finger straddle), ensuring that the fingering is technically feasible. Furthermore, the evaluation results of condition b can also adjust the first type threshold and the second switching threshold set in condition a, achieving personalized adaptation. Condition c, on the other hand, acts as a reverse constraint on condition a, achieving a balance between simplification and performance quality.

[0130] Therefore, by introducing diverse teaching presentation constraints to adapt fingering techniques, limiting the number of finger switches and finger types, and allowing different fingering types, a fingering sequence that conforms to performance standards and matches the user's skill level is provided. Simultaneously, the clarity of subsequent fingering visualizations is improved, achieving more efficient and intuitive performance guidance. Based on this, the fingerings provided to users are highly adapted to their skill level and learning goals. After visualization, they are easier to quickly guide users to start playing and master the pieces. Especially for beginners and amateurs, even when faced with complex classical pieces, they can successfully complete the performance with simplified fingerings that maintain musical recognizability, significantly lowering the learning threshold and enhancing their sense of accomplishment and motivation for continued practice.

[0131] In some embodiments, S203 includes: S2031, determining an optional fingering combination between adjacent notes based on the contextual features; the fingering is used to indicate the hand and fingers playing the notes.

[0132] Specifically, the playing actions between adjacent notes are modeled based on contextual features, generating multiple musically logical and technically feasible alternative fingering combinations. For any given note, there are several alternative fingering combinations with the preceding note, as well as multiple possible combinations with the following note. Furthermore, there are multiple possible fingering combinations between a note and other notes within the same note event. This multi-directional modeling mechanism endows each note with rich fingering possibilities within its local context, thereby constructing a diverse set of candidate fingerings.

[0133] When two adjacent notes are an ascending minor second, natural fingering combinations such as "right hand 1-2" and "right hand 2-3" can be generated; when two adjacent notes are an ascending third, fingering combinations with appropriate spans such as "right hand 1-3" and "right hand 2-4" can be generated; when two adjacent notes are an octave apart, fingering combinations with appropriate spans such as "left hand 1-5", "left hand 5-1", and "left hand 1-5 with finger crossing" can be generated; when two adjacent notes are the same note, fingering combinations using the same fingers can be generated, such as "right hand 1-1".

[0134] In some embodiments, a fingering combination generation model can be pre-trained. This model undergoes supervised learning based on a large amount of labeled data (such as MIDI fingering records from professional performance recordings and standard fingering markings in instructional scores). The input consists of contextual features such as interval span and ascending / descending trends, and the output consists of a variety of selectable fingering combinations. Different interval spans and ascending / descending trends in the labeled data are associated with corresponding fingering combinations, and the fingering combinations are adapted to the user's physical finger constraints.

[0135] In some embodiments, finger physical constraints are pre-set based on the physiological structure of the human hand. The range of intervals a user can perform can be dynamically obtained based on the physiological data (such as hand length and finger width) of different user groups (e.g., children, adolescents, adults) or individual users. Personalized interval thresholds that trigger specific playing actions (e.g., stretching the thumb, finger crossing, finger straddling, hand twisting) can then be flexibly set as finger physical constraints. This allows for matching span-adaptive finger combinations across different interval ranges to suit the user's hand abilities.

[0136] For example, the average interval span of an adult's single hand in a naturally relaxed state is about 7 to 12 semitones. If a chordal interval of more than 10 semitones needs to be played simultaneously, the web of the hand needs to be stretched, which can easily lead to tension or discomfort. If the intervals are played sequentially and exceed 10 semitones, the hand shape needs to be adjusted by crossing or interlacing fingers to complete the performance. In addition, the pitch interval between adjacent fingers should generally not exceed 4 semitones, otherwise it will force the hand to twist, affecting the fluency of the performance and long-term health. This results in fingering that conforms to ergonomics, avoiding the recommendation of unreasonable solutions that are physiologically difficult to achieve or easily cause fatigue.

[0137] In some embodiments, S203 includes: S2032, determining the target fingering for each note from the optional fingering combinations based on preset fingering constraints to generate a fingering sequence. Specifically, multiple candidate fingering sequences are generated based on the optional fingering combinations, and the candidate fingering sequences are filtered based on preset fingering constraints to determine the target fingering sequence.

[0138] In some embodiments, when there is a first musical score segment with preset fingering restrictions in the musical score data, the preset fingering constraints further include context constraints, and the fingering sequence includes a first-class fingering sequence and a second-class fingering sequence; the method further includes: generating a first-class fingering sequence of the first musical score segment based on the fingering restrictions in the first musical score segment; extracting the playing fingering of at least one endpoint note of the first-class fingering sequence as the context constraint; the endpoint note is the note at the beginning or end of the first musical score segment; and generating second-class fingering sequences of the remaining musical score segments based on step S203.

[0139] In some embodiments, the fingering restrictions include at least one of user-manually marked fingering, composer's original fingering markings, or instructionally recommended fingering, to suit the specific teaching objectives or artistic requirements of different users. For example, users can manually specify "use only fingers 1–3" or "no finger crossing" for a technically challenging passage in their practice plan, or they can specify to enable the composer's original fingering, even if their current skill level has not yet fully met the requirements, thereby breaking through the limitations of instructional presentation constraints and making fingering allocation more flexible.

[0140] Specifically, based on fingering constraints, a first type of fingering sequence for the first musical score fragment is generated. The fingering used for at least one note (i.e., an endpoint note) at the beginning and / or end of this first type of fingering sequence is extracted as a contextual constraint for the second musical score fragment adjacent to the first musical score fragment. When processing the remaining unmarked musical score fragments, step S203 is executed to generate a second type of fingering sequence. For the second musical score fragment adjacent to the first musical score fragment, its preset fingering constraints also include contextual constraints, ensuring a natural and coherent fingering connection between the first and second musical score fragments, avoiding abrupt finger changes or hand shape conflicts.

[0141] For example, if the ending note of the current segment (i.e., the first musical segment) is played using the third finger of the right hand, then the fingering of the beginning note of the next segment (i.e., the second musical segment adjacent to the first musical segment) needs to be reasonably extended based on the position of the third finger, so as to ensure the physiological continuity and technical rationality of the overall fingering sequence at the connection point.

[0142] In some embodiments, the method further includes: if any musical score fragment cannot generate a fingering sequence that satisfies the teaching presentation constraints, simplifying the corresponding complex musical score fragment, wherein the simplification process includes deleting or replacing at least one note in the complex musical score fragment.

[0143] Specifically, when all candidate fingering sequences generated for a certain musical score fragment fail to meet the teaching presentation constraints (e.g., the overall scores are all below the preset scoring threshold), a simplification mechanism will be triggered to partially simplify the original musical score fragment, such as deleting ornamental notes. The simplified fragment will then be reassigned fingerings until a fingering sequence that meets the teaching presentation constraints is output, ensuring that users always receive clear and actionable performance guidance at their skill level.

[0144] In some embodiments, the method includes: analyzing the fingering sequence currently generated by the complex musical score fragment to determine the target skill level of the complex musical score fragment; and determining to delete or replace at least one note in the complex musical score fragment based on the target skill level and the user's skill level.

[0145] Specifically, the alternative fingering sequences between adjacent notes in complex musical scores are analyzed to assess the target skill level. For example, the fingering types contained in the fingering sequence are analyzed (such as whether finger crossing, finger skipping, large-span leaps, or high-frequency finger changes are necessary). Combined with the user's mastery of various fingering types, fingering types that are not mastered or are not the learning target are identified, and the corresponding note combinations are simplified. For example, intermediate transitional notes (such as passing notes or ornaments) can be selectively deleted, or the original note sequence can be replaced with a simplified version with a smaller interval span that can be completed simply by following the fingering.

[0146] It should be noted that the deletion or replacement strategy can be determined in advance based on the mapping rule library of common technical difficulties and corresponding simplification modes. For example, the strategy for densely interlaced passages is to retain the backbone notes (such as the root note or the highest note) and replace notes to reduce the interval. Simplified versions with different degrees of deletion or replacement can also be pre-set for the score and can be called directly.

[0147] In some embodiments, the simplification process corresponding to the complex musical score fragment includes: extracting chord units from the accompaniment part based on a preset chord extraction algorithm; generating a simplified target accompaniment part based on the beat position of the chord units and a first retained note in each chord unit; wherein the first retained note includes the root note in each chord unit.

[0148] In some embodiments, the simplification process corresponding to the complex musical score fragment includes: extracting several independent note events from the melodic part of the complex musical score fragment based on the start time of the notes; generating a simplified target melodic part based on the beat position of the note events and a second retained note in each note event; wherein the second retained note includes the highest note in each note event.

[0149] In some embodiments, the method includes: determining a degree of simplification based on the gap between the target skill level and the user skill level, wherein the larger the gap, the higher the degree of simplification and the fewer the number of the first retained sounds and / or the second retained sounds; and adjusting the number of the first retained sounds and / or the second retained sounds based on the degree of simplification.

[0150] It should be noted that, for the sake of convenience and brevity, the specific implementation of the simplification process described above can refer to the corresponding process of the score simplification method in the aforementioned method embodiments (such as S102 and S103), and can be combined with the aforementioned embodiments without conflict, which will not be repeated here.

[0151] In some embodiments, the simplification of musical scores may also refer to other related technologies, and is not limited to the musical score simplification methods provided in the embodiments of this application.

[0152] In some embodiments, auxiliary scores are generated based on the deletion or replacement of complex segments, and automatically accompany the user's performance. Specifically, this can be achieved by a smart piano automatically controlling the key presses through its built-in mechanical device; or by an electronic device with audio synthesis and MIDI triggering capabilities (such as a tablet, mobile phone, digital audio workstation, or dedicated teaching terminal) generating and playing the corresponding audio in real time.

[0153] It should be understood that when finger placement sequences cannot meet the constraints of instructional presentation, their original structure exceeds the teaching scope suitable for the current user's skill level. Visualizing such finger placements can easily lead to cognitive overload and reduce practice efficiency. In this case, intelligently deleting or replacing complex segments and simultaneously updating finger placement assignments adapts to the user's skill level, constructing an executable, understandable, and progressive learning path.

[0154] The method described in this application can be used in a wide range of general-purpose or special-purpose computing system environments or configurations. Examples include: intelligent musical instruments (such as intelligent pianos), personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices.

[0155] Please see Figure 8 , Figure 8 This is a schematic block diagram illustrating the structure of a computer device according to an embodiment of this application. The computer device may be a terminal device or a server.

[0156] For example, the above method can be implemented as a computer program, which can be used in, for example... Figure 8 It runs on the computer device shown.

[0157] like Figure 8 As shown, the computer device includes a processor, memory, and network interface connected via a system bus, wherein the memory may include non-volatile storage media and internal memory.

[0158] Non-volatile storage media can store operating systems and computer programs. These computer programs include program instructions that, when executed, cause the processor to perform specific implementation steps of any method for simplifying musical notation or assigning fingerings.

[0159] The processor provides computing and control capabilities, supporting the operation of the entire computer device.

[0160] Internal memory provides an environment for the execution of computer programs in non-volatile storage media. When the computer program is executed by the processor, it enables the processor to execute the specific implementation steps of any method of simplifying musical scores or assigning fingerings.

[0161] This network interface is used for network communication, such as sending assigned tasks.

[0162] It should be understood that the processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0163] In one embodiment, the processor is configured to run a computer program stored in memory to perform the following steps: S101, Obtain the original score, which includes the accompaniment and melody parts; S102, extract chord units from the accompaniment part based on a preset chord extraction algorithm; generate a simplified target accompaniment part based on the beat position of the chord units and the first retained note in each chord unit; wherein, the first retained note includes the root note in each chord unit; and / or, S103, based on the start time of the notes, extract several independent note events from the melody part; based on the beat position of the note events and the second retained note in each note event, generate a simplified target melody part; wherein, the second retained note includes the highest note in each note event; S104, Generate a simplified score corresponding to the original score based on the target melody part and / or the target accompaniment part.

[0164] In one embodiment, the processor is configured to run a computer program stored in memory to perform the following steps: S201, Obtain the sheet music to be played; S202, Based on the first time window, perform sliding analysis on the pitch sequence of the score to be played to determine the contextual features of each note; S203, based on the context features and preset fingering constraints, determine the fingering sequence of the score to be played, wherein the fingering sequence includes the target fingering for each note; the preset fingering constraints include teaching presentation constraints.

[0165] For example, the processor is used to run a computer program stored in the memory, and is also used to implement the specific implementation steps of the music score simplification method and the fingering assignment method provided in any embodiment of this application, which will not be repeated here.

[0166] The embodiments of this application also provide a computer-readable storage medium storing a computer program, the computer program including program instructions, and the processor executing the program instructions to implement the steps and specific implementation steps of the music score simplification method and the fingering assignment method provided in any of the embodiments of this application.

[0167] The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiments, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, SmartMedia Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the computer device.

[0168] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for allocating fingerings in playing music, characterized in that, The method includes: S201, Obtain the sheet music to be played; S202, Based on the first time window, perform sliding analysis on the pitch sequence of the score to be played to determine the contextual features of each note; S203, based on the context features and preset fingering constraints, determine the fingering sequence of the score to be played, wherein the fingering sequence includes the target fingering for each note; The preset finger placement constraints include teaching presentation constraints; wherein, the teaching presentation constraints include at least one of the following conditions: a. In any musical score segment within a second time window, the number of finger types playing notes is less than or equal to the first type threshold, and / or the number of finger switching is less than or equal to the second switching threshold; b. The finger combination belongs to the set of allowed finger combinations based on the user's skill level; c. In any third time window of the musical score segment, the preset number of times that adjacent notes with different pitches and consecutive time are assigned to the same finger is less than or equal to the third number threshold.

2. The method according to claim 1, characterized in that, The contextual features include interval span and / or melodic trend.

3. The method according to claim 1, characterized in that, The preset fingering constraints also include context constraints; the fingering sequences include a type I fingering sequence and a type II fingering sequence; the method further includes: Based on the fingering restrictions in the first musical score fragment, generate a class of fingering sequences for the first musical score fragment; Extract the playing fingering of at least one endpoint note of the fingering sequence as the context constraint; the endpoint note is the note at the beginning or end of the first musical score segment. Based on step S203, generate the second type of fingering sequence for the remaining musical score fragments.

4. The method according to claim 3, characterized in that, The fingering restrictions include at least one of the following: fingering manually marked by the user, fingering markings originally provided by the composer, or fingering recommended for instruction.

5. The method according to claim 1, characterized in that, The method further includes: If any musical score fragment cannot generate a fingering sequence that satisfies the teaching presentation constraints, the corresponding complex musical score fragment is simplified, and the simplification process includes deleting or replacing at least one note in the complex musical score fragment.

6. The method according to claim 5, characterized in that, The simplified processing corresponds to the complex musical score fragments, including: Based on a preset chord extraction algorithm, chord units are extracted from the accompaniment parts of complex musical scores. A simplified target accompaniment part is generated based on the beat position of the chord units and the first retained note in each chord unit; wherein the first retained note includes the root note in each chord unit.

7. The method according to claim 5, characterized in that, The simplified processing corresponds to the complex musical score fragments, including: Based on the start time of the notes, several independent note events are extracted from the melodic part of a complex musical score fragment. A simplified target melody part is generated based on the beat position of the note events and the second retained note in each note event; wherein the second retained note includes the highest note in each note event.

8. The method according to claim 1, characterized in that, S203 includes: S2031, Based on the context features, determine the possible fingering combinations between adjacent notes; the fingering is used to indicate the hand and fingers for playing the notes; S2032, based on preset fingering constraints, determine the target fingering for each note from the selectable fingering combinations to generate a fingering sequence.

9. A computer device, characterized in that, The device includes: Memory, used to store computer programs; A processor for executing the computer program and, in executing the computer program, implementing the fingering assignment method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the fingering assignment method as described in any one of claims 1 to 8.

Images