Playing data display method and display system

Abstract

The invention relates to the field of piano intelligent display, in particular to a playing data display method and system, and the method comprises the steps: obtaining music score data; the music score data comprises one or more of the following: standard time values, standard strength, standard fingering and standard pitches corresponding to the plurality of notes; the playing data of the user are obtained, the playing data of the user comprise data sets at multiple moments, and the data sets comprise one or more of the following data: time value data, force data, fingering data and pitch data; judging whether at least one data group is matched with the corresponding music score data or not; if yes, correlation comparison is carried out on the music score data and the matched data set, and the difference degree is calculated; and displaying the music score, and displaying the associated data group in a region corresponding to the notes. According to the playing data display method provided by the invention, visual optimization can be realized on the basis of ensuring the integrity of playing parameters.

Description

Technical Field

[0001] The present invention relates to the field of intelligent display of pianos, and particularly to a method and a display system for displaying performance data. Background Art

[0002] Piano practice often highly depends on the guidance of professional teachers because it is often very difficult for piano practitioners to have an accurate and intuitive understanding of the playing effect, so the learning cost of the piano is very high. Currently, some methods for digital feedback and evaluation of piano performance effects are provided in the prior art.

[0003] For example, patent application CN119274578A discloses a music performance evaluation system, which basically includes an audio input unit, a notification device, and at least one processor. The audio input unit is configured to input music performance. The notification device outputs an evaluation of the music performance received via the audio input unit. At least one processor executes a music performance evaluation program to identify errors in the music performance based on reference data including error-containing music performance segments, classify the errors in the music performance into significant errors or non-significant errors, and instruct the notification device to output an evaluation of the music performance in a manner that identifies the presence of significant errors different from non-significant errors.

[0004] Again, for example, patent application CN108597300A discloses a note display method and device. The method includes: starting a timing function; listening for a first message generated by triggering a music control; determining a target note according to the first message, where the target note is the note associated with the triggered music control; determining whether the timing period has ended; if the timing period has not ended, storing the target notes in a target note list in the order of determining the target notes; if the timing period has ended, displaying the notes in the target note list on a staff.

[0005] Still, for example, patent application CN107767847A discloses an intelligent piano performance evaluation method and system, which collects the user's MIDI audio digital signal and converts it into performance data; matches the user's performance time series and the master's performance time series on the time axis; performs pitch determination on the note groups played by the user and the master; performs rhythm determination on the relative note durations of the notes played by the user and the master; calculates the relative speed of the user's performance speed and the master's performance speed for speed determination; performs dynamics determination on the note dynamics of the notes played by the user and the master; comprehensively evaluates the performance pitch, performance rhythm, performance speed, and performance dynamics; and marks the result of the comprehensive evaluation on the staff of the intelligent terminal.

[0006] However, although these methods can provide data feedback and evaluation for the piano performance effect to a certain extent, they also pose higher requirements for the user's data capture ability. Therefore, there is an urgent need for a performance data display method that can facilitate piano practitioners to improve their practice efficiency through the optimization of the display scheme. Summary of the Invention

[0007] The object of the present invention is to provide a performance data display method and a display system, which can partially solve or alleviate the above deficiencies in the prior art, enabling users to clearly and intuitively understand their own performance status through the display scheme presented by the present invention. To solve the above-mentioned technical problems, the present invention specifically adopts the following technical solutions: In the first aspect of the present invention, there is provided a performance data display method, including the steps of: S101, obtaining music score data, where the music score includes: a plurality of syllables, and one syllable is represented by at least one note; the music score data includes one or more of the following: the standard time value, standard intensity, standard fingering, and standard pitch corresponding to the plurality of notes; S102, obtaining user performance data, where the user performance data includes data groups at multiple moments, and the data group includes one or more of the following data: time value data, intensity data, fingering data, and pitch data; S103, determining whether at least one of the data groups matches the corresponding music score data; S104, if so, associating and comparing the music score data with the matching data group, and calculating the degree of difference; the degree of difference includes at least one of the time value difference, intensity difference, fingering difference, and pitch difference; S105, displaying the music score, and displaying the associated data group in the corresponding area of the note; where S105 includes the steps of: S1051, generating the priority of the data group according to the error frequency, and S1051 includes the steps of: S1051A, determining whether the error frequency is greater than the first threshold, if so, then, according to the degree of difference between the data group and the music score data, setting the data group with the degree of difference greater than the first preset degree of difference as the first priority, and setting the data group with the degree of difference less than or equal to the first preset degree of difference as the second priority; S1051B, displaying the data group according to the generated priority, where the data group with the first priority is preferentially displayed.

[0008] In some embodiments, the method further includes: S1052. Generate a subclass priority for the data group set as the first priority according to the error frequency. S1052 includes the steps: S1052A. Determine whether the error frequency is greater than a second threshold, where the second threshold is greater than the first threshold. S1052B. If so, obtain the error proportion of the playing error types in the data group, where the playing error types are one or more of duration error, dynamics error, fingering error, and pitch error; the error proportion is the proportion of at least one type of error among all types of playing errors. S1052C. Set the data group with the error proportion greater than the first error proportion as the first error subclass priority, and set the data group with the error proportion less than or equal to the first preset error proportion as the second error subclass priority. S1052D. Display the data groups according to the subclass priority, where the data groups with the first error subclass priority are preferentially displayed.

[0009] In some embodiments, the method further includes: S1053. Perform combined display on the data groups according to the display density of the data groups, where the display density is the number of data groups per measure; S1053 includes the steps: S1053A. Determine whether the display density is greater than a first density. S1053B. If so, determine whether the data similarity between two adjacent data groups is greater than a first similarity, where the data similarity requirement includes at least two of duration similarity, dynamics similarity, fingering similarity, and pitch similarity. S1053C. If so, identify the corresponding data groups as similar data groups. S1053D. Determine whether the number of the similar data groups is greater than a first similar number. S1053E. If so, merge the data groups to obtain a first merged data group.

[0010] In some embodiments, the method further includes: S1054. Perform combined display on the data groups according to whether the priorities between two adjacent data groups are continuous (or the same); S1054 includes the steps: S1054A. Determine whether the two adjacent data groups are of the same priority. S1054B. If so, identify the corresponding data groups as continuous data groups. S1054C. Merge the continuous data groups to obtain a second merged data group.

[0011] In some embodiments, the method further includes: generating a performance status prompt icon according to the continuous data groups: when the adjacent two data groups are both of the first priority, generating a first performance status prompt icon; when the adjacent two data groups are both of the second priority, generating a second performance status prompt icon.

[0012] In some embodiments, the method further includes: adding visual emphasis elements with different intensities to the data groups and the performance status prompt icons corresponding to different priorities, where the visual emphasis elements include static graphic marks, dynamic visual effects, color changes, and animation effects.

[0013] In some embodiments, the method further includes: determining the display height of the data group in the score height direction according to the pitch data.

[0014] A second aspect of the present application lies in providing a performance data display system, where the display system includes: A score data acquisition module, configured to acquire score data, where the score includes: a plurality of syllables, and one syllable is represented by at least one note; the score data includes one or more of the following: standard time values, standard dynamics, standard fingerings, and standard pitches corresponding to the plurality of notes; A user data acquisition module, configured to acquire user performance data, where the user performance data includes data groups at multiple moments, and the data groups include one or more of the following data: time value data, dynamics data, fingering data, and pitch data; A matching and comparison data module, configured to determine whether at least one of the data groups matches the corresponding score data; if so, associatively comparing the score data with the matching data group and calculating the degree of difference; the degree of difference includes at least one of a time value difference, a dynamics difference, a fingering difference, and a pitch difference; A data group display module, configured to display the score and display the associated data group in the area corresponding to the note; where it includes a sub-module: A priority generation sub-module, configured to generate the priority of the data group according to the error frequency, including units: A judgment unit, configured to judge whether the error frequency is greater than a first threshold; if so, setting the data group with a difference degree greater than a first preset difference degree as the first priority and setting the data group with a difference degree less than or equal to the first preset difference degree as the second priority according to the degree of difference between the data group and the score data; A display unit, configured to display the data group according to the generated priority, where the data group of the first priority is preferentially displayed.

[0015] In a third aspect of the present application, there is provided a computer device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and, when executing the computer program, implement the performance data display method described in any one of the embodiments.

[0016] In a fourth aspect of the present application, there is also correspondingly provided a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the performance data display method described in any one of the embodiments.

[0017] Beneficial technical effects: In the present invention, the intensity data, duration data, fingering data, and pitch data corresponding to each played note are displayed in the form of a data group. By completely displaying each note data played by the user, it is beneficial for the user to understand every professional detail worthy of improvement. At the same time, the priority of the data group is set according to the changes in the user's state and scene mode, and then screening and merging are performed, which greatly optimizes the visual effect. Specifically, the technical effects produced by a performance data display method proposed by the present invention are as follows: 1) The redundant and huge performance data is decomposed into independent parameter sets with each note as a unit and presented in the form of a data group. Compared with the traditional method, the "atomic-level" display method of the present invention greatly improves the user's positioning efficiency for performance detail problems; 2) The present invention sets different priorities and sub-class priorities for the data group according to the playing state and specific scene mode reflected by the playing errors made by the user, so as to screen out high-value data from a large number of performance data groups, and then ensure the dynamic balance of the user experience and data integrity on the basis of the complete display of the performance data, and improve the user's error correction efficiency; 3) The present invention merges data groups with the same priority and relatively high similarity to reveal the rules behind the performance data to the user, so that the display density of the data group always remains within a reasonable range that is more suitable for the user's visual habits, and can further balance the contradiction between the retention of details of subtle differences between data groups and the display efficiency; 4) By adding different visual emphasis elements to render data groups with different priorities, merged data groups, and performance state prompt icons, the user can be quickly focused on key data through visual hints, helping the user intuitively understand the logical relationship of data display. In addition, instant feedback can be provided through the dynamic change of visual emphasis elements (such as color switching), enhancing the user's operation interaction feeling. Description of the Drawings

[0018] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts do not necessarily draw to actual scale. Obviously, the following-described drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0019] Figure 1 Schematic flowchart of a performance data display method provided by an embodiment of this application; Figure 2 Schematic diagram of performance data display provided by an embodiment of this application; Figure 3 Schematic diagram of misplayed display of a performance data display method provided by an embodiment of this application; Figure 4 Schematic diagram of missed-play display of a performance data display method provided by an embodiment of this application; Figure 5 Schematic diagram of extra-play display of a performance data display method provided by an embodiment of this application; Figure 6 Schematic diagram of custom display of a data group provided by an embodiment of this application; Figure 7 Schematic block diagram of a performance data display system provided by an embodiment of this application; Figure 8 Structural schematic block diagram of a computer device provided by an embodiment of this application. Detailed implementation manners

[0020] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0021] In this article, suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of the description of the present invention, and they have no specific meaning themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0022] In this document, the orientation or positional relationship indicated by terms such as "upper", "lower", "inner", "outer", "front", "rear", "one end", "the other end", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation to the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance.

[0023] In this document, unless otherwise clearly specified and defined, terms such as "installed", "provided with", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium, and can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0024] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0025] In this document, "a plurality of" means two or more, that is, it includes two, three, four, five, etc.

[0026] As used in this specification, the term "about" typically represents + / - 5% of the value, more typically + / - 4% of the value, more typically + / - 3% of the value, more typically + / - 2% of the value, even more typically + / - 1% of the value, and even more typically + / - 0.5% of the value.

[0027] In this specification, certain embodiments may be disclosed in a format within a certain range. It should be understood that this kind of "within a certain range" description is only for convenience and brevity, and should not be construed as a rigid limitation to the disclosed range. Therefore, the description of the range should be considered as having specifically disclosed all possible sub-ranges and the individual numerical values within this range. For example, the description of the range 1 - 6 should be regarded as having specifically disclosed sub-ranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., and the individual numbers within this range, such as 1, 2, 3, 4, 5, and 6. The above rules apply regardless of the breadth of the range.

[0028] Example 1: Selected embodiments will now be described with reference to the drawings. Those skilled in the art in the field of intelligent display of pianos will appreciate from this disclosure that the following description of the embodiments is provided for illustration only and not for limiting the purpose of the present invention as defined by the appended claims and their equivalents.

[0029] See Figure 1 As shown, the present invention provides a flowchart of a method for displaying performance data. Generally, it includes the steps: S101, obtain score data, where the score includes: a plurality of syllables, and one of the syllables is represented by at least one note; the score data includes one or more of the following: the standard time value, standard intensity, standard fingering, and standard pitch corresponding to a plurality of the notes; It should be understood that obtaining the score data is both for matching and comparing with the user's playing data and for providing a display position reference for the display of performance data. The data group is displayed at the note position of the score and / or in the adjacent area of the note, enabling the user to intuitively understand the pitch change of their playing even without analyzing the pitch data.

[0030] During the actual playing process, the user's playing data may include: pitch data, fingering data, hand shape data, time value data, intensity data, pedal data, body shape data, etc. It should be understood that musical instrument performance, especially keyboard instruments such as the piano, has a wide range of pitches and dynamic ranges. From the softest notes to the most powerful sounds, the performer needs to precisely control key pressing, pedal use, rhythm, and intonation, etc., while conveying the emotion and style of the work. Therefore, during practice, the performer needs to pay attention to many evaluation dimensions, and each evaluation dimension affects the final musical performance. These dimensions help improve the performer's comprehensive ability and ensure that their performance is both technically proficient and artistically appealing.

[0031] Preferably, the present invention focuses on professional performers and / or people with high requirements for performance, and screens out these three types of data: fingering data, time value data, and intensity data. Among them, intensity changes show the concentration of emotion and emotional changes, smooth fingering ensures technical accuracy, and accurate time value improves the rhythm and sense of rhythm of playing. These three indicators often have the largest room for improvement and the greatest difficulty in optimizing practice when professional performers practice the score.

[0032] Specifically: 1) The display of fingering data is beneficial for the user to improve technical stability. In professional performances, complex passages (such as fast scales on the piano) have extremely high requirements for fingering. Through fingering data analysis, the user can correct incorrect fingering (such as stuttering caused by frequent finger changes), and targeted optimization can reduce technical mistakes and improve fluency. The hand sizes and finger flexibilities of different performers vary significantly. For example, for chords with a large span in piano performance, the fingering needs to be adjusted in time to avoid muscle fatigue or injury.

[0033] 2) The display of duration data helps to ensure the accuracy of music rhythm. Professional music pieces often contain free rhythms, complex syncopations, or asymmetric beats. The display of duration data can facilitate the quantitative analysis of the deviation between the actual playing duration of notes and the standard sheet music data, helping users correct problems such as "lagging behind the beat" or "beating ahead of the beat". Moreover, large-scale works often require the division of paragraphs and levels through duration control. For example, the accuracy of the duration of rests in Beethoven's symphonies directly affects the accumulation and release of dramatic tension.

[0034] 3) The display of dynamics data helps users enhance emotional tension. Professional performances need to create contrast effects within a very narrow dynamic range to highlight the emotional changes in music. Dynamics data can quantify the loudness of each note, avoiding the problem of "flat performance effects". For example, the "staccato" and "legato" of the piano especially rely on the explosive power that can instantly reach a high dynamic value. Therefore, the dynamic level can very intuitively reflect the emotions of the performance (such as "sad", "cheerful", etc.).

[0035] S102, obtain the user's performance data, where the user's performance data includes data groups at multiple moments, and the data groups include one or more of the following types of data: duration data, dynamics data, fingering data, pitch data; It should be noted that the data groups are mainly presented in the form of "data frames" in the drawings of the present invention. The main purpose is to help users improve training efficiency and the accuracy of artistic expression while constructing a visually friendly feedback mechanism between sheet music expression and data analysis display. However, the data groups can also have other forms, such as data bars, data columns, data circles, etc. As Figure 6 shown, the user can click the edit button in the upper right corner of the data group to customize the display shape of the data group. It should be understood that as long as the performance data is displayed according to the method of the present invention to achieve the purpose of adaptive visualization of performance data, it should fall within the protection scope of the present invention. The shape of the data group is not limited in the present invention.

[0036] In some embodiments, the duration data, dynamics data, fingering data, and pitch data can be correspondingly collected through detection devices such as sensors. For example, a dynamics sensor or a displacement sensor is provided under the keys, which can detect the force of the user's key presses in real time.

[0037] Furthermore, finger technique data, duration data, dynamics data, and pitch data are not isolated performance data. On the contrary, to a certain extent, they are mutually coupled (for example, insufficient dynamics on a piano may also expose finger technique problems, and incorrect finger technique may also lead to incorrect pitch). Such multi-dimensional data cross-analysis can help users analyze performance problems more comprehensively and systematically, thereby improving the error correction efficiency. Therefore, the linked display of performance data is conducive to obtaining more valuable performance suggestions for users through multi-dimensional data correlation analysis. Preferably, if the actual dynamics data of a note is significantly lower than the standard dynamics data, the data set can also suggest that the user change the finger to increase the key pressing speed, thereby making the actual dynamics data closer to the standard dynamics data.

[0038] In some embodiments, please refer to Figure 6 , users can edit the performance data displayed in the data set according to their needs. For example, users can choose to display single data (such as only displaying finger technique data) or combined data (such as displaying duration data and dynamics data), thereby helping users focus more on the performance indicators they most want to improve.

[0039] For professional or advanced performers, the refined analysis and display of finger technique, duration, dynamics, and pitch data essentially convert subjective awareness into visible and measurable technical indicators. The performance data display method proposed by the present invention not only facilitates error correction for users, but also promotes the leap of performance level from "accurate" to "excellent", ultimately serving the depth and uniqueness of musical expression.

[0040] S103. Determine whether at least one of the data sets matches the corresponding score data; If so, the data set can be associated with the score data, and the data set can be displayed at the corresponding note on the score.

[0041] For example, in some embodiments, the time when the data set is generated can be matched with the score data. Each note in the score data has a corresponding performance rhythm (i.e., a certain order or time of appearance). Therefore, it can be determined which note's data set the data set is associated with based on the generation time of the data set.

[0042] Alternatively, in some embodiments, whether the data set and the score data match can be evaluated based on the similarity of one or more data in the data set and the score data. For example, the similarity between the duration data and the standard duration can be used as the similarity degree, the similarity between the dynamics data and the standard dynamics can be used as the similarity degree, the similarity between the finger technique data and the standard finger technique can be used as the similarity degree, the similarity between the pitch data and the standard pitch can be used as the similarity degree, or the sum or weighted value of any at least two of the above similarity degrees can be used as the similarity degree.

[0043] If the data group matches the music score data, the data group can be associated with each type of data in the music score data. In some embodiments, if the data group does not match the corresponding music score data, it may include two cases: when the actual playing data cannot be associated with the music score data, it indicates that the user plays extra notes. At this time, a multi-play prompt can be made within the display range of the data group, such as Figure 5 shown; when the music score data cannot be associated with the actual playing data, it indicates that the user misses the target note. At this time, a missed-play prompt can be made within the data group range. Please refer to Figure 4 , Figure 4 As shown in, when a missed play occurs, the data group is not displayed at the target note that the user does not play, to prompt the user that a missed play occurs here.

[0044] Furthermore, in some embodiments, targeted display schemes can be implemented for users who often "play extra", often "miss play", and often "play wrongly", respectively. For example: for users who often "play extra", focus on fingering detection; for users who often "miss play", enhance the display readability to facilitate the user to improve the music score recognition ability through the present invention.

[0045] Furthermore, in some embodiments, it further includes: S104, if so, associate and compare the music score data with the matching data group, and calculate the degree of difference; the degree of difference includes at least one of time value difference, intensity difference, fingering difference, and pitch difference; Specifically, the music score data is associated and compared with the matching data group correspondingly, and the degree of difference of each type of playing data is calculated to accurately judge whether the user's playing data is correct. The degree of difference is used to represent the deviation degree between the music score data and the matching data group. The reason for introducing the concept of the degree of difference is to more personalized and targeted distinguish the deviation degree of the data group from the music score data (or classify the performance data), avoiding one-size-fits-all display, which not only improves the flexibility and adaptability of the performance data display, but also enables the user to focus more on the more obvious playing errors and maximize the practice benefits.

[0046] S105, display the music score, and display the associated data group in the corresponding area of the note; where the error frequency is the number of all playing errors occurring within a set time; or the number of all playing errors occurring within a set measure; the length of the set time and the set measure can be set by the user; S105 includes the steps: S1051. Generate the priority of the data group according to the error frequency, where the error frequency is the number of all playing errors occurring within a set time; or the number of all playing errors occurring within a set measure; the lengths of the set time and the set measure can be set by the user; S1051 includes the steps: S1051A. Determine whether the error frequency is greater than a first threshold. If so, then, according to the degree of difference between the data group and the score data, set the data group with the degree of difference greater than a first preset degree of difference as the first priority, and set the data group with the degree of difference less than or equal to the first preset degree of difference as the second priority; S1051B. Display the data group according to the generated priority, where the data group with the first priority is preferentially displayed.

[0047] Exemplarily, for the display effect of the performance data proposed by the present invention, reference can be made to Figure 2 .

[0048] In some embodiments, the preferential display may mean that when at least two data groups overlap on the display interface, the data group with the first priority is displayed on the top layer, or the display intensity (such as contrast, transparency, color depth) of the data group with the first priority is higher than that of the second priority. Please refer to Figure 3 , Figure 3 As shown in, a red wireframe is added to the data group with the first priority, and the display area is filled with red to visually display the priority difference between the data groups, facilitating the user to improve the error correction efficiency.

[0049] It should be noted that the core purpose of step S1051 is to realize data screening based on the priorities of different data groups, so as to solve the contradiction between data overload and limited attention. Specifically, based on the classification and grading of performance data, the present invention can assign different display priorities to performance data in different time periods, different error types, and different playing scenarios, and adjust the display density of the data group in a scenario-based, personalized, and adaptive manner according to this display priority, thereby transforming the redundant and static performance data into an orderly and dynamic visual index.

[0050] In some embodiments, when the error frequency is lower than the first error threshold, all matched data groups can be displayed, and different priorities can also be set for the data groups for differential display.

[0051] Exemplarily, it is also possible to determine whether to hide the data groups with lower priorities in combination with the user's playing error frequency and display density.

[0052] In some embodiments, since the error frequency of the user's performance can, to a certain extent, indicate their playing level and the user identity reflected behind it. If the error frequency of the user's performance is lower than the first error threshold (e.g., 5%), it can indicate that the user has a high playing level. At this time, when exploring what the user really needs to improve during performance, it is often not about the user's familiarity with the sheet music or their adaptability to the difficulty of the sheet music, but rather about the improvement of playing skills. This requires a comprehensive presentation of the performance data to help the user have an overall grasp of the performance effect. On this basis, exemplarily, different visual emphasis elements can be added to render data groups with different priorities, and data groups with lower priorities can also be hidden, so that the user can pay different attentions to data groups with different priorities while ensuring data integrity.

[0053] The present invention also provides a method for displaying data groups. In some embodiments, S105 further includes: S1052, generating subclass priorities for the data groups set as the first priority according to the error frequency. S1052 includes the steps of: S1052A, determining whether the error frequency is greater than a second threshold, where the second threshold is greater than the first threshold; S1052B, if so, obtaining the error proportion of the error types in the data groups during performance, where the error types during performance are one or more of duration error, dynamics error, fingering error, and pitch error; the error proportion is the proportion of at least one type of error in all types of performance errors; S1052C, setting the data groups with the error proportion greater than the first error proportion as the first error subclass priority, and setting the data groups with the error proportion less than or equal to the first preset error proportion as the second error subclass priority; S1052D, displaying the data groups according to the subclass priorities, where the data groups with the first error subclass priority are preferentially displayed.

[0054] It should be understood that when the error frequency of the user is not only higher than the first threshold but also exceeds the second threshold, it can indicate that the user's playing level is not high, their state is not good, or the difficulty of the sheet music is high. Therefore, the present invention further analyzes the playing key points that the user should focus on improving most currently according to the proportion of different types of errors (such as duration error, dynamics error, fingering error, and pitch error) in all errors, that is, the error proportion, so as to maximize the error correction efficiency within the same time and avoid the contradiction between limited attention and data overload.

[0055] In some embodiments, the error frequency may be set to at least the frequency of a certain type of performance data error. For example, when the user wants to concentrate on practicing the fingerings of a musical score, or when the proportion of the user's fingering errors among all types of errors is particularly high (such as exceeding 50%), at this time, the time value errors and dynamics errors can be ignored, and the frequency of the fingering errors can be regarded as the error frequency. Then, a more targeted data group priority can be set according to this "customized" error frequency, which is convenient for the user to carry out personalized intensive practice.

[0056] Of course, this step is also applicable to professional players or players with a very high playing level. In some embodiments, the user can customize the settings of the first preset difference degree and the first preset error ratio: for example, the initial first preset difference degree and the first preset error ratio can be adjusted downward as needed, so as to increase the high-priority data groups and facilitate the user to carry out higher-standard advanced practice.

[0057] The present invention also provides a method for displaying data groups. In some embodiments, S105 further includes: S1053, combining and displaying the data groups according to the display density of the data groups, where the display density is the number of data groups in a unit measure; S1053 includes the steps of: S1053A, determining whether the display density is greater than a first density; S1053B, if so, determining whether the data similarity between two adjacent data groups is greater than a first similarity, where the data similarity requirement includes at least two of time value similarity, dynamics similarity, fingering similarity, and pitch similarity; preferably, at least two similarities need to be greater than the first similarity.

[0058] S1053C, if so, identifying the corresponding data groups as similar data groups; S1053D, determining whether the number of the similar data groups is greater than a first similar number; S1053E, if so, combining the data groups to obtain a first combined data group.

[0059] Preferably, when the number of consecutive similar data groups is greater than the first similar number, the data groups are combined.

[0060] It should be noted that, for the convenience of structurally dividing the musical score, the "measure" mentioned in the present invention refers to the smallest repeatable training paragraph unit divided by the measure line (vertical line) in the musical score. Combining and displaying similar data groups in units of measures can help the user quickly locate the problem areas and better adapt to the score-reading habits of piano-playing users.

[0061] Of course, in some embodiments, the "bar" range can also be flexibly adjusted according to the complexity of the track, which is not limited here.

[0062] In some embodiments, ensuring that the number of data groups in a unit bar does not exceed the first density, the core purpose is to maintain the readability of the data display and the interface is simple and clear enough, without causing visual chaos due to too many data groups, improving the display efficiency of the performance data, and being highly adaptable to the complex scenarios of piano performance.

[0063] In some embodiments, not only can two adjacent similar data groups be merged, but also multiple adjacent (such as five) similar data groups can be merged. As long as the similarity between multiple data groups is greater than the first similarity, the data groups are considered similar, further reducing the cognitive load and improving the display efficiency.

[0064] It should be noted that the similar data groups judged by the present invention are only approximations in several types of playing data. Such a design is for the display efficiency of the data groups, but it does not mean that the data groups are completely approximate. Therefore, in some cases, excessive merging may obscure subtle differences (such as merging data groups based on approximate fingering and dynamics, but the pitch and duration are not approximate), and at this time, important small differences may be ignored. Therefore, in order to balance the contradiction between the granularity of merging and the complete display of details, the user can increase the requirements for the data categories constituting similarity to three, four or more, which is not limited here.

[0065] In some embodiments, the duration data, dynamics data, fingering data, and pitch data of the first merged data group can be the average value or the most representative value of the corresponding data in all approximate data groups. Of course, the most representative value mentioned here can also be custom-set by the user according to needs, such as the maximum value, the minimum value, or the value closest to the standard score data.

[0066] The present invention also provides a method for displaying data groups. In some embodiments, S105 further includes: S1054, merging and displaying the data groups according to whether the priorities between two adjacent data groups are continuous; S1054 includes the steps: S1054A, determining whether the two adjacent data groups are of the same priority; S1054B, if so, identifying the corresponding data groups as continuous data groups; S1054C, merging the continuous data groups to obtain a second merged data group.

[0067] In some embodiments, two or more data groups in which the user plays continuously correctly, or continuously incorrectly, or the error ratio of a certain type of error is continuously greater than or less than a first preset error ratio can be combined. The main purpose is to further improve the readability of data display and make the interface simple, clear, and not visually chaotic due to too many data groups, thus improving the display efficiency of performance data and being highly adaptable to the complex scenarios of piano performance.

[0068] The method for obtaining the display data of the second combined data group is similar to that of the first combined data group, which can be the average value or the most representative value of the corresponding data in all approximate data groups. Of course, the most representative value mentioned here can also be custom-set by the user according to their needs, such as the maximum value, the minimum value, or the value closest to the standard score data.

[0069] In addition, in some embodiments, different from the first combined data group which is a combination of approximate data groups, the second combined data group also reflects the display priorities of two or more data groups behind it. Therefore, different visual emphasis elements can be added and rendered to the second combined data group and the first combined data group, so that the user pays different attentions to the first combined data group and the second combined data group.

[0070] In some embodiments, S1054C further includes: Generating a performance status prompt icon according to the continuously occurring data groups: When the adjacent two data groups are both of the first priority, generating a first performance status prompt icon; When the adjacent two data groups are both of the second priority, generating a second performance status prompt icon.

[0071] In some embodiments, for data groups that are continuously updated to the first priority and the second priority, performance status prompt icons can be generated, such as "Great! You got everything right in this section!" or "Keep practicing and you will definitely make progress!" This can give appropriate reminders when the user often makes mistakes and give encouragement when the user plays well, which is beneficial to enhancing the user experience and interaction, and improving the enthusiasm and efficiency of practice.

[0072] Furthermore, different performance status prompt icons can also be generated for different error subclass priorities. For example, when the data group is continuously updated to the first error subclass priority (such as when a certain type of error in the data group is a timing error), a performance status prompt icon such as "Pay attention to the key pressing duration / Pay attention to stepping on the sustain pedal" can be generated.

[0073] By adding performance status prompt icons to the display of performance data, it is possible to understand the performance effect from a more macroscopic dimension on the basis of the form of the data group. Moreover, since the display priority of the performance status prompt icons is higher than that of the data group and the combined data group, it is convenient for users to have a multi-dimensional understanding of the data group display, reducing the user's cognitive threshold and improving the user's practice efficiency.

[0074] In some embodiments, it further includes: Adding different degrees of visual emphasis elements to the performance status prompt icons corresponding to different priorities, where the visual emphasis elements include static graphic marks, dynamic visual effects, color changes, and animation effects.

[0075] Among them, the visual emphasis element refers to various visualization elements used to highlight specific information, guide the viewer's attention, or enhance the viewing experience, so that the viewer can obtain key information through intuitive visual cues. Exemplarily, the visual emphasis element can be a static graphic mark, a dynamic visual effect, or a combination of both. Specifically, it can be a color change (such as highlighting, gradient color), a flashing effect (such as periodic flashing, pulse light effect, water ripple effect), an arrow indication (such as direction guidance, dynamic path), an icon and symbol, a text annotation (such as a short description, a numerical label), a shadow and contour (such as a projection effect, a halo design, a bold contour), an animation effect (such as an explosion and dispersion, floating bubbles), a line thickening or highlighting, etc., which are not limited here.

[0076] It should be understood that the different degrees of visual emphasis elements proposed by the present invention need to distinguish at least the following levels of data display effects: 1) Different priority data groups correspond to different visual emphasis elements; 2) Different combined data groups correspond to different visual emphasis elements; 3) Different performance status prompt icons correspond to different visual emphasis elements. Exemplarily, different visual elements such as colors, transparencies, contrasts, and lines can display the performance data in a more intuitive way, facilitating hierarchical attention guidance for users, improving the recognition speed of key information, shortening the error correction response time, and at the same time reducing the visual fatigue of users for a single performance data display form.

[0077] In some embodiments, it further includes: Determining the display height of the data group in the musical score height direction according to the pitch data.

[0078] In some embodiments, the display height of the data group in the musical score height direction reflects the pitch data actually played by the user. Therefore, the deviation value between the data group and the note can also intuitively reflect the deviation value of the pitch played by the user, and at the same time reflect the scale trend of the musical score, improving the user's practice efficiency.

[0079] In some embodiments, to ensure that the data group display efficiently adapts to the size of the music score display interface, exemplarily, the display area of the data group in the music score can be: taking the position and display size of the corresponding note head as a reference to determine the display boundary of the data group.

[0080] Preferably, in some embodiments, the display of the data group should pay attention to avoiding obscuring symbols such as stems and slurs, ensuring the compatibility between the data group display and the music score.

[0081] Preferably, in some embodiments, the different display positions of the data group can also be determined according to the stem direction. For example, when the stem is downward, the data group is displayed in the lower area of the note head; when the stem is upward, the data group is displayed in the upper area of the note head. Through such differentiated display, it can ensure a visual balance between the stem and the display of the data group, indicating the adaptability of the present invention to the user's visual habits.

[0082] In some embodiments, the data group can also be displayed in an embedded manner. For example, the data group only pops up when the user hovers over or clicks on the note area, which can maintain the visual purity of the music score and also facilitate the user to correct errors more pertinently.

[0083] Embodiment 2: The present invention also provides a performance data display system. Please refer to Figure 7 , Figure 7 which is a schematic block diagram of a performance data display system provided by an embodiment of the present application. The display system includes: A music score data acquisition module 10, configured to acquire music score data, where the music score includes: a plurality of syllables, and one of the syllables is represented by at least one note; the music score data includes one or more of the following: the standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the plurality of notes; A user data acquisition module 20, configured to acquire user performance data, where the user performance data includes a data group at a plurality of moments, and the data group includes one or more of the following data: time value data, dynamics data, fingering data, and pitch data; A matching and comparing data module 30, configured to determine whether at least one of the data groups matches the corresponding music score data; if so, associate and compare the music score data with the matching data group, and calculate the degree of difference; the degree of difference includes at least one of a time value difference, a dynamics difference, a fingering difference, and a pitch difference; A display data group module 40, configured to display the music score and display the associated data group in the corresponding area of the note; where it includes a sub-module: A generation priority sub-module 401, configured to generate the priority of the data group according to the error frequency, including units: A determination unit 401A is configured to determine whether the error frequency is greater than a first threshold. If so, according to the degree of difference between the data group and the music score data, the data group with a degree of difference greater than a first preset degree of difference is set as the first priority level, and the data group with a degree of difference less than or equal to the first preset degree of difference is set as the second priority level; A display unit 401B is configured to display the data group according to the generated priority level, wherein the data group with the first priority level is preferentially displayed.

[0084] Exemplarily, the performance data display system further includes: a subclass priority generation module 402 configured to generate a subclass priority of the data group set as the first priority level according to the error frequency; The subclass priority generation module 402 further includes: a determination unit configured to determine whether the error frequency is greater than a second threshold, wherein the second threshold is greater than the first threshold; an error ratio acquisition unit configured to, if so, acquire the error ratio of the playing error types in the data group, wherein the playing error types are one or more of time value error, dynamics error, fingering error, pitch error; the error ratio is the proportion of at least one type of error in all types of playing errors; a priority level setting unit configured to set the data group with an error ratio greater than a first error ratio as the first error subclass priority level, and set the data group with an error ratio less than or equal to a first preset error ratio as the second error subclass priority level; a display unit configured to display the data group according to the subclass priority level, wherein the data group with the first error subclass priority level is preferentially displayed.

[0085] Exemplarily, the performance data display system further includes: a combined display module 403 configured to perform combined display on the data group according to the display density of the data group, wherein the display density is the number of data groups in a unit measure; The combined display module 403 further includes: a display density determination unit configured to determine whether the display density is greater than a first density; an adjacent similarity determination unit configured to, if so, determine whether the data similarity between two adjacent data groups is greater than a first similarity, wherein the data similarity requirement includes at least two of time value similarity, dynamics similarity, fingering similarity, pitch similarity; an identification unit configured to, if so, identify the corresponding data group as a similar data group; a similar number determination unit configured to determine whether the number of the similar data groups is greater than a first similar number; a combination unit configured to, if so, combine the data groups to obtain a first combined data group.

[0086] Exemplarily, the performance data display system further includes: a combined display unit 404, configured to perform combined display on the data groups according to whether the priorities between two adjacent data groups are continuous; The combined display unit 404 further includes: a judgment unit, configured to judge whether the two adjacent data groups have the same priority; an identification unit, configured to, if so, identify the corresponding data groups as continuous data groups; and a combination unit, configured to combine the continuous data groups to obtain a second combined data group.

[0087] Exemplarily, the performance data display system further includes: a performance state prompt icon generation module, configured to generate a performance state prompt icon according to the continuous data groups; wherein the performance state prompt icon generation module includes: a first performance state prompt icon generation unit, configured to generate a first performance state prompt icon when the two adjacent data groups are both of the first priority; and a second performance state prompt icon generation unit, configured to generate a second performance state prompt icon when the two adjacent data groups are both of the second priority.

[0088] Exemplarily, the performance data display system further includes: a visual emphasis element adding module, configured to add visual emphasis elements with different intensities to the data groups corresponding to different priorities and the performance state prompt icons, where the visual emphasis elements include static graphic marks, dynamic visual effects, color changes, and animation effects.

[0089] Exemplarily, the performance data display system further includes: a display height determination module, configured to determine the display height of the data groups in the score height direction according to the pitch data.

[0090] An embodiment of the present application further provides a schematic block diagram of the structure of a computer device. Please refer to Figure 8 , and the computer program can run on the computer device as shown in Figure 8 . As shown in Figure 8 , the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0091] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any one of the performance data display methods.

[0092] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0093] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any one of the performance data display methods.

[0094] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 8 the structure shown in

[0095] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0096] Among them, in one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps: S101, obtain music score data, where the music score includes: multiple syllables, and one syllable is represented by at least one note; the music score data includes one or more of the following: the standard time value, standard intensity, standard fingering, and standard pitch corresponding to multiple notes; S102, obtain user performance data, where the user performance data includes data groups at multiple moments, and the data groups include one or more of the following data: time value data, intensity data, fingering data, and pitch data; S103, determine whether at least one of the data groups matches the corresponding music score data; S104, if so, perform an associated comparison between the music score data and the matching data group, and calculate the degree of difference; the degree of difference includes at least one of the time value difference, intensity difference, fingering difference, and pitch difference; S105, display the music score, and display the associated data group in the area corresponding to the note; where S105 includes the steps: S1051, generate the priority of the data group according to the error frequency, and S1051 includes the steps: S1051A, determine whether the error frequency is greater than the first threshold, if so, Then, according to the degree of difference between the data group and the music score data, the data group with a degree of difference greater than the first preset degree of difference is set as the first priority level, and the data group with a degree of difference less than or equal to the first preset degree of difference is set as the second priority level; S1051B. Display the data group according to the generated priority level, wherein the data group with the first priority level is preferentially displayed.

[0097] Exemplarily, the processor is used to run the computer program stored in the memory, and is also used to implement the steps of the performance data display method provided in any embodiment of the present application, which will not be elaborated here.

[0098] An embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the computer program includes program instructions. The processor executes the program instructions to implement the performance data display method provided in any one of the embodiments of the present application.

[0099] Wherein, the computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiment, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the computer device. It should be noted that in this article, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, article or device including that element.

[0100] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a computer terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention.

[0101] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many forms without departing from the purpose of the present invention and the scope protected by the claims. All of these fall within the protection scope of the present invention.

Claims

1. A method for displaying performance data, characterized in that: S101. Obtain score data, where the score includes: a plurality of syllables, and one of the syllables is represented by at least one note; the score data includes one or more of the following: the standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the plurality of notes; S102. Obtain user performance data, where the user performance data includes data groups at multiple moments, and the data groups include one or more of the following data: time value data, dynamics data, fingering data, and pitch data; S103. Determine whether at least one of the data groups matches the corresponding score data; S104. If so, perform an associated comparison between the score data and the matching data group, and calculate the degree of difference; the degree of difference includes at least one of a time value difference, a dynamics difference, a fingering difference, and a pitch difference; S105. Display the score, and display the associated data group in the area corresponding to the note; where S105 includes the steps: S1051. Generate the priority of the data group according to the error frequency, and S1051 includes the steps: S1051A. Determine whether the error frequency is greater than a first threshold. If so, set the data group with a degree of difference greater than a first preset degree of difference as the first priority according to the degree of difference between the data group and the score data, and set the data group with a degree of difference less than or equal to the first preset degree of difference as the second priority; S1051B. Display the data group according to the generated priority, where the data group with the first priority is preferentially displayed.

2. The method for displaying performance data according to claim 1, wherein, S105 further includes: S1052. Generate the subclass priority of the data group set as the first priority according to the error frequency, and S1052 includes the steps: S1052A. Determine whether the error frequency is greater than a second threshold, where the second threshold is greater than the first threshold; S1052B. If so, obtain the error ratio of the playing error type in the data group, where the playing error type is one or more of a time value error, a dynamics error, a fingering error, and a pitch error; the error ratio is the proportion of at least one type of error in all types of playing errors; S1052C. Set the data group with an error ratio greater than a first error ratio as the first error subclass priority, and set the data group with an error ratio less than or equal to the first preset error ratio as the second error subclass priority; S1052D. Display the data group according to the subclass priority, where the data group with the first error subclass priority is preferentially displayed.

3. The method for displaying performance data according to claim 1, wherein S105 further includes: S1053. Perform combined display on the data group according to the display density of the data group, where the display density is the number of data groups in a unit measure; S1053 includes the steps: S1053A. Determine whether the display density is greater than a first density; S1053B. If so, determine whether the data similarity between two adjacent data groups is greater than a first similarity, where the data similarity requirement includes at least two of tempo similarity, dynamics similarity, fingering similarity, and pitch similarity; S1053C. If so, identify the corresponding data group as a similar data group; S1053D. Determine whether the number of the similar data groups is greater than a first similar number; S1053E. If so, merge the data groups to obtain a first merged data group.

4. A method for displaying performance data according to claim 1, wherein, S105 further includes: S1054. Merge and display the data groups according to whether the priorities between two adjacent data groups are continuous; S1054 includes steps: S1054A. Determine whether the two adjacent data groups are of the same priority; S1054B. If so, identify the corresponding data group as a continuous data group; S1054C. Merge the continuous data groups to obtain a second merged data group.

5. A method for displaying performance data according to claim 4, wherein S1054C further includes: Generate a performance status prompt icon according to the continuous data group: When the two adjacent data groups are both of the first priority, generate a first performance status prompt icon; When the two adjacent data groups are both of the second priority, generate a second performance status prompt icon.

6. A method for displaying performance data according to claim 5, characterized in that, It further includes: Add different intensity visual emphasis elements to the data groups and the performance status prompt icons corresponding to different priorities, where the visual emphasis elements include static graphic marks, dynamic visual effects, color changes, and animation effects.

7. A method for displaying performance data according to claim 1, characterized in that, It includes: Determine the display height of the data group in the score height direction according to the pitch data.

8. A performance data display system, characterized in that, The display system includes: A score data acquisition module, configured to acquire score data, where the score includes: multiple syllables, and one syllable is represented by at least one note; the score data includes one or more of the following: the standard tempo, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; A user data acquisition module, configured to acquire user performance data, where the user performance data includes data groups at multiple moments, and the data group includes one or more of the following data: tempo data, dynamics data, fingering data, and pitch data; A matching and comparing data module, configured to determine whether at least one data group matches the corresponding score data; if so, perform an associated comparison between the score data and the matching data group, and calculate the difference degree; the difference degree includes at least one of tempo difference, dynamics difference, fingering difference, and pitch difference; A data group display module, configured to display the score and display the associated data group in the area corresponding to the note; where it includes a sub-module: A priority generation sub-module, configured to generate the priority of the data group according to the error frequency, including units: A determination unit, configured to determine whether the error frequency is greater than a first threshold. If so, according to the degree of difference between the data group and the music score data, the data group with a degree of difference greater than a first preset degree of difference is set as a first priority level, and the data group with a degree of difference less than or equal to the first preset degree of difference is set as a second priority level; A display unit, configured to display the data group according to the generated priority level, wherein the data group with the first priority level is preferentially displayed.

9. A computer device, characterized in that, The device includes a memory and a processor; The memory is used for storing a computer program; The processor is configured to execute the computer program and, when executing the computer program, implement the performance data display method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the processor is caused to implement the performance data display method according to any one of claims 1 to 7.

Images