Data set display method, system, equipment and medium

Abstract

The invention relates to the field of piano intelligent display, in particular to a data set display method, system and device and a medium. The music score data comprises one or more of the following: standard time values, standard strength, standard fingering and standard pitches corresponding to the plurality of notes; the playing data of the user are obtained, the playing data of the user comprise data sets at multiple moments, and the data sets comprise one or more of the following data: time value data, force data, fingering data and pitch data; judging whether at least one data group is matched with the corresponding music score data or not; if yes, correlation comparison is carried out on the music score data and the matched data set, and the difference degree is calculated; and displaying the music score, and displaying the associated data group in a region corresponding to the notes. According to the playing data display method provided by the invention, visual optimization can be realized on the basis of ensuring the integrity of playing parameters.

Description

[0001] Divisional application This application is a divisional application of Chinese invention patent application CN202510758520.7, filed on June 9, 2025, entitled "A Method and System for Displaying Performance Data". Technical Field

[0002] This invention relates to the field of intelligent piano display, and more particularly to a data group display method, system, device, and medium. Background Technology

[0003] Piano practice often relies heavily on the guidance of professional teachers because learners frequently struggle to gain an accurate and intuitive understanding of their playing, making the learning process very costly. Currently, existing technologies offer several methods for providing data-driven feedback and evaluation of piano performance.

[0004] For example, patent application CN119274578A discloses a music performance evaluation system, which basically includes an audio input unit, a notification device, and at least one processor. The audio input unit is configured to input music performance. The notification device outputs an evaluation of the music performance received via the audio input unit. At least one processor executes a music performance evaluation procedure to identify errors in the music performance based on reference data containing erroneous music performance segments, classify the errors in the music performance as significant errors or non-significant errors, and instruct the notification device to output the evaluation of the music performance in a manner that identifies the presence of significant errors, which are different from non-significant errors.

[0005] For example, patent application CN108597300A discloses a method and apparatus for displaying musical notes. The method includes: activating a timing function; listening to a first message generated by the triggering of a music control; determining a target note based on the first message, wherein the target note is the note associated with the triggered music control; determining whether the timing cycle has ended; if the timing cycle has not ended, storing the target notes in a target note list according to the order in which the target notes were determined; and if the timing cycle ends, displaying the notes in the target note list on a musical staff.

[0006] For example, patent application CN107767847A discloses an intelligent piano performance evaluation method and system, which collects the user's MIDI audio digital signal and converts it into performance data; matches the user's performance time sequence with the master's performance time sequence on the time axis; determines the pitch of the note groups played by the user and the master; determines the rhythm by comparing the relative time values ​​of the notes played by the user and the master; determines the tempo by calculating the relative tempo of the user and the master; determines the dynamics by comparing the dynamics of the notes played by the user and the master; comprehensively evaluates the performance pitch, rhythm, tempo, and dynamics; and marks the comprehensive evaluation results on the staff of the intelligent terminal.

[0007] However, while these methods can provide data-driven feedback and evaluation of piano performance to a certain extent, they also place higher demands on users' data capture capabilities. Therefore, there is an urgent need for a performance data display method that allows piano learners to improve their practice efficiency through optimized display schemes. Summary of the Invention

[0008] The purpose of this invention is to provide a performance data display method and system, partially solving or alleviating the aforementioned shortcomings of the prior art, enabling users to clearly and intuitively understand their performance status through the display scheme presented by this invention. To solve the aforementioned technical problems, this invention specifically adopts the following technical solution: A first aspect of the present invention is to provide a method for displaying performance data, comprising the steps of: S101, acquire musical score data, wherein the musical score includes: multiple syllables, and each syllable is represented by at least one note; the musical score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; S102, acquire user performance data, the user performance data includes data groups at multiple times, the data groups include one or more of the following data: time value data, dynamic data, fingering data, pitch data; S103, determine whether at least one of the data groups matches the corresponding musical score data; S104, if so, then the score data is compared with the matched data group to calculate the degree of difference; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; S105, display the musical score and display the associated data group in the area corresponding to the note; wherein, S105 includes the following steps: S1051, generating a priority for the data group based on the error frequency, S1051 includes the following steps: S1051A, determine whether the error frequency is greater than a first threshold; if so... Based on the degree of difference between the data group and the score data, the data group with a difference greater than a first preset difference degree is set as the first priority, and the data group with a difference degree less than or equal to the first preset difference degree is set as the second priority. S1051B, Display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

[0009] In some embodiments, the method further includes: S1052, generating a subclass priority for the data group set as the first priority based on the error frequency, S1052 includes the following steps: S1052A, determine whether the error frequency is greater than a second threshold, wherein the second threshold is greater than the first threshold; S1052B, if so, then obtain the error ratio of the playing error type in the data group, wherein the playing error type is one or more of timing error, dynamic error, fingering error, and pitch error; the error ratio is the proportion of at least one type of error among all types of playing errors; S1052C, the data group with the error ratio greater than the first error ratio is set as the first error subclass priority, and the data group with the error ratio less than or equal to the first preset error ratio is set as the second error subclass priority; S1052D, Display the data group according to the subclass priority, wherein the data group with the first error subclass priority is displayed first.

[0010] In some embodiments, the method further includes: S1053, merging and displaying the data groups according to the display density of the data groups, wherein the display density is the number of data groups in a unit section; S1053 includes the following steps: S1053A, determine whether the displayed density is greater than the first density; S1053B, If so, determine whether the data similarity between two adjacent data groups is greater than the first similarity, wherein the data similarity is required to include at least two of the following: time value similarity, dynamic similarity, fingering similarity, and pitch similarity. S1053C, if so, then the corresponding data group is identified as a similar data group; S1053D, determine whether the number of similar data groups is greater than the first similarity number; S1053E, if so, then the data groups are merged to obtain the first merged data group.

[0011] In some embodiments, the method further includes: S1054, merge and display the data groups according to whether the priorities of two adjacent data groups are consecutive (or the same); S1054 includes the following steps: S1054A, determine whether the two adjacent data groups have the same priority; S1054B, if so, then the corresponding data group is identified as a continuous data group; S1054C, merge the continuous data groups to obtain a second merged data group.

[0012] In some embodiments, the method further includes: generating performance status prompt icons based on the consecutive data groups: generating a first performance status prompt icon when two adjacent data groups are both of the first priority; and generating a second performance status prompt icon when two adjacent data groups are both of the second priority.

[0013] In some embodiments, the method further includes adding visual emphasis elements of different intensities to the data groups and the performance status prompt icons corresponding to different priorities, wherein the visual emphasis elements include static graphic markers, dynamic visual effects, color changes, and animation effects.

[0014] In some embodiments, the method further includes: determining the display height of the data group in the height direction of the score based on the pitch data.

[0015] A second aspect of this application is to provide a performance data display system, the display system comprising: The music score data acquisition module is used to acquire music score data, wherein the music score includes: multiple syllables, and each syllable is represented by at least one note; the music score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; The user data acquisition module is used to acquire user performance data, which includes data groups at multiple times. The data groups include one or more of the following: time value data, dynamic data, fingering data, and pitch data. The matching and comparison data module is used to determine whether at least one of the data groups matches the corresponding musical score data; if so, the musical score data is associated and compared with the matched data group, and the degree of difference is calculated; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; The data group display module is used to display the musical score and show the associated data groups in the areas corresponding to the notes; it includes sub-modules: The priority generation submodule, used to generate the priority of the data group based on the error frequency, includes the following units: The judgment unit is used to determine whether the error frequency is greater than a first threshold. If so, based on the degree of difference between the data group and the score data, the data group with a difference degree greater than a first preset difference degree is set as the first priority, and the data group with a difference degree less than or equal to the first preset difference degree is set as the second priority. A display unit is configured to display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

[0016] A third aspect of this application provides a computer device, the device including a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and, when executing the computer program, implement the performance data display method as described in any embodiment.

[0017] In a fourth aspect, this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the performance data display method described in any embodiment.

[0018] Beneficial technical effects: This invention displays the dynamics, duration, fingering, and pitch data corresponding to each played note in a data group format. By comprehensively displaying the data for each note played by the user, it helps the user understand every professional detail that can be improved. Furthermore, the data groups are prioritized based on changes in user status and scene mode, allowing for filtering and merging, which greatly optimizes the visual effect. Specifically, the technical effects of the performance data display method proposed in this invention are as follows: 1) The complex and massive performance data is broken down into independent parameter sets for each note and presented in the form of data groups. Compared with traditional methods, this invention greatly improves the efficiency of users in locating performance details with an "atomic-level" display method. 2) This invention sets different priorities and sub-class priorities for data groups based on the playing status and specific scenario patterns reflected by the user's playing errors, thereby filtering out high-value data from a large number of performance data groups, and thus ensuring a dynamic balance between user experience and data integrity on the basis of complete display of performance data, and improving the efficiency of user error correction. 3) This invention reveals the patterns behind the playing data to users by merging data groups with the same priority and high similarity, so that the display density of the data groups is always maintained within a reasonable range that is more in line with the user's visual habits. This can further balance the contradiction between the preservation of details of subtle differences between data groups and display efficiency. 4) By adding different visual emphasis elements to data groups with different priorities, merged data groups, and performance status prompt icons, users can quickly focus on key data through visual cues, help users intuitively understand the logical relationship of data display, and provide instant feedback through dynamic changes of visual emphasis elements (such as color switching), thereby improving the user's interactive experience. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0020] Figure 1 A schematic flowchart illustrating a performance data display method provided in this application embodiment; Figure 2 This is a schematic diagram showing the performance data provided in the embodiments of this application; Figure 3 This application provides a schematic diagram of a method for displaying performance data, illustrating the display of incorrect playing. Figure 4 This is a schematic diagram illustrating a method for displaying missed notes in a performance data display, provided in an embodiment of this application. Figure 5 This application provides a schematic diagram of a multi-play display method for displaying performance data in an embodiment of the present application. Figure 6 This is a schematic diagram illustrating a custom display of a data group, provided as an embodiment of this application. Figure 7 A schematic block diagram of a performance data display system provided in this application embodiment; Figure 8 This is a schematic block diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0022] In this document, suffixes such as "module," "part," or "unit" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves. Therefore, "module," "part," or "unit" may be used interchangeably.

[0023] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the present invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0024] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0025] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0026] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0027] As used in this specification, the term "about" typically means + / -5% of the value, more typically + / -4% of the value, more typically + / -3% of the value, more typically + / -2% of the value, even more typically + / -1% of the value, and even more typically + / -0.5% of the value.

[0028] In this specification, certain embodiments may be disclosed in a range-bound format. It should be understood that this "range-bound" description is merely for convenience and brevity and should not be construed as a rigid limitation on the disclosed range. Therefore, the description of a range should be considered as having specifically disclosed all possible subranges and the individual numerical values ​​within those ranges. For example, a description of the range 1-6 should be considered as having specifically disclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., and the individual numbers within those ranges, such as 1, 2, 3, 4, 5, and 6. This rule applies regardless of the breadth of the range.

[0029] Example 1: Selected embodiments will now be described with reference to the accompanying drawings. Those skilled in the art of intelligent piano displays will understand from this disclosure that the following description of the embodiments is for illustrative purposes only and not for limiting the objectives of the invention as defined by the appended claims and their equivalents.

[0030] See Figure 1 As shown, this invention provides a flowchart of a method for displaying performance data. It typically includes the following steps: S101, acquire musical score data, wherein the musical score includes: multiple syllables, and each syllable is represented by at least one note; the musical score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; It should be understood that the purpose of acquiring the sheet music data is both to match and compare it with the user's playing data, and to provide a reference for the display position of the performance data. The data group is displayed at the note position of the sheet music and / or the area adjacent to the note, so that the user can intuitively understand the pitch changes of the playing even without analyzing the pitch data.

[0031] In actual playing, a user's playing data can include: pitch data, fingering data, hand shape data, note value data, dynamics data, pedal data, body posture data, etc. It should be understood that musical instrument playing, especially keyboard instruments like the piano, has a wide range and dynamic range, from the softest notes to the most powerful sounds. The performer needs precise control over touch, pedal use, rhythm, and intonation, while simultaneously conveying the emotion and style of the piece. Therefore, performers need to pay attention to numerous evaluation dimensions during practice, and each dimension affects the final musical performance. These dimensions help improve the performer's overall ability, ensuring that their performance is both technically superb and artistically compelling.

[0032] Preferably, this invention focuses on selecting three types of data—fingering data, timing data, and dynamic data—for professional performers and / or people with high performance requirements. Among them, dynamic changes reflect emotional intensity and mood changes, smooth fingering ensures technical accuracy, and accurate timing improves the sense of rhythm and melody. These three indicators often have the greatest potential for improvement and are the most difficult to optimize when professional performers practice scores.

[0033] Specifically: 1) Fingering data analysis helps users improve technical stability. In professional performances, complex passages (such as fast scales on the piano) demand extremely high fingering accuracy. Fingering data analysis allows users to correct incorrect fingering (such as stuttering caused by frequent finger changes), and targeted optimization can reduce technical errors and improve fluency. Different performers have significantly different hand sizes and finger flexibility. For example, in piano playing, chords with large spans require timely fingering adjustments to avoid muscle fatigue or injury.

[0034] 2) Displaying note values ​​helps ensure precise musical rhythm. Professional repertoire often contains free rhythms, complex syncopation, or asymmetrical beats. Displaying note values ​​allows for the quantitative analysis of deviations between the actual playing time of notes and the standard score, helping users correct issues like "dragging out" or "rushing." Furthermore, large-scale works often require the use of note values ​​to divide sections. For example, the precision of rest values ​​in Beethoven's symphonies directly affects the accumulation and release of dramatic tension.

[0035] 3) Dynamics data displays help users enhance emotional impact. Professional performances require creating contrast within a very narrow dynamic range to highlight changes in musical emotion. Dynamics data quantifies the loudness of each note, avoiding a "flat performance effect." For example, staccato and legato on the piano particularly rely on explosive power that requires reaching high dynamic values ​​instantly. Therefore, the magnitude of dynamics can very intuitively reflect the emotional tone of the performance (such as "sadness," "joy," etc.).

[0036] S102, acquire user performance data, the user performance data includes data groups at multiple times, the data groups include one or more of the following data: time value data, dynamic data, fingering data, pitch data; It should be noted that the data group in the accompanying drawings of this invention is mainly represented in the form of a "data frame," the purpose of which is primarily to help users improve training efficiency and the accuracy of artistic expression while constructing a visually friendly feedback mechanism between the musical score representation and data analysis display. However, the data group can also have other forms of representation, such as data bars, data columns, data circles, etc. Figure 6As shown, users can click the edit button in the upper right corner of the data group to customize its display shape. It should be understood that any display of performance data according to the method of this invention, achieving adaptive visualization of the performance data, should fall within the scope of protection of this invention; the shape of the data group is not limited by this invention.

[0037] In some embodiments, the timing data, force data, fingering data, and pitch data can be acquired by detection devices, such as sensors. For example, a force sensor or displacement sensor can be installed below the piano keys to detect the force of the user's key press in real time.

[0038] Furthermore, fingering data, note value data, dynamics data, and pitch data are not isolated performance data; on the contrary, they are coupled to some extent (for example, insufficient piano dynamics may also reveal fingering problems, and fingering errors may also lead to pitch errors). Such multidimensional data cross-analysis helps users analyze performance problems more comprehensively and systematically, thereby improving error correction efficiency. Therefore, linked display of performance data is beneficial for generating more valuable performance suggestions for users through multidimensional data correlation analysis. Preferably, if the actual dynamics data of a note is significantly lower than the standard dynamics data, the data set can also suggest that the user use a different finger to increase the touch speed, thereby making the actual dynamics data closer to the standard dynamics data.

[0039] In some embodiments, see Figure 6 Users can edit the performance data displayed in the data group according to their needs. For example, users can choose to display single data (such as only fingering data) or combined data (such as displaying timing data and dynamics data), thereby helping users to focus more on the performance indicators they want to improve the most.

[0040] For professional or advanced performers, the refined analysis and display of fingering, note values, dynamics, and pitch data essentially transforms subjective perception into visual and measurable technical indicators. The performance data display method proposed in this invention not only helps users correct errors but also propels performance levels from "accuracy" to "excellence," ultimately serving the depth and uniqueness of musical expression.

[0041] S103, determine whether at least one of the data groups matches the corresponding musical score data; If so, the data group can be associated with the score data, and the data group can be displayed at the corresponding note on the score.

[0042] For example, in some embodiments, the data set can be matched with the musical score data based on the time it was generated. If each note in the musical score data has a corresponding performance rhythm (i.e., it has a certain order of appearance or time of appearance), the data set can be matched with the data set of which note it is associated with based on the time it was generated.

[0043] Alternatively, in some embodiments, the similarity between the data set and the score data can be assessed based on the degree of similarity between one or more data points. For example, the similarity between time value data and standard time value can be used as the degree of similarity; the similarity between dynamic data and standard dynamic can be used as the degree of similarity; the similarity between fingering data and standard fingering can be used as the degree of similarity; the similarity between pitch data and standard pitch can be used as the degree of similarity; or the sum or weighted value of any at least two of the above degree of similarity can be used as the degree of similarity.

[0044] If the data group matches the sheet music data, the data group can be associated with each type of data in the sheet music data. In some embodiments, if the data group cannot match the corresponding sheet music data, there may be two situations: when the actual playing data cannot be associated with the sheet music data, it indicates that the user has played too many notes, and in this case, a prompt for playing too many notes can be displayed within the data group display range, such as... Figure 5 As shown; when the sheet music data cannot be correlated with the actual playing data, it indicates that the user has missed playing the target note. In this case, a missed note prompt can be added within the data group. Please refer to [link to relevant documentation]. Figure 4 , Figure 4 The image shows that when a missed note occurs, the data group is not displayed at the target note that the user did not play, which serves as a notification to the user that a missed note has occurred.

[0045] Furthermore, in some embodiments, targeted display schemes can be implemented for users who frequently "play too many notes," frequently "miss notes," and frequently "play the wrong notes." For example, for users who frequently "play too many notes," the focus can be on finger placement detection; for users who frequently "miss notes," the display readability can be enhanced, making it easier for users to improve their music reading ability through this invention.

[0046] Furthermore, in some embodiments, the method further includes: S104, if so, associating and comparing the score data with the matched data group to calculate the degree of difference; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; Specifically, the musical score data is correlated and compared with the matched data sets, and the degree of difference for each type of playing data is calculated to accurately determine whether the user's playing data is correct. The degree of difference is used to represent the degree of deviation between the musical score data and the matched data sets. The concept of degree of difference is introduced to more personally and specifically distinguish the degree of deviation of the data sets from the musical score data (or to classify the playing data), avoiding a one-size-fits-all display. This improves the flexibility and adaptability of the playing data display and allows users to focus more on more obvious playing errors, maximizing the benefits of practice.

[0047] S105, display the sheet music and display the associated data group in the area corresponding to the note; wherein, the error frequency is the number of times all playing errors occur within a set time; or the number of times all playing errors occur within a set measure; the set time and the length of the set measure can be set by the user; S105 includes the following steps: S1051, generate the priority of the data group according to the error frequency, wherein the error frequency is the number of times all playing errors occur within a set time period; or the number of times all playing errors occur within a set measure; the set time and the length of the set measure can be set by the user; S1051 includes the following steps: S1051A, determine whether the error frequency is greater than a first threshold; if so... Based on the degree of difference between the data group and the score data, the data group with a difference greater than a first preset difference degree is set as the first priority, and the data group with a difference degree less than or equal to the first preset difference degree is set as the second priority. S1051B, Display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

[0048] For example, the performance data display effect proposed in this invention can be found in [reference needed]. Figure 2 .

[0049] In some embodiments, the "priority display" may refer to the first priority data group being displayed on top when at least two data groups overlap on the display interface, or it may mean that the display intensity (e.g., contrast, transparency, color depth) of the first priority data group is higher than that of the second priority data group. See also Figure 3 , Figure 3 The image shows the addition of a red border to the first priority data group and the filling of the display area with red, which visually shows the priority differences between data groups and helps users improve error correction efficiency.

[0050] It should be noted that the core purpose of step S1051 is to achieve data filtering based on the priority of different data groups, thereby resolving the contradiction between data overload and limited attention. Specifically, based on the hierarchical classification of performance data, this invention can assign different display priorities to performance data of different time periods, different error types, and different playing scenarios, and adjust the display density of data groups in a scenario-based, personalized, and adaptive manner according to these display priorities, thereby transforming redundant and static performance data into orderly and dynamic visual indicators.

[0051] In some embodiments, when the error frequency is below a first error threshold, all matched data groups can be displayed, and different priorities can be set for the data groups to distinguish them for display.

[0052] For example, the frequency of user playing errors and display density can also be combined to determine whether to hide lower-priority data groups.

[0053] In some embodiments, the frequency of user errors can, to some extent, indicate their playing level and the user's identity. If the frequency of user errors is below a first error threshold (e.g., 5%), it indicates that the user's playing level is very high. In this case, the real area for improvement is often not the user's familiarity with the score or their adaptation to its difficulty, but rather the improvement of their playing techniques. This requires a comprehensive presentation of the playing data to help the user have an overall grasp of the playing effect. Based on this, for example, different visual emphasis elements can be added to data groups with different priorities, and lower priority data groups can be hidden, so that users can apply different attention to data groups with different priorities while ensuring data integrity.

[0054] The present invention also provides a method for displaying a data group, wherein in some embodiments, S105 further includes: S1052, generating a subclass priority for the data group set as the first priority based on the error frequency, S1052 includes the following steps: S1052A, determine whether the error frequency is greater than a second threshold, wherein the second threshold is greater than the first threshold; S1052B, if so, then obtain the error ratio of the playing error type in the data group, wherein the playing error type is one or more of timing error, dynamic error, fingering error, and pitch error; the error ratio is the proportion of at least one type of error among all types of playing errors; S1052C, the data group with the error ratio greater than the first error ratio is set as the first error subclass priority, and the data group with the error ratio less than or equal to the first preset error ratio is set as the second error subclass priority; S1052D, Display the data group according to the subclass priority, wherein the data group with the first error subclass priority is displayed first.

[0055] It should be understood that when a user's error frequency is not only higher than the first threshold but also exceeds the second threshold, it indicates that the user's playing level is not high, their state is not good, or the score is difficult. Therefore, this invention further analyzes the proportion of different types of errors (such as timing errors, dynamic errors, fingering errors, and pitch errors) in all errors, i.e., the error ratio, to identify the playing points that the user should focus on improving at the moment, so that they can maximize the error correction efficiency in the same amount of time and avoid the contradiction between limited attention and data overload.

[0056] In some embodiments, the error frequency can be set to the frequency of at least one type of performance data error. For example, when a user wants to focus on practicing the fingering of a piece of music, or when the user's fingering errors account for a particularly high percentage of all types of errors (e.g., more than 50%), then timing errors and dynamic errors can be ignored, and the frequency of fingering errors can be regarded as the error frequency. Then, based on this "customized" error frequency, a more targeted data group priority can be set to facilitate personalized reinforcement practice.

[0057] Of course, this step is also applicable to professional players or practitioners with a high level of playing skills. In some embodiments, users can customize the size of the first preset difference level and the first preset error ratio: for example, the initial first preset difference level and the first preset error ratio can be lowered as needed, which can increase the high-priority data set and facilitate higher-standard advanced practice.

[0058] The present invention also provides a method for displaying a data group, wherein in some embodiments, S105 further includes: S1053, merging and displaying the data groups according to the display density of the data groups, wherein the display density is the number of data groups in a unit section; S1053 includes the following steps: S1053A, determine whether the displayed density is greater than the first density; S1053B, if so, determine whether the data similarity between two adjacent data groups is greater than the first similarity, wherein the data similarity is required to include at least two of the following: time value similarity, dynamic similarity, fingering similarity, and pitch similarity; preferably, at least two similarities are required to be greater than the first similarity.

[0059] S1053C, if so, then the corresponding data group is identified as a similar data group; S1053D, determine whether the number of similar data groups is greater than the first similarity number; S1053E, if so, then the data groups are merged to obtain the first merged data group.

[0060] Preferably, if the number of consecutively occurring similar data groups is greater than the first similarity number, then the data groups are merged.

[0061] It should be noted that, for the purpose of facilitating the structural division of musical scores, the "measure" mentioned in this invention refers to the bar lines (vertical lines) that divide the score into the smallest segment units that can be repeatedly trained. Displaying similar data groups by measure helps users quickly locate problem areas and better adapts to the sight-reading habits of piano players.

[0062] Of course, in some embodiments, the range of "measures" can be flexibly adjusted according to the complexity of the music, which is not limited here.

[0063] In some embodiments, ensuring that the number of data groups in a unit measure does not exceed the first density is the core purpose of maintaining the readability of the data display and ensuring that the interface is sufficiently simple and clear, so as not to cause visual confusion due to too many data groups, thereby improving the efficiency of performance data display and being highly adaptable to the complex scenarios of piano performance.

[0064] In some embodiments, not only can two adjacent similar data groups be merged, but also multiple adjacent (e.g., five) similar data groups can be merged. As long as the similarity between multiple data groups is greater than the first similarity, the data groups are considered similar, thereby further reducing cognitive load and improving display efficiency.

[0065] It should be noted that the similar data groups identified in this invention are only approximations in a few categories of playing data. This design is for the sake of data group display efficiency, but it does not mean that the data groups are completely similar. Therefore, in some cases, excessive merging may mask subtle differences (for example, merging data groups based on fingering and dynamics approximations, but pitch and duration are not approximations), which may cause important small differences to be ignored. Therefore, in order to balance the contradiction between the granularity of merging and the complete display of details, users can increase the requirement for similar data categories to three, four, or even more, which is not limited here.

[0066] In some embodiments, the time value data, dynamics data, fingering data, and pitch data of the first merged data group can be the average value or the most representative value of the corresponding data in all approximate data groups. Of course, the most representative value mentioned here can also be customized by the user as needed, such as the maximum value, minimum value, or the value closest to the standard score data.

[0067] The present invention also provides a method for displaying a data group, wherein in some embodiments, S105 further includes: S1054, merge and display the data groups according to whether the priority between two adjacent data groups is continuous; S1054 includes the following steps: S1054A, determine whether the two adjacent data groups have the same priority; S1054B, if so, then the corresponding data group is identified as a continuous data group; S1054C, merge the continuous data groups to obtain a second merged data group.

[0068] In some embodiments, two or more data groups can be merged, where the user plays correctly in succession, plays incorrectly in succession, or the error ratio of a certain type of error is continuously greater than or less than a first preset error ratio. The main purpose is to further improve the readability of the data display and ensure that the interface is concise and clear enough, so as not to cause visual confusion due to too many data groups, thereby improving the efficiency of performance data display and being highly adaptable to the complex scenarios of piano performance.

[0069] The second merged data group is displayed in a similar way to the first merged data group. It can be the average value or the most representative value of the corresponding data in all approximate data groups. Of course, the most representative value mentioned here can also be customized by the user as needed, such as the maximum value, minimum value, or the value closest to the standard score data.

[0070] In some embodiments, unlike the first merged data group which is a merge of similar data groups, the second merged data group also reflects the display priority of two or more data groups. Therefore, different visual emphasis elements can be added to the second merged data group and the first merged data group to make the user pay different attention to the first merged data group and the second merged data group.

[0071] In some embodiments, S1054C further includes: Generate a performance status indicator icon based on the consecutively occurring data sets: When two adjacent data groups are both of the first priority, a first performance status prompt icon is generated. When two adjacent data groups are both of the second priority, a second performance status prompt icon is generated.

[0072] In some embodiments, for data groups that are continuously updated to the first priority and the second priority, performance status prompt icons can be generated, such as "Great job, this part is all correct!" or "With more practice, you will definitely improve!" This can appropriately remind users when they make mistakes and encourage them when they play well, which helps to enhance the user experience and interactivity, and improve practice motivation and efficiency.

[0073] Furthermore, different performance status prompt icons can be generated for different error subclass priorities. For example, when a data group is continuously updated to the first error subclass priority (such as when the first type of error in the data group is a timing error), a performance status prompt icon such as "Pay attention to key touch duration / Pay attention to pressing the sustain pedal" can be generated.

[0074] By adding performance status indicator icons to the performance data, the performance effect can be understood from a more macro perspective, beyond the data group format. Furthermore, since the performance status indicator icons have a higher display priority than the data groups and merged data groups, it is easier for users to understand the data group display from multiple dimensions, lowering the cognitive threshold for users and improving their practice efficiency.

[0075] In some embodiments, it also includes: Different levels of visual emphasis elements are added to the performance status prompt icons corresponding to different priorities. These visual emphasis elements include static graphic markers, dynamic visual effects, color changes, and animation effects.

[0076] Visual emphasis elements refer to various visual elements used to highlight specific information, guide viewers' attention, or enhance the viewing experience, thereby enabling viewers to obtain key information through intuitive visual cues. For example, visual emphasis elements can be static graphic markers, dynamic visual effects, or a combination of both. Specifically, they can include color changes (e.g., highlighting, gradient colors), flashing effects (e.g., periodic flashing, pulse light effects, water ripple effects), arrow indicators (e.g., directional guidance, dynamic paths), icons and symbols, text labels (e.g., brief descriptions, numerical labels), shadows and outlines (e.g., projection effects, halo design, bold outlines), animation effects (e.g., explosions, floating bubbles), thickened or highlighted lines, etc., without further limitation.

[0077] It should be understood that the different levels of visual emphasis elements proposed in this invention need to distinguish the data display effects at least in the following aspects: 1) Different priority data groups correspond to different visual emphasis elements; 2) Different merged data groups correspond to different visual emphasis elements; 3) Different performance status prompt icons correspond to different visual emphasis elements. For example, different colors, transparency, contrast, lines, and other visual elements can display performance data in a more intuitive way, facilitating layered attention guidance for users, improving the speed of key information recognition, shortening error correction response time, and reducing user visual fatigue from a single performance data display format.

[0078] In some embodiments, it also includes: The display height of the data group in the height direction of the score is determined based on the pitch data.

[0079] In some embodiments, the display height of the data group in the height direction of the score reflects the pitch data actually played by the user. Therefore, the deviation value between the data group and the note can also intuitively reflect the deviation value of the pitch played by the user, and at the same time reflect the direction of the score scale, thus improving the user's practice efficiency.

[0080] In some embodiments, to ensure that the data group display adapts efficiently to the size of the sheet music display interface, the display area of ​​the data group in the sheet music can be, for example, determined by using the position and display size of the corresponding note head as a reference to define the display boundary of the data group.

[0081] Preferably, in some embodiments, the display of data groups should avoid obscuring symbols such as stems and slurs to ensure compatibility between the data group display and the musical score.

[0082] Preferably, in some embodiments, the different display positions of the data group can be determined according to the stem direction. For example, when the stem is downward, the data group is displayed in the area below the stem, and when the stem is upward, the data group is displayed in the area above the stem. This differentiated display ensures visual balance between the display of the stem and the data group, demonstrating the invention's adaptability to user visual habits.

[0083] In some embodiments, data groups can also be embedded, for example, when the user hovers over or clicks on the note area, which maintains the visual purity of the score while also helping the user to make more targeted corrections.

[0084] Example 2: This invention also provides a performance data display system; please refer to [link / reference]. Figure 7 , Figure 7 This is a schematic block diagram of a performance data display system provided in an embodiment of this application. The display system includes: The music score data acquisition module 10 is used to acquire music score data, wherein the music score includes: multiple syllables, and each syllable is represented by at least one note; the music score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; User data acquisition module 20 is used to acquire user performance data, which includes data groups at multiple times. The data groups include one or more of the following: time value data, dynamic data, fingering data, and pitch data. The matching and comparison data module 30 is used to determine whether at least one of the data groups matches the corresponding musical score data; if so, the musical score data is associated and compared with the matched data group, and the degree of difference is calculated; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; Display data group module 40 is used to display the musical score and display the associated data group in the area corresponding to the note; it includes sub-modules: Priority generation submodule 401, used to generate the priority of the data group according to the error frequency, includes the following units: The judgment unit 401A is used to determine whether the error frequency is greater than a first threshold. If so, based on the degree of difference between the data group and the score data, the data group with a difference degree greater than a first preset difference degree is set as the first priority, and the data group with a difference degree less than or equal to the first preset difference degree is set as the second priority. Display unit 401B is used to display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

[0085] For example, the performance data display system further includes: a subclass priority generation module 402, used to generate a subclass priority of the data group that is set as the first priority according to the error frequency; The subclass priority generation module 402 further includes: a judgment unit, used to judge whether the error frequency is greater than a second threshold, wherein the second threshold is greater than the first threshold; an error ratio acquisition unit, used to acquire the error ratio of the playing error type in the data group if yes, wherein the playing error type is one or more of timing error, dynamic error, fingering error, and pitch error; the error ratio is the proportion of at least one type of error in all types of playing errors; a priority setting unit, used to set the data group with the error ratio greater than a first error ratio as the first error subclass priority, and set the data group with the error ratio less than or equal to a first preset error ratio as the second error subclass priority; and a display unit, used to display the data group according to the subclass priority, wherein the data group with the first error subclass priority is displayed first.

[0086] For example, the performance data display system further includes: a merged display module 403, used to merge and display the data groups according to the display density of the data groups, wherein the display density is the number of data groups in a unit measure; The merging display module 403 further includes: a display density judgment unit, used to determine whether the display density is greater than a first density; an adjacent similarity judgment unit, used to determine whether the data similarity between two adjacent data groups is greater than a first similarity if the data similarity is greater than a first similarity, wherein the data similarity is required to include at least two of the following: time value similarity, intensity similarity, fingering similarity, and pitch similarity; an identification unit, used to identify the corresponding data group as a similar data group if the data similarity is greater than a first similarity; a similarity quantity judgment unit, used to determine whether the number of similar data groups is greater than a first similarity quantity; and a merging unit, used to merge the data groups if the data similarity is greater than a first merged data group.

[0087] For example, the performance data display system further includes: a merging display unit 404, used to merge and display the data groups according to whether the priority between two adjacent data groups is continuous; The merging display unit 404 further includes: a judgment unit for judging whether the two adjacent data groups have the same priority; an identification unit for identifying the corresponding data group as a continuous data group if so; and a merging unit for merging the continuous data groups to obtain a second merged data group.

[0088] For example, the performance data display system further includes: a performance status prompt icon generation module, used to generate performance status prompt icons based on the continuous data groups; wherein the performance status prompt icon generation module includes: a first performance status prompt icon generation unit, used to generate a first performance status prompt icon when the two adjacent data groups are both of the first priority; and a second performance status prompt icon generation unit, used to generate a second performance status prompt icon when the two adjacent data groups are both of the second priority.

[0089] For example, the performance data display system further includes a visual emphasis element adding module, used to add visual emphasis elements of different intensities to the data groups and the performance status prompt icons corresponding to different priorities, wherein the visual emphasis elements include static graphic markers, dynamic visual effects, color changes, and animation effects.

[0090] For example, the performance data display system further includes a display height determination module, used to determine the display height of the data group in the height direction of the score based on the pitch data.

[0091] Embodiments of this application also provide a schematic block diagram of the structure of a computer device, please see... Figure 8 Computer programs can be used in situations such as Figure 8 It runs on the computer device shown. Figure 8As shown, the computer device includes a processor, memory, and network interface connected via a system bus, wherein the memory may include non-volatile storage media and internal memory.

[0092] Non-volatile storage media can store operating systems and computer programs. These computer programs include program instructions that, when executed, cause the processor to perform any method of displaying performance data.

[0093] The processor provides computing and control capabilities, supporting the operation of the entire computer device.

[0094] Internal memory provides an environment for the execution of computer programs stored in non-volatile storage media. When these computer programs are executed by a processor, the processor can perform any method of displaying performance data.

[0095] This network interface is used for network communication, such as sending assigned tasks. Those skilled in the art will understand that... Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0096] It should be understood that the processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0097] In one embodiment, the processor is configured to run a computer program stored in memory to perform the following steps: S101, acquire musical score data, wherein the musical score includes: multiple syllables, and each syllable is represented by at least one note; the musical score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; S102, acquire user performance data, the user performance data includes data groups at multiple times, the data groups include one or more of the following data: time value data, dynamic data, fingering data, pitch data; S103, determine whether at least one of the data groups matches the corresponding musical score data; S104, if so, then the score data is compared with the matched data group to calculate the degree of difference; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; S105, display the musical score and display the associated data group in the area corresponding to the note; wherein, S105 includes the following steps: S1051, generating a priority for the data group based on the error frequency, S1051 includes the following steps: S1051A, determine whether the error frequency is greater than a first threshold; if so... Based on the degree of difference between the data group and the score data, the data group with a difference greater than a first preset difference degree is set as the first priority, and the data group with a difference degree less than or equal to the first preset difference degree is set as the second priority. S1051B, Display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

[0098] For example, the processor is used to run a computer program stored in the memory, and is also used to implement the steps of the performance data display method provided in any embodiment of this application, which will not be repeated here.

[0099] The embodiments of this application also provide a computer-readable storage medium storing a computer program, the computer program including program instructions, and the processor executing the program instructions to implement any of the performance data display methods provided in the embodiments of this application.

[0100] The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiments, such as the hard disk or memory of the computer device. Alternatively, the computer-readable storage medium may be an external storage device of the computer device, such as a plug-in hard disk, SmartMedia Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the computer device. It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0101] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a computer terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0102] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A method for displaying data groups, characterized in that, include: S101, Obtain musical score data, wherein the musical score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to multiple notes; S102, acquire user performance data, the user performance data includes data groups at multiple times, the data groups include one or more of the following data: time value data, dynamic data, fingering data, pitch data; S103, determine whether at least one of the data groups matches the corresponding musical score data; S104, if so, then the score data is compared with the matched data group to calculate the degree of difference; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; S105, display the musical score and display the associated data group in the area corresponding to the note; wherein, S105 includes the following steps: S1053, merging and displaying the data groups according to the display density of the data groups, wherein the display density is the number of data groups in a unit section; S1053 includes the following steps: S1053A, determine whether the displayed density is greater than the first density; S1053B, If so, determine whether the data similarity between two adjacent data groups is greater than the first similarity; S1053C, if so, then the corresponding data group is identified as a similar data group; S1053D, determine whether the number of similar data groups is greater than the first similarity number; S1053E, if so, then the data groups are merged to obtain the first merged data group.

2. The data group display method according to claim 1, characterized in that, S105 includes the following steps: S1051, generating a priority for the data group based on the error frequency, S1051 includes the following steps: S1051A, determine whether the error frequency is greater than a first threshold; if so... Data groups with a difference greater than a first preset difference level are set as first priority, and data groups with a difference less than or equal to the first preset difference level are set as second priority. S1051B, Display the data group according to the generated priority, wherein the data group with the first priority is displayed first.

3. The data group display method according to claim 2, characterized in that, S105 also includes: S1052, generating a subclass priority for the data group set as the first priority based on the error frequency, S1052 includes the following steps: S1052A, determine whether the error frequency is greater than a second threshold, wherein the second threshold is greater than the first threshold; S1052B, if so, then obtain the error ratio of the playing error type in the data group, wherein the playing error type is one or more of timing error, dynamic error, fingering error, and pitch error; the error ratio is the proportion of at least one type of error among all types of playing errors; S1052C, the data group with an error ratio greater than the first error ratio is set as the first error subclass priority, and the data group with an error ratio less than or equal to the first preset error ratio is set as the second error subclass priority; S1052D, Display the data group according to the subclass priority, wherein the data group with the first error subclass priority is displayed first.

4. The data group display method according to claim 2, characterized in that, include: Different performance status indicator icons are generated based on the priority of the subclass.

5. A data group display method according to claim 1, characterized in that, The time value data, the dynamic data, the fingering data, and the pitch data in the first merged data group are one of the maximum, minimum, and average values ​​of the corresponding data in the similar data group; And / or, the method includes: determining the display position of the data group based on the stem direction of the note.

6. The data group display method according to claim 1, characterized in that, Also includes: Add corresponding visual emphasis elements to the data groups, the first merged data group, and the performance status prompt icons corresponding to different priorities. The visual emphasis elements include static graphic markers, and / or dynamic visual effects, and / or color changes, and / or animation effects. And / or, the display priority of the performance status indicator icon is higher than that of the data group, and / or the first merged data group.

7. A data group display method according to claim 1, characterized in that, include: The display height of the data group in the height direction of the score is determined based on the pitch data; And / or, the data group is displayed when the user hovers over or clicks the note.

8. A data group display system, characterized in that, The display system includes: The music score data acquisition module is used to acquire music score data, wherein the music score includes: multiple syllables, and each syllable is represented by at least one note; the music score data includes one or more of the following: standard time value, standard dynamics, standard fingering, and standard pitch corresponding to the multiple notes; The user data acquisition module is used to acquire user performance data, which includes data groups at multiple times. The data groups include one or more of the following: time value data, dynamic data, fingering data, and pitch data. The matching and comparison data module is used to determine whether at least one of the data groups matches the corresponding musical score data; if so, the musical score data is associated and compared with the matched data group, and the degree of difference is calculated; the degree of difference includes at least one of the following: time value difference, dynamic difference, fingering difference, and pitch difference; The system is configured to display the musical score and, in the corresponding area of ​​each note, display the associated data group; wherein, the system is further configured to: The data groups are merged and displayed according to their display density, where the display density is the number of data groups per unit section; this also includes: Determine whether the displayed density is greater than the first density; If so, determine whether the data similarity between two adjacent data groups is greater than the first similarity. If so, the corresponding data group will be identified as a similar data group; Determine whether the number of similar data groups is greater than the first similarity count; If so, the data groups are merged to obtain the first merged data group.

9. A computer device, characterized in that, The device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and, in executing the computer program, implement the data group display method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the data group display method as described in any one of claims 1 to 7.

Images