A performance error display method and system

Abstract

The present application relates to the technical field of piano playing display, in particular to a playing error display method and system, wherein the method comprises: identifying wrong notes; when the number of wrong notes is greater than or equal to a preset merging threshold, the wrong notes are taken as merging objects; and a first display scheme is used to display the merging objects; wherein the first display scheme comprises the following steps: adding a moving effect to the merging objects, wherein the moving effect is determined according to moving display parameters; the moving display parameters include one or more of the following: object number, display height, display time length, and display color; the object number is determined according to the number of merging objects; and the merging objects are displayed according to the moving display parameters. The present application can avoid the frustration of users caused by error display to the greatest extent, and improve the integrity and efficiency of error display.

Description

Technical Field

[0001] This invention relates to the field of piano performance display technology, and more specifically to a method and system for displaying performance errors. Background Technology

[0002] During daily piano practice, playing mistakes are inevitable. Therefore, users need to view the error display on a smart device while playing. Currently, the existing technology detects playing errors by comparing performance data and displays the incorrect parts to the user.

[0003] For example, patent application CN104680881A discloses a teaching method for mobile and online music, including the following steps: randomly providing single or multiple notes from a pre-stored pitch exercise library on the server side; the test subject producing the same note based on the single or multiple notes heard; acquiring the user's audio signal at the user end according to a preset sampling rate; converting the audio signal into a digital signal; converting the digital signal into a sound file waveform on the server side; obtaining a standard frequency waveform corresponding to the sound file waveform; superimposing the sound file waveform and the standard frequency waveform, and sending the superimposed graph to the user end for display after error-tolerant data optimization and comparison processing.

[0004] This method of displaying performance details to learners helps users identify every difference in the music recording process, thereby encouraging learners to make improvements and achieving the goals of music teaching to some extent. However, in teaching scenarios with many performance errors, beginners may not be able to efficiently capture error information from graphical data.

[0005] For example, patent application CN120260527A discloses a performance data display method and system, which includes: acquiring sheet music data; the sheet music data includes one or more of the following: standard time values, standard dynamics, standard fingering, and standard pitch corresponding to multiple notes; acquiring user performance data, the user performance data including multiple data groups at various times, the data groups including one or more of the following: time value data, dynamics data, fingering data, and pitch data; determining whether at least one of the data groups matches the corresponding sheet music data; if so, associating and comparing the sheet music data with the matching data group, calculating the degree of difference; displaying the sheet music, and displaying the associated data group in the area corresponding to the note. This method can achieve visual optimization while ensuring the integrity of performance parameters.

[0006] However, patent application CN120260527A focuses on displaying performance data according to the degree of error, and there is still an urgent need for a more scenario-adaptable method for displaying performance errors. Summary of the Invention

[0007] The purpose of this invention is to provide a method and system for displaying performance errors, which partially solves or alleviates the above-mentioned shortcomings in the prior art, and can minimize the frustration caused to users by error display while improving the completeness and efficiency of error display.

[0008] To solve the aforementioned technical problems, the present invention specifically adopts the following technical solution:

[0009] A first aspect of the present invention is to provide a method for displaying performance errors, comprising:

[0010] S101, identifies incorrectly played notes;

[0011] S102, when the number of the wrongly played notes is greater than or equal to a preset merging threshold, at least one merging object is generated based on at least one wrongly played note, and the merging object is an error prompt icon;

[0012] S103, the merged objects are displayed using a first display scheme; wherein, the steps include:

[0013] S1031, Add a movement effect to the merged object, wherein the movement effect is determined according to the movement display parameters;

[0014] The mobile display parameters include one or more of the following: number of objects, display height, display duration, and display color; the number of objects is determined based on the number of merged objects.

[0015] S1032, Visually move and display the merged object according to the movement display parameters; including:

[0016] At least one reference line segment is generated at the display location of the merged object;

[0017] The merged object is visually moved and displayed on at least one of the reference line segments; wherein the display height is used to define the relative height of the merged object in the associated reference line segment.

[0018] In some embodiments, the merged display further includes:

[0019] Count the number of merged objects and generate a quantity icon based on the count.

[0020] In some embodiments, including:

[0021] When the number of incorrectly played notes is less than the preset merging threshold, an error prompt icon is generated based on the incorrectly played notes;

[0022] The second display scheme is used to display the error message icons separately, which includes the following steps:

[0023] The error message icon is displayed at the corresponding position of the wrongly played note in the score.

[0024] The error message icon is given a dynamic effect, which is determined based on dynamic display parameters.

[0025] The dynamic display parameters include one or more of the following: the display duration and the display color.

[0026] In some embodiments, including:

[0027] The display position includes the position above and / or below the spectral line.

[0028] In some embodiments, prior to merging the display, the method further includes:

[0029] Calculate the difference of at least one musical attribute between the actual performance data and the standard performance data;

[0030] The error trend type is determined based on the difference; wherein the error trend type includes a first error trend and a second error trend; the first error trend refers to the actual performance data being greater than the standard performance data; the second error trend refers to the actual performance data being less than the standard performance data;

[0031] Determine the recommended display direction for each merged object based on the error trend type;

[0032] Determine whether to perform merged display on the merged objects based on the similarity of the recommended display orientation:

[0033] If the similarity is greater than or equal to a preset similarity threshold, then a merged display is performed;

[0034] If the similarity is less than a preset similarity threshold, then merging and display will not be performed.

[0035] In some embodiments, prior to performing the merged display, the method further includes:

[0036] Determine whether the interval between the misplayed notes corresponding to the merged object is less than or equal to a preset interval;

[0037] If so, then perform a merge display;

[0038] If not, the merged display will not be performed.

[0039] In some embodiments, including:

[0040] Acquire musical score data, wherein the musical score data includes several musical sections; each musical section includes at least one note;

[0041] Obtain the expected merging limit of the musical phrase, which is generated based on the merging limit parameter of the musical phrase; the merging limit parameter includes: the number of notes, and / or the number of score markers;

[0042] A merger scheme is generated based on the expected merger limits and the merger objects;

[0043] The merged objects are displayed in a merged manner according to the merge scheme.

[0044] In some embodiments, including:

[0045] The display duration is determined based on error information and / or user information; wherein the error information includes error type, error severity, and error frequency; and the user information includes user level and progress status.

[0046] A second aspect of the present invention is to provide a performance error display system, comprising:

[0047] The wrong note recognition module is used to identify wrong notes;

[0048] The merged object determination module is used to generate at least one merged object based on at least one of the wrongly played notes when the number of the wrongly played notes is greater than or equal to a preset merge threshold. The merged object is an error prompt icon.

[0049] A merged display module is used to merge and display the merged objects using a first display scheme; wherein the steps include:

[0050] The movement effect addition submodule is used to add movement effects to the merged object, wherein the movement effect is determined according to the movement display parameters;

[0051] The mobile display parameters include one or more of the following: number of objects, display height, display duration, and display color; the number of objects is determined based on the number of merged objects.

[0052] A mobile display submodule is used to perform visual mobile display of the merged object according to the mobile display parameters, including: generating at least one reference line segment at the display position of the merged object; performing visual mobile display of the merged object on at least one of the reference line segments; wherein the display height is used to define the relative height of the merged object in the associated reference line segment.

[0053] In some embodiments, the system is further configured to:

[0054] Count the number of merged objects and generate a quantity icon based on the count.

[0055] Beneficial technical effects:

[0056] 1. This invention, through a dual display scheme of merging and separate display, combined with a collaborative mechanism of mobile display and dynamic display, can effectively avoid the psychological impact on users from directly displaying all errors in scenarios with many errors, while improving the efficiency of error display and avoiding a cluttered interface.

[0057] 2. Furthermore, by using the recommendation display to map error trends, users can understand the general error situation without analyzing complex performance data, thereby greatly improving the efficiency of piano practice.

[0058] 3. In addition, by using the merge limit parameter, it can be ensured that the merged display matches the complexity of the score itself, avoiding over-merging. Attached Figure Description

[0059] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0060] Figure 1 This is a schematic diagram illustrating an error display according to an embodiment of this application;

[0061] Figure 2 Another error display diagram provided for an embodiment of this application;

[0062] Figure 3a This is a schematic diagram illustrating the mobile display effect provided in one embodiment of this application;

[0063] Figure 3b This is another schematic diagram illustrating a mobile display effect provided in an embodiment of this application;

[0064] Figure 3c This is a schematic diagram illustrating another mobile display effect provided in an embodiment of this application;

[0065] Figure 3d This is an example diagram illustrating the mobile display effect provided in one embodiment of this application;

[0066] Figure 4 A flowchart illustrating an error display method provided in an embodiment of this application;

[0067] Figure 5 This is a schematic diagram of the structure of an error display system provided in an embodiment of this application. Detailed Implementation

[0068] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0069] In this document, suffixes such as "module," "part," or "unit" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves. Therefore, "module," "part," or "unit" may be used interchangeably.

[0070] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the present invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0071] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0072] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0073] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0074] As used in this specification, the term "about" typically means + / -5% of the value, more typically + / -4% of the value, more typically + / -3% of the value, more typically + / -2% of the value, even more typically + / -1% of the value, and even more typically + / -0.5% of the value.

[0075] In this specification, certain embodiments may be disclosed in a range-bound format. It should be understood that this "range-bound" description is merely for convenience and brevity and should not be construed as a rigid limitation on the disclosed range. Therefore, the description of a range should be considered as having specifically disclosed all possible subranges and the individual numerical values ​​within those ranges. For example, a description of the range 1-6 should be considered as having specifically disclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., and the individual numbers within those ranges, such as 1, 2, 3, 4, 5, and 6. This rule applies regardless of the breadth of the range.

[0076] Example 1:

[0077] Please see Figure 4 The present invention provides a method for displaying performance errors, comprising:

[0078] S101, identifies incorrectly played notes;

[0079] S102, generate at least one merged object based on at least one of the misplayed notes, wherein the merged object is an error message icon;

[0080] Preferably, when the number of misplayed notes is greater than or equal to a preset merging threshold, at least one merged object is generated based on at least one misplayed note (or, S102 is to determine the merged object based on the misplayed notes when the number of misplayed notes is greater than or equal to the preset merging threshold).

[0081] S103, the merged objects are displayed using a first display scheme; wherein, the steps include:

[0082] S1031, Add a movement effect to the merged object, wherein the movement effect is determined according to the movement display parameters;

[0083] The mobile display parameters include one or more of the following: number of objects, display height, display duration, and display color; the number of objects is determined based on the number of merged objects.

[0084] S1032, Visually move and display the merged object according to the moving display parameters;

[0085] For example, in some embodiments, S1032 may include the step of generating at least one reference line segment at the display position of the merged object in the score;

[0086] The merged object is visually moved and displayed on at least one of the reference line segments; wherein the display height is used to define the relative height of the merged object in the associated reference line segment.

[0087] For example, in some embodiments, a merged object (or an error message icon corresponding to a merged object) can be displayed between two reference line segments. Alternatively, a merged object can be displayed between two reference line segments.

[0088] For example, in some embodiments, multiple reference line segments may be provided (e.g., preferably five reference line segments).

[0089] For example, in some embodiments, the display position (or display height) of the merged objects can be determined based on the error severity of the merged objects. Preferably, an error severity is pre-associated with a recommended display position. Furthermore, the error severity can be the error severity of a single merged object, or it can be the average of the error severity of multiple merged objects.

[0090] For example, in this embodiment, the "reference line segment" associated with the "merging object" is one or two reference line segments where the display position is located.

[0091] Error level refers to the difference between the actual performance data of the merged object and the standard performance data.

[0092] For example, in some embodiments, the error level can be the timeout level of the time value or the force level of the force. For example, different timeout levels or force levels are associated with different display positions; for example, the greater the timeout level, the higher the display position (e.g., it can be displayed starting from the first reference line segment), or the greater the force level, the higher the display position.

[0093] In some embodiments, including:

[0094] The display position includes the position above and / or below the spectral line.

[0095] In some embodiments, see Figure 3d Reference lines can be generated at the display position of the merged object in the score (not shown in the figure). These reference lines can be placed either above or below the staff line.

[0096] In some embodiments, the reference line segment can be displayed as either a line segment or a point.

[0097] In some embodiments, the display position, display color, and other display formats (such as line segment transparency, line segment length, etc.) of the reference line segment can be default values.

[0098] In some embodiments, when the actual performance value of a musical attribute corresponding to the merged object is greater than the standard performance value, a reference line segment can be displayed above the score; otherwise, the reference line segment can be displayed below the score.

[0099] In some embodiments, moving the merged objects on a reference line segment can include: obtaining the number of objects (e.g., N), determining the number of reference line segments (e.g., N-1) based on the number of objects; determining the display height of the reference line segment and each merged object within the reference line segment; determining the display duration of different misplayed notes based on the error type, and / or error severity, and / or error frequency; sorting the merged objects in chronological order; since the display of each merged object has a sequence and duration, a visual effect of the merged objects fading away can be created.

[0100] It should be understood that reference line segments usually appear in groups, such as in the figure. Figure 3d The reference line segment in the diagram.

[0101] In some embodiments, relative height refers to which reference line segment each merged object is located on.

[0102] It should be understood that reference lines differ from staff lines in regular sheet music. Reference lines are only generated during the merge display. On one hand, as separators between merged objects, reference lines prevent clutter in the merged display interface; on the other hand, the style (solid / dashed) and color of the reference lines themselves can be associated with the wrongly played notes (for example, the color of the reference lines can be chosen to be similar to the color of the merged objects), thereby optimizing the visual effect.

[0103] Furthermore, reference line segments can create a visual effect similar to a musical staff, making the movement of merged objects appear less abrupt in the score.

[0104] This invention further defines the display height of the merged object. Specifically, the display height can refer to the relative height of the merged object within the reference line segment.

[0105] For example, by using a misplayed note as the merging object, an error message icon can be generated based on a misplayed note.

[0106] Alternatively, in this invention, the merged object refers to an error message icon corresponding to a misplayed note; further, the merged object group refers to a group of error message icons that are determined to be merged and displayed.

[0107] In some embodiments, identifying a wrongly played note may include the following steps: 1) acquiring standard performance data (or other performance data selected by the user for comparison) and the current user's actual performance data; 2) aligning the standard performance data and the actual performance data by time; 3) identifying the difference between the standard performance data and the actual performance data (which may be a difference in a musical attribute, such as pitch difference, duration difference, dynamic difference, etc.), and if the difference between the notes is greater than a preset difference, then the note is identified as a wrongly played note.

[0108] In some embodiments, if the number of misplayed notes in a unit musical segment is greater than or equal to a preset merging threshold, the merging object is determined based on the misplayed notes.

[0109] It should be understood that, unlike existing technologies that strive for complete capture and accurate reflection of incorrect playing, this invention proposes a technical solution for merging and displaying incorrectly played notes. The technical solution for merging and displaying incorrectly played notes will be described below.

[0110] In some embodiments, if the number of incorrectly played notes in a unit musical segment is greater than or equal to a preset merging threshold, the error message icon corresponding to the incorrectly played notes can be identified as the merging object so that the incorrectly played notes can be merged and displayed subsequently.

[0111] The preset merging threshold refers to the minimum number of incorrectly played notes that can be merged and displayed. The specific value can be set by the user.

[0112] Among them, the error prompt icon corresponding to the wrong note refers to the dynamic visual mark superimposed on the corresponding position of the note in the score when a wrong note is detected. It can reflect the degree of error (the difference between the actual value and the standard value), error type (time value, dynamics, pitch, etc.), error frequency (the number of times the note is played wrong / the total number of times the note is played) to the user through shape, color and other display attributes (such as fade-out display effects).

[0113] The unit segment can refer to a single measure or a larger range of musical score. As long as the score can be divided into lengths to efficiently count the number of incorrectly played notes within a certain range, the specific length of the unit segment can be set by the user and is not limited here.

[0114] It should be understood that, unlike the technical approach of patent application CN120260527A which focuses on merging and displaying performance data according to the degree of error, this invention focuses on optimizing the overall visual effect of error display (i.e., the moving display effect), which can avoid causing users frustration while ensuring the comprehensiveness and accuracy of error display.

[0115] For example, please see Figures 3a-3d Merging can refer to displaying the error message icons corresponding to the wrong notes identified as merging objects within the first measure in one location. This centralized display location can be selected based on the severity of the error (for example, displaying it where the error is most severe) or at the location where the wrong note first appeared. Users can set this according to their visual preferences, and there are no restrictions here.

[0116] Specifically, this scheme of merging and displaying misplayed notes has at least the following technical effects: 1) It helps guide users to pay attention to the overall structural performance issues from a more macro perspective (such as which section has more concentrated performance errors, and which section has only occasional errors), thereby making users pay more attention to higher-value errors; 2) It helps to visually reduce the display range of errors (merging multiple scattered errors into one place), effectively avoiding the negative feedback of too many misplayed notes that may cause users to feel frustrated.

[0117] In some embodiments, a first display scheme can be used to display the merged objects in a merged manner. The first display scheme may refer to aggregating and displaying erroneous notes within a certain range of musical scores as a single visual unit, replacing multiple scattered erroneous markers with a single composite erroneous marker, and optimizing the display effect of erroneous performances while considering user psychology.

[0118] In some embodiments, displaying merged objects using a first display scheme may include: displaying the merged objects centrally at specific positions in the musical score and arranging them in a specific order.

[0119] For example, above the musical notation, error message icons corresponding to the wrong notes played in each measure can be grouped together and displayed, and can be arranged in the order in which the errors appeared, from top to bottom, from bottom to top, from left to right, or from right to left.

[0120] In some embodiments, adding a movement effect to the merged objects further includes: determining the number of objects, display height, display duration, and display color of the merged objects through movement display parameters, thereby creating a movement visual effect.

[0121] Among them, the movement display parameter is the core parameter used to precisely control the movement effect of merged objects, and it mainly includes the following four key dimensions:

[0122] 1) The number of objects refers to the number of error message icons corresponding to the wrongly played notes, or the total number of icons included in the merged display result. It directly reflects the number of wrongly played notes and the visual density of error display. In other words, the more objects there are, the higher the visual density of stacking or arrangement during the display process.

[0123] In some embodiments, the number of objects can be determined based on the number of error message icons.

[0124] The number of error message icons can be used directly as the number of objects (for example, if the number of error message icons is 3, then the number of objects is 3), or the number of objects can be increased or decreased accordingly based on the number of error message icons.

[0125] For example, the numerical range of the number of error message icons can be determined based on the numerical range of the number of error message icons (for example, if the number of error message icons is 5 and the numerical range is 3-6, then the number of objects can also be 3-5). The numerical range can be a preset value.

[0126] 2) Display height refers to the vertical or horizontal position (or coordinates) of the merged object during the display process, which directly reflects the position of the merged object on the score. Preferably, the display is moved above or below the score line.

[0127] In some embodiments, the display height can be determined based on at least one of the following factors: the type of error, the severity of the error, and the frequency of the error corresponding to the wrong note played by the error message icon. For example, the greater the severity of the error, the higher the display height.

[0128] For example, in some embodiments, the display height can be represented by the number of the reference line segments of the error message icon. For instance, the display height is used to define that an error message icon will be displayed between the xth and yth reference line segments. Different numbers are set for the five reference line segments to distinguish and identify them.

[0129] For example, in some embodiments, the display height of the first error message icon can be determined based on the degree of error (specifically, the degree of deviation between the actual time value / force and the preset standard time value / force), such as different recommended display heights preset for different degrees of error.

[0130] Taking display height as an example, the specific process for determining the display height can be as follows: calculate the difference between the actual dynamics and the standard dynamics corresponding to one of the error message icons (such as the first error message icon), and select the corresponding recommended display height based on the magnitude of the difference. For example, when the actual pitch is higher than the preset standard pitch, and the difference between the actual pitch and the standard pitch is relatively large, it can be displayed at a relatively high position (such as setting the reference line above the staff, and the error message icon is preferably displayed between the first and second reference lines).

[0131] Alternatively, in some embodiments, the display height may also have a default setting.

[0132] It should be noted that in practical applications, the display height can be selected or set by the user, and this invention does not impose any restrictions on this.

[0133] 3) Display duration refers to the total time span for each merged object to complete one display process. The longer the display duration, the slower the movement of the display effect, making it easier for the user to observe clearly. It should be understood that the display duration of each merged object in a group is not necessarily equal. The display duration can be determined based on at least one of the following factors: the type, severity, and frequency of the misplayed notes (for example, if the error frequency is high, the display duration of the merged object can be increased, thus providing a better prompt to the user).

[0134] In some embodiments, the display duration may further include a start display time. The start display time can be determined based on the order in which the corresponding wrong notes are played. In other words, if the wrong note appears first, the start display time can be set to display first. For example, the start display times of the three merged objects can be set to a first start display time, a second start display time, and a third start display time, respectively, with the start display times progressively delayed.

[0135] In some embodiments, the display duration of the merged object can be divided into several stages. For example, the display duration can be divided into three stages: gradual appearance (e.g., the transparency gradually decreases, creating a gradually appearing visual effect), pause (e.g., the transparency remains unchanged), and gradual disappearance (e.g., the transparency gradually increases, creating a gradually disappearing visual effect). Whether to further subdivide the display duration can be set by the user.

[0136] It should be understood that by using different start times and display durations, it is possible to determine when and for how long the merged object will be displayed, thereby creating a visual effect where it disappears after being displayed, avoiding the frustration caused to users by errors being displayed continuously.

[0137] 4) Display color refers to the color attribute of the merged object. Different error types, error severity, error frequency and other information can be distinguished by color changes (for example, the greater the error severity, the darker the color).

[0138] In some embodiments, the merged objects can be visually moved and displayed according to the moving display parameters.

[0139] It should be understood that the moving display proposed in this invention does not refer to a literal movement of position, but rather emphasizes creating a visual effect of "moving" in a certain direction by applying different moving display parameters to the merged objects. Alternatively, the visual moving display in this invention can refer to the continuous display of different merged objects at different display positions (i.e., sequential display in time), thereby visually presenting a moving effect. For an example of the visual moving display effect, please refer to [link / reference needed]. Figures 3a-3c .

[0140] In some embodiments, the method further includes: counting the number of merged objects and generating a quantity icon based on the number.

[0141] For example, please see Figure 1 The number of merged objects can be displayed more clearly above or in other locations, and a number icon can be generated based on the number of merged objects, so that users can intuitively see the distribution of their playing errors in the score.

[0142] In some embodiments, the quantity icon may not directly display the quantity; instead, it may represent the number of merged objects through other means (such as the color or shape of the quantity icon). For example, when there are 1-3 merged objects, the quantity icon may be displayed in yellow; when there are 4-6 merged objects, the quantity icon may be displayed in red. As another example, when there are 1-3 merged objects, the quantity icon may be displayed relatively small; when there are 4-6 merged objects, the quantity icon may be displayed relatively large.

[0143] In some embodiments, it also includes:

[0144] When the number of incorrectly played notes is less than a preset merging threshold, an error message icon is generated based on the incorrectly played notes.

[0145] The second display scheme is used to display the error message icons separately, which includes the following steps:

[0146] The error message icon is displayed at the corresponding position of the wrongly played note in the score.

[0147] The error message icon is given a dynamic effect, which is determined based on dynamic display parameters.

[0148] The dynamic display parameters include one or more of the following: the display duration and the display color.

[0149] In some embodiments, when the number of incorrectly played notes is less than a preset merging threshold, a second display scheme can be used to display the error message icons corresponding to the incorrectly played notes separately. Please refer to [link to relevant documentation]. Figure 2 .

[0150] The second display scheme, which displays error message icons for each misplayed note separately, may include: obtaining the position of each misplayed note in the score and displaying the error message icon for the misplayed note at the corresponding position (e.g., directly above the misplayed note). In other words, when the number of misplayed notes is less than a preset merging threshold, this invention preferably displays the error message icons for each misplayed note separately rather than merging them. The core objective is that, as the applicant has found, for performance scenarios where the number of misplayed notes is less than the preset merging threshold, or where the density of misplayed notes is low, displaying them separately is more beneficial for balancing user experience and display completeness.

[0151] In some embodiments, dynamic effects refer to display effects determined based on dynamic display parameters.

[0152] Among them, the dynamic display parameters are the core parameters used to control the display format of the error message icon, which mainly include two key dimensions: display duration and display color. The display duration and display color can be determined with reference to the moving display parameters in the first display scheme.

[0153] It should be understood that the display duration for both combined and separate displays can be preset default values.

[0154] Preferably, the error message icon corresponding to the wrong note, or the merged object, can disappear after the display time ends, so that the user can focus on the current progress while playing, and also have a general understanding of the error.

[0155] In some embodiments, when a user finishes playing and reviews the performance data, the error message icons or merged objects corresponding to all the wrongly played notes can be redisplayed, making it easier for the user to review the wrongly played notes in a targeted manner.

[0156] It should be noted that the choice between merging or displaying the notes separately can be determined based on the number of incorrectly played notes. In other embodiments, the choice can also be based on whether the musical section containing the incorrectly played notes belongs to a key section of the score; that is, incorrectly played notes in key sections can be displayed separately as much as possible, while incorrectly played notes in non-key sections can be merged.

[0157] In some embodiments, the choice between the first and second display schemes, i.e., whether to perform merged display or separate display, can be determined based on other factors, such as the interval of misplayed notes, error trends, and error music attribute types.

[0158] In some embodiments, it also includes:

[0159] Calculate the difference of at least one musical attribute between the actual performance data and the standard performance data;

[0160] The error trend type is determined based on the difference; wherein the error trend type includes a first error trend and a second error trend; the first error trend refers to the actual performance data being greater than the standard performance data; the second error trend refers to the actual performance data being less than the standard performance data;

[0161] Determine the recommended display direction for each merged object based on the error trend type;

[0162] Determine whether to perform merged display on the merged objects based on the similarity of the recommended display orientation:

[0163] If the similarity is greater than or equal to a preset similarity threshold, then a merged display is performed;

[0164] If the similarity is less than a preset similarity threshold, then merging and display will not be performed.

[0165] In some embodiments, the error trend type can be determined based on the difference of at least one musical attribute between the actual performance data and the standard performance data.

[0166] Preferably, the error trend refers to whether a certain musical attribute (such as pitch, duration, or dynamics) played by the user is larger or smaller than that musical attribute in the standard performance data, which corresponds to the first error trend and the second error trend, respectively.

[0167] In some embodiments, the recommended display direction for each merged object can be determined based on the error trend. For example, if the value of the musical attribute of the user's playing dynamics is larger than the standard playing data, the merged object corresponding to the wrongly played note can be marked as recommended to be displayed upwards.

[0168] It should be understood that if multiple consecutive misplayed notes share the same error trend type (i.e., either too high or too low), then these misplayed notes can all be marked as recommended for upward display.

[0169] Specifically, this is reflected in the reference line segment, which can be displayed by moving several merged objects from bottom to top, thus creating an upward visual effect.

[0170] Optionally, a preset mapping table of music attributes and display colors (e.g., red for incorrect dynamics, blue for incorrect time values, etc.) can be used, combined with a recommended display direction, to visually show users that the dynamics of these incorrectly played notes are all too high.

[0171] In some embodiments, it can be further determined whether to merge the objects for display based on the recommended display orientation of the merged objects.

[0172] In some embodiments, the method may further include: obtaining a set of merged objects and their corresponding error trend types; if the error trends are consecutively of the same type, then merging and displaying the merged objects of the same type of error trend.

[0173] In other words, this invention proposes a movement display mechanism that combines error trends. By mapping error trends to the movement direction of the merged object (up / down movement too large / too small), and coordinating with the three-dimensional display color, it can filter out some random errors by checking whether the movement direction is consistent, focusing on high-value performance problems, such as consistently excessive force moving upwards. Users can intuitively see the performance problem from the visual effect of the merged object moving upwards, without needing to analyze the performance data (performance data is complex and difficult to analyze, especially for some beginners, who find it difficult to capture effective information from a large amount of data). It can also intuitively reflect the performance problem to the user through the movement direction, and once a visual habit is formed, it can greatly reduce the cognitive conversion steps.

[0174] It should be understood that by using a dual display optimization mechanism of merging and moving displays, the problem of scattered and redundant error displays can be avoided by merging displays while accurately reflecting the wrong notes, and at the same time, users can avoid feeling frustrated. Furthermore, the movement trajectory formed by the moving display (i.e., up or down) can also prompt users with error trends, so that users can intuitively obtain error trend information from the movement trajectory without in-depth analysis.

[0175] In some embodiments, the decision to merge objects can be determined based on the similarity of the recommended display orientation. Specifically, if the similarity is greater than or equal to a preset similarity threshold, then merging is performed; if the similarity is less than the preset similarity threshold, then merging is not performed.

[0176] In some embodiments, the similarity of recommended display directions can refer to the proportion of merged objects with the same recommended display direction among all merged objects in a unit musical phrase.

[0177] For example, in a certain measure, there are five incorrectly played notes (all of which are dynamic errors). Four of them are too loud, meaning the recommended display direction is upward, and the remaining one is too soft, meaning the recommended display direction is downward. Therefore, the similarity of the upward recommended display direction in this measure can be calculated as 4 / 5, or 80%. Furthermore, if the preset similarity threshold is set to 60%, then the similarity of the recommended display directions is greater than the preset threshold, and a merge display operation can be performed.

[0178] In some embodiments, if the recommended display direction in a unit musical phrase has been determined, the starting point for moving the display can be further determined, i.e., the reference line segment where the first merged object is displayed.

[0179] For example, the starting point for moving the display can be determined based on the difference between the actual value and the standard value of the music attribute. This can be because a larger difference indicates a higher starting point (or a larger difference indicates a lower starting point).

[0180] In some embodiments, the starting point for the moving display can also be determined based on the difficulty of the performance. For example, if the musical passage contains large leaps and staccato notes, which are technically challenging, the starting point for the moving display can be set relatively high.

[0181] It should be understood that the starting point of the mobile display is also one of the parameters of the mobile display, and the starting point of the mobile display can be set by the user according to their needs.

[0182] In some embodiments, it also includes:

[0183] Determine whether the interval between the misplayed notes corresponding to the merged object is less than or equal to a preset interval;

[0184] If so, then perform a merge display;

[0185] If not, the merged display will not be performed.

[0186] In some embodiments, the merged objects corresponding to misplayed notes with an interval less than or equal to a preset interval are merged and displayed, while the merged objects corresponding to misplayed notes with an interval greater than the preset interval are not merged and displayed. This ensures that the merged display does not deviate from the musical phrase (for example, if misplayed notes that are several lines apart are merged, it may be difficult for the user to locate the corresponding position based on the error display results), and effectively avoids excessive merging.

[0187] The interval can refer to the number of notes between misplayed notes or the duration of the interval between misplayed notes; there is no limitation here.

[0188] In some embodiments, it also includes:

[0189] Acquire musical score data, wherein the musical score data includes several musical sections; each musical section includes at least one note;

[0190] Obtain the expected merging limit of the musical phrase, which is generated based on the merging limit parameter of the musical phrase; the merging limit parameter includes: the number of notes, and / or the number of score markers;

[0191] A merger scheme is generated based on the expected merger limits and the merger objects;

[0192] The merged objects are displayed in a merged manner according to the merge scheme.

[0193] It should be understood that the merging limit parameter is an indicator that objectively describes the musical complexity of a unit musical phrase (such as the number of notes, the number of musical notation marks, etc.), reflecting the information intensity of the score itself, or the difficulty of performance. It is used to predict the merging limit of the display and can effectively avoid the problem of the final result of the merging display being mismatched with the complexity of the score itself due to excessive merging from the perspective of limiting the merging display limit.

[0194] In some embodiments, a expected merging limit is generated based on a merging limit parameter. For example, if the merging limit parameter of a unit musical phrase is large (i.e., the number of notes and / or the number of score markers is large), the expected merging limit can be increased accordingly, so that the merged display result matches the complexity of each musical phrase. That is, the more complex the musical phrase, the larger the expected merging limit, which makes it easier for users to directly see from the merged display result (i.e., which musical phrases have large merging limits or which musical phrases have small merging limits) which musical phrases are difficult and important to play.

[0195] In some embodiments, the expected merging limit refers to the expected number of merged object groups remaining after the merged display is completed, or the number of times the merged display is performed on a unit musical phrase.

[0196] In some embodiments, generating a merging scheme based on the expected merging limit and the merging objects includes: obtaining the expected number of merging object groups in the current musical segment and the actual number of merging object groups in the musical segment after the initial merging operation; determining whether the expected number and the actual number are the same; if so, maintaining the original merging result; if not, correcting the actual number based on the expected number, that is, increasing or decreasing the actual number of merging object groups to a value that meets the expected number, thereby determining the final number of merging data groups, i.e., the final merging scheme, and then merging and displaying the merging objects according to the merging scheme.

[0197] The expected merging limit can be a specific value (e.g., 3) or a range of values ​​(e.g., 2-5).

[0198] In some embodiments, it also includes:

[0199] The display duration is determined based on error information and / or user information; wherein the error information includes error type, error severity, and error frequency; and the user information includes user level and progress status.

[0200] In some embodiments, error information includes error type (instantaneous value, dynamics, or pitch, etc.), error severity (i.e., the difference between the actual value and the standard value), and error frequency (i.e., the number of times the wrong note was played / the total number of times the note was played). It should be understood that error information can reflect the learning value of wrongly played notes from multiple dimensions. Determining the display duration based on the error information (e.g., the greater the error severity, the longer the display duration) helps to further improve the scenario adaptability of error display.

[0201] In some embodiments, user information includes user level (i.e., professional / amateur), progress (i.e., a decrease in the frequency of playing errors), and other information. It should be understood that determining the display duration based on user information (e.g., if the user is at an amateur level, the display duration can be longer to give them sufficient time for error analysis) helps to determine the duration of error display based on the user's own playing state and level, effectively improving the adaptability of error display to the user.

[0202] In summary, the technical problem solved by this invention is how to minimize the frustration caused to users by displaying errors while improving the completeness and efficiency of error display. To this end, this invention utilizes a dual display scheme of merged and separate displays, combined with a collaborative mechanism of mobile and dynamic displays. This effectively avoids the psychological impact on users from directly displaying all errors in scenarios with numerous mistakes, while simultaneously improving the efficiency of error display and preventing interface clutter. Furthermore, by using recommended display directions to map error trends, users can understand the approximate error situation without analyzing complex performance data, thereby greatly improving piano practice efficiency. In addition, by using merging limit parameters, it can be ensured that the merged display matches the complexity of the sheet music itself, avoiding excessive merging.

[0203] To better illustrate the invention below, the following will be combined with... Figure 1 , Figure 2 , Figures 3a-3d This application provides a unified description of the specific implementation methods for the mobile display:

[0204] Please see Figure 2 , Figures 3a-3c The purple tone bar on the note can be used to display the actual performance of at least one musical attribute. For example, in some embodiments, the length of the tone bar (e.g., the distance from the leftmost to the rightmost end of the tone bar) can be used to display the duration of the note value, and different lengths of the tone bars can correspond to different durations.

[0205] For example, if a user misses a note (missing a note is a type of misplay), the note column for the missed note may not be displayed.

[0206] It should be understood that the shape, color, and other visual effects of the sound bar can be set by the user or by default, and no restrictions are imposed here.

[0207] In some embodiments, a merged object, i.e. an error message icon, can be generated based on the cumulative number of misplayed notes in a unit musical phrase.

[0208] It should be understood that the error message icon can be used to display incorrectly played notes, or it can be... Figure 2 The red dot in the image can also be displayed in other ways (such as color, shape, etc.), as long as it achieves the purpose of displaying the wrongly played note; there are no restrictions here.

[0209] In some embodiments, the gray dashed lines in the figure represent reference lines, used to display a virtual staff based on the original musical score. It is understood that the color or shade of the reference lines can be adjusted by the user. For example, in some embodiments, the color of the reference lines can be set relatively light to mitigate any negative feedback that might result from an error display. Conversely, in some embodiments, the color of the reference lines can be set relatively dark to allow the user to clearly observe the overall nature of the error by observing the display effect of the error indicator icon between the reference lines.

[0210] For a clearer explanation of this plan, please refer to [link / reference]. Figure 3d Above a staff line, the black dashed lines form a set of reference lines, and one of the red ellipses within them represents an error message icon. It should be understood that different movement parameters can be added to the error message icon, such as display duration, color, and height, to create a moving visual effect.

[0211] For example, the moving visual effect can be achieved as follows: starting from the moment of display, the first error message icon is displayed for 0.5 seconds (the display duration can be divided into three stages: fade-in, pause, and fade-out, with the fade-in and fade-out durations being 0.2 seconds each and the pause duration being 0.1 seconds). At 0.3 seconds, the second error message icon is displayed for 0.5 seconds, and so on, thus creating the effect that the second error message icon begins to appear as the first one begins to disappear. Furthermore, by gradually decreasing the display height of each error message icon (i.e., the reference line segment where the error message icon is located), the effect of moving the display in a certain direction can be achieved.

[0212] In some embodiments, the moving effect can refer to the moving effect of an error message icon itself from appearance to disappearance, or it can refer to the visual effect of a group of merged objects moving in a certain direction under the action of moving display parameters.

[0213] It should be noted that in practical applications (see [link to relevant documentation]), Figure 2 The display color of the merged object (or error message icon) can be changed from dark to light after a short pause (the specific color can be determined based on the moving display parameters). The purpose is to avoid excessive display of incorrectly played notes, which would cause the user's attention to be mistakenly diverted and affect the performance.

[0214] In other words, this invention focuses on balancing user experience (avoiding overemphasizing errors and causing user frustration) and the completeness of displaying incorrectly played notes. This allows for the full display of errors while preventing excessive display of error message icons by adjusting display parameters. Please see [link to relevant documentation]. Figure 5 The present invention also provides a performance error display system, the system comprising:

[0215] The wrong note recognition module is used to identify wrong notes;

[0216] The merged object determination module is used to generate at least one merged object based on at least one of the wrongly played notes when the number of the wrongly played notes is greater than or equal to a preset merge threshold. The merged object is an error prompt icon.

[0217] A merged display module is used to merge and display the merged objects using a first display scheme; wherein the steps include:

[0218] The movement effect addition submodule is used to add movement effects to the merged object, wherein the movement effect is determined according to the movement display parameters;

[0219] The mobile display parameters include one or more of the following: number of objects, display height, display duration, and display color; the number of objects is determined based on the number of merged objects.

[0220] The mobile display submodule is used to move and display the merged object according to the mobile display parameters.

[0221] In some embodiments, the system is further configured to:

[0222] Count the number of merged objects and generate a quantity icon based on the count.

[0223] It should be understood that the system can be used to perform the steps described in any embodiment of the present invention.

[0224] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0225] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a computer terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0226] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A performance error display method characterized by comprising: Comprise: S101, identify the wrong playing notes; S102, when the number of wrong playing notes is greater than or equal to a preset merging threshold, at least one merging object is generated according to at least one of the wrong playing notes, and the merging object is an error prompt icon; S103, the merging object is displayed by using a first display scheme; wherein, comprising steps: S1031, adding a moving effect to the merging object, wherein the moving effect is determined according to a moving display parameter; The moving display parameter comprises: object quantity, display height, display time length, display color; the object quantity is determined according to the number of merging objects; the display height refers to the vertical or horizontal position of the merging object in the moving display process, and the display height is determined according to at least one of the error type, error degree and error frequency of the wrong playing notes; the display time length refers to the total time span of completing a display process of the merging object, and the display time length is determined according to at least one of the error type, error degree and error frequency of the wrong playing notes; the display color refers to the color attribute of the merging object, and different error types, error degrees and error frequencies are distinguished by color change; S1032, visually moving display the merging object according to the moving display parameter; wherein, comprising: At least one reference line segment is generated at the display position of the merging object; The merging object is visually moved and displayed on at least one reference line segment; wherein, the display height is used to define the relative height of the merging object in the associated reference line segment.

2. The performance error display method according to claim 1, characterized by The merging display further comprises: The number of merging objects is counted, and a quantity icon is generated according to the number.

3. The performance error display method according to claim 1, characterized by Comprise: When the number of wrong playing notes is less than the preset merging threshold, the error prompt icon is generated according to the wrong playing notes; The error prompt icon is displayed separately by using a second display scheme, and correspondingly comprising steps: The error prompt icon is displayed at the corresponding position of the wrong playing notes in the score; Wherein, a dynamic effect is added to the error prompt icon, wherein the dynamic effect is determined according to a dynamic display parameter; The dynamic display parameter comprises one or more of the following: the display time length and the display color.

4. The performance error display method of claim 1, wherein Comprise: The display position comprises the upper position and / or the lower position of the staff line.

5. The performance error display method of claim 1, wherein Before merging display, further comprising: Calculate the difference of at least one music attribute between the actual performance data and the standard performance data; Determine the error trend type according to the difference; wherein, the error trend type comprises a first error trend and a second error trend; the first error trend means that the actual performance data is greater than the standard performance data; the second error trend means that the actual performance data is less than the standard performance data; Determine the recommended display direction of each merging object according to the error trend type; Determine whether to perform merging display on the merging object according to the similarity degree of the recommended display direction: Wherein, if the similarity degree is greater than or equal to a preset similarity threshold, merging display is performed; If the similarity degree is less than a preset similarity threshold, the merged display is not performed.

6. The performance error display method according to claim 5, characterized by Before performing the merged display, further comprising: determining whether the interval of the wrong note corresponding to the merging object is less than or equal to a preset interval; if yes, performing the merged display; if no, not performing the merged display.

7. The performance error display method of claim 1, wherein comprising: obtaining score data, wherein the score data comprises a plurality of musical phrases; the musical phrases comprise at least one note; obtaining an expected merging limit of the musical phrase, the expected merging limit being generated according to a merging limit parameter of the musical phrase; the merging limit parameter comprises: the number of notes, and / or the number of score marks; generating a merging scheme according to the expected merging limit and the merging object; performing the merged display of the merging object according to the merging scheme.

8. The performance error display method of claim 1, wherein comprising: the display duration is determined according to error information, and / or user information; wherein the error information comprises error type, error degree, and error frequency; the user information comprises user level and progress situation.

9. A performance error display system characterized by comprising: comprising: a wrong note recognition module for recognizing wrong notes; a merging object determination module for generating at least one merging object according to at least one wrong note when the number of wrong notes is greater than or equal to a preset merging threshold; the merging object is an error prompt icon; a merged display module for performing the merged display of the merging object using a first display scheme; wherein comprising steps: a moving effect adding submodule for adding moving effects to the merging object, wherein the moving effects are determined according to moving display parameters; the moving display parameters comprise: object number, display height, display duration, and display color; the object number is determined according to the number of merging objects; the display height refers to the vertical or horizontal position of the merging object in the moving display process, and is determined according to at least one of the error type, error degree, and error frequency of the wrong note; the display duration refers to the total time span of the merging object completing a display process, and is determined according to at least one of the error type, error degree, and error frequency of the wrong note; the display color refers to the color attribute of the merging object, and different error types, error degrees, and error frequencies are distinguished by color changes; a moving display submodule for visually moving and displaying the merging object according to the moving display parameters, wherein comprising: generating at least one reference line segment at the display position of the merging object; visually moving and displaying the merging object on at least one reference line segment; wherein the display height is used to define the relative height of the merging object in the associated reference line segment.

10. The performance error display system of claim 9, wherein The system is further used for: counting the number of merging objects, and generating a number icon according to the number.

Images