A vectorized music score display method and system

Abstract

The present application relates to the technical field of score display, and particularly relates to a vectorized score display method and system. The vectorized score comprises vectorized notes, and each vectorized note corresponds to a note display area. The method comprises: obtaining an operation signal; determining a continuous selection area according to a first track at a first time and a second track at a second time; which comprises: identifying the first track at the first time; determining a first display height according to the first track; identifying the second track at the second time; determining a first display length according to the first track and the second track; generating the continuous selection area according to the first display height and the first display length; generating a thumbnail label according to an adding label signal; wherein the thumbnail label comprises a thumbnail information label; and displaying an expanded information label corresponding to the thumbnail information label according to a label expansion signal triggered by the user in the thumbnail information label. The present application can optimize the label display efficiency in the vectorized score and improve the user experience.

Description

Technical Field

[0001] This invention relates to the field of sheet music display technology, specifically to a vectorized sheet music display method and system. Background Technology

[0002] The continuous development of technology and the increasing demand for piano practice are constantly raising new requirements for how to utilize new technologies to improve the efficiency of piano learning. Currently, existing technologies are also attempting to propose some optimization solutions for piano scores.

[0003] For example, patent application CN113360721A discloses a method and terminal for real-time mutual translation of musical scores. It constructs a musical score data structure library, which includes unique elements specific to each type of musical score and common elements shared by all types of scores; establishes a basic musical score graphic library, which includes various types of musical score graphics; establishes a mapping relationship between the musical score data structure library and the basic musical score graphic library; receives musical score editing requests, which include the musical score graphic to be edited; determines the type of the musical score data structure to be edited based on the musical score data structure library, the basic musical score graphic library, the musical score graphic to be edited, and the mapping relationship; and performs translation between different musical scores and edits the corresponding musical score graphics based on the type of the musical score data structure to be edited. By introducing common elements for various types of musical scores, it achieves data sharing among different types of scores, greatly improving editing and refreshing efficiency, and enabling real-time mutual translation between various types of musical scores, making mutual translation and score transcription instantaneous and reliable.

[0004] For example, patent application CN116863892A discloses an intelligent music score editing method, device, computing device, and storage medium, which identifies the imported file according to the file type and extracts the music score information; wherein, the music score information includes key signature information, chord information, time signature information, and lyrics information; and can quickly generate and export an editable music score file based on the imported file.

[0005] However, the applicant noted that while the aforementioned solution can analyze and edit piano scores, it struggles to meet the diverse needs of users in various scenarios. Therefore, a method capable of adapting to complex score display scenarios is urgently needed. Summary of the Invention

[0006] The purpose of this invention is to provide a vectorized music score display method and system, which partially solves or alleviates the above-mentioned shortcomings in the prior art, optimizes the label display efficiency in vectorized music scores, and improves the user experience.

[0007] To solve the aforementioned technical problems, the present invention specifically adopts the following technical solution:

[0008] A first aspect of the present invention is to provide a method for displaying vectorized musical scores, wherein the vectorized musical scores include vectorized notes, and each vectorized note corresponds to a note display area; the method includes:

[0009] S101, Obtain the operation signal; the operation signal includes a first trajectory and a second trajectory;

[0010] A continuously selected region is determined based on the first trajectory at the first time point and the second trajectory at the second time point; this includes:

[0011] Identify the first trajectory at the first moment;

[0012] When the first trajectory is within the note display area, the first display height is determined based on the first trajectory;

[0013] Identify the second trajectory at the second time point;

[0014] When the second trajectory is within the note display area, the first display length is determined based on the first trajectory and the second trajectory;

[0015] The continuous selection area is generated based on the first display height and the first display length;

[0016] S102, Generate a thumbnail label based on the tag addition signal triggered by the user in the continuously selected area; wherein, the thumbnail label includes a thumbnail information label;

[0017] S103, based on the tag expansion signal triggered by the user on the thumbnail information tag, display the expanded information tag corresponding to the thumbnail information tag.

[0018] In some embodiments, it also includes:

[0019] S104, determine whether the visual parameter of the abbreviation tag in the unit musical segment is greater than or equal to the visual parameter threshold of the abbreviation tag; the visual parameter of the abbreviation tag includes: the density of the abbreviation tag, or the interval between two abbreviation tags;

[0020] S105, if the execution result of S104 is yes, then perform a merging operation on the abbreviated information tags;

[0021] The merging operation refers to combining at least two abbreviated information tags into one abbreviated information tag, and combining the text content of at least two corresponding expanded information tags into one expanded information tag.

[0022] In some embodiments, S105 further includes:

[0023] Calculate the degree of association between at least two of the expanded information tags within the unit musical phrase; the degree of association is the semantic similarity of the text content in the expanded information tags;

[0024] Mark the abbreviated information tags corresponding to at least two expanded information tags whose degree of association is greater than or equal to the first degree of association as sibling merged tags;

[0025] Perform the merge operation on the sibling merge tags.

[0026] In some embodiments, the merging operation further includes:

[0027] Determine whether the sibling merge labels are adjacent; where adjacent means that the notes corresponding to the sibling merge labels are adjacent in terms of playing time.

[0028] If they are adjacent, then merge the sibling merge tags;

[0029] If they are not adjacent, determine whether the distance between the merged tags at the same level is greater than a preset distance;

[0030] If not, then merge the sibling merge tags.

[0031] In some embodiments, it also includes:

[0032] If the distance between the sibling merged tags is greater than a preset distance, then an intermediate abbreviation information tag is identified, wherein the intermediate abbreviation information tag is the abbreviation information tag between at least two sibling merged tags;

[0033] Determine whether the degree of association between the intermediate abbreviation information tag and the sibling merged tag is greater than or equal to the second degree of association;

[0034] If so, then merge the sibling merge tag and the intermediate abbreviation information tag.

[0035] In some embodiments, the method further includes the following steps prior to step S105:

[0036] S106, determine whether the text size in the expanded information tag corresponding to the abbreviated information tag is greater than or equal to the preset text size;

[0037] If the result of S106 is yes, then S105 will not be executed.

[0038] If the result of S106 is negative, then S105 will be executed.

[0039] In some embodiments, it also includes:

[0040] The abbreviation labels also include graphic labels;

[0041] If both the abbreviation information label and the graphic label exist simultaneously in a musical note display area;

[0042] The thumbnail information label and the graphic label are displayed at different display heights in the musical note display area.

[0043] In some embodiments, it also includes:

[0044] Obtain the expected number of merges, which is generated based on the visual parameters of the staff within the unit musical phrase; the visual parameters of the staff include: the number of notes within the unit musical phrase, and / or the number of musical notation marks;

[0045] A merger scheme is generated based on the expected number of mergers and the same-level merger tags;

[0046] The merge operation is performed according to the merge scheme.

[0047] In some embodiments, it also includes:

[0048] Generating the continuous selection area based on the first display height and the first display length includes the following steps:

[0049] Before the second time point, identify the third trajectory at the third time point;

[0050] Calculate the height difference between the third trajectory and the first trajectory;

[0051] When the height difference is greater than a preset height threshold, a second display height at the third moment is generated based on the third trajectory.

[0052] The continuous selection area is generated based on the first display height, the second display height, and the first display length.

[0053] A second aspect of the present invention is to provide a vectorized musical score display system, wherein the vectorized musical score includes vectorized notes, and each vectorized note corresponds to a note display area; the system includes:

[0054] An operation signal acquisition module is used to acquire operation signals, including a first trajectory and a second trajectory. A continuous selection area is determined based on the first trajectory at a first moment and the second trajectory at the second moment. This includes: identifying the first trajectory at the first moment; determining a first display height based on the first trajectory when the first trajectory is within the note display area; identifying the second trajectory at the second moment; determining a first display length based on the first trajectory and the second trajectory when the second trajectory is within the note display area; and generating the continuous selection area based on the first display height and the first display length.

[0055] The thumbnail generation module is used to generate thumbnails based on the tag addition signal triggered by the user in the continuously selected area; wherein, the thumbnail includes thumbnail information tags;

[0056] The expand label display module is used to display the expand information label corresponding to the thumbnail information label based on the label expand signal triggered by the user on the thumbnail information label.

[0057] Beneficial technical effects:

[0058] This invention uses vectorization to select irregularly shaped areas across lines, using the note display area as the unit. It generates continuous selection areas based on the note display areas corresponding to continuous operation signals, facilitating local selection operations and enabling users to understand the deeper operational intent behind the signals. This supports personalized needs in various scenarios (e.g., playback, adding tags). Furthermore, this invention proposes a mid-segment signal recognition mechanism, which can further determine the range of the continuous selection area selected by the user based on the operation signal triggered at a third time between the first and second time points, improving the understanding of the user's true intent. Simultaneously, this invention not only supports irregularly shaped selection operations but also provides a visual optimization scheme for information abbreviation tags corresponding to continuous selection areas. Specifically, the visual optimization scheme has the following technical effects:

[0059] Firstly, this invention employs a tiered merging mechanism, prioritizing tags with a higher degree of relevance. This prioritization based on relevance offers at least three advantages: 1) It ensures logical coherence and focus in the merged tags, preventing semantic confusion caused by direct, abrupt splicing; 2) The merged tags maintain continuity, reducing the information interpretation cost due to significant differences in content; 3) Prioritizing the merging of semantically similar tags through a tiered strategy helps free up display space on the sheet music interface and reduces visual interference.

[0060] Secondly, while maintaining the association of tags (merging tags of the same level with an association degree greater than or equal to the first association degree), this invention merges intermediate abbreviation information tags with an association degree greater than the second association degree. In other words, this invention proposes a dynamic decision-making mechanism based on dual association degree thresholds, which can significantly reduce the visual parameters of abbreviation tags while ensuring that the merging operation is logical, thereby further improving the efficiency of vectorized sheet music display.

[0061] Third, the invention performs a merging operation on abbreviated information tags based on visual parameters of the abbreviated tags, while simultaneously imposing restrictions on the merging operation based on visual parameters of the musical score to suit the characteristics of the score. In other words, this invention proposes a dual mechanism where merging operation rules and merging restriction rules work together, which helps improve the adaptability and relevance of the merging operation to different types of musical scores. Attached Figure Description

[0062] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0063] Figure 1 This is an example diagram of a continuously selected region in an exemplary embodiment of the present invention;

[0064] Figure 2 This is an example diagram of the operation signals in an exemplary embodiment of the present invention;

[0065] Figure 3 This is an example diagram illustrating the selection of a single note display area in an exemplary embodiment of the present invention;

[0066] Figure 4 This is an example diagram illustrating popular music theory knowledge in an exemplary embodiment of the present invention;

[0067] Figure 5 This is an example diagram of the expanded information label in an exemplary embodiment of the present invention;

[0068] Figure 6 This is an example diagram of selecting a graphic label in an exemplary embodiment of the present invention;

[0069] Figure 7 This is a display effect diagram after adding graphic labels in an exemplary embodiment of the present invention;

[0070] Figure 8This is an example diagram illustrating the operation of reducing the size of a musical score in an exemplary embodiment of the present invention;

[0071] Figure 9 This is an example diagram illustrating the operation of enlarging the musical score surface in an exemplary embodiment of the present invention;

[0072] Figure 10 A flowchart illustrating the vectorized musical score display method in an exemplary embodiment of the present invention. Detailed Implementation

[0073] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0074] In this document, suffixes such as "module," "part," or "unit" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves. Therefore, "module," "part," or "unit" may be used interchangeably.

[0075] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the present invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0076] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0077] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0078] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0079] As used in this specification, the term "about" typically means + / -5% of the value, more typically + / -4% of the value, more typically + / -3% of the value, more typically + / -2% of the value, even more typically + / -1% of the value, and even more typically + / -0.5% of the value.

[0080] In this specification, certain embodiments may be disclosed in a range-bound format. It should be understood that this "range-bound" description is merely for convenience and brevity and should not be construed as a rigid limitation on the disclosed range. Therefore, the description of a range should be considered as having specifically disclosed all possible subranges and the individual numerical values ​​within those ranges. For example, a description of the range 1-6 should be considered as having specifically disclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., and the individual numbers within those ranges, such as 1, 2, 3, 4, 5, and 6. This rule applies regardless of the breadth of the range.

[0081] Definition of noun:

[0082] Vectorized sheet music refers to a method that uses image processing technology to automatically identify and convert sheet music and its musical symbols (such as notes, rests, clefs, key signatures, time signatures, slurs, etc.) into a digital form that is understandable, editable, and playable by computers. Its core lies in parsing the sheet music and its musical symbols into structured data, rather than simply the pixel information in the sheet music image. Please see [link to documentation]. Figure 8 , Figure 9 This vectorization conversion allows users to select, play, and search for specific parts of the sheet music, while also overcoming problems such as blurred image format sheet music when enlarged and uneditable.

[0083] Vectorized notes refer to the process of converting notes in a vectorized musical score into selectable and editable note objects. For details, please refer to [link to relevant documentation]. Figure 8 , Figure 9 It features infinite scaling without distortion and supports arbitrary selection.

[0084] Example 1:

[0085] Please see Figure 10 This invention proposes a method for displaying vectorized musical scores, wherein the vectorized musical scores include vectorized notes, and each vectorized note corresponds to a note display area;

[0086] The methods include:

[0087] S101, acquire the operation signal, and generate a continuous selection area based on the operation signal;

[0088] For example, in some embodiments, the operating signal includes a first trajectory and a second trajectory;

[0089] A continuously selected region is determined based on the first trajectory at the first time point and the second trajectory at the second time point; this includes:

[0090] Identify the first trajectory at the first moment;

[0091] When the first trajectory is within the note display area, the first display height is determined based on the first trajectory;

[0092] Identify the second trajectory at the second time point;

[0093] When the second trajectory is within the note display area, the first display length is determined based on the first trajectory and the second trajectory;

[0094] The continuous selection area is generated based on the first display height and the first display length;

[0095] S102, Generate a thumbnail label based on the tag addition signal triggered by the user in the continuously selected area; wherein, the thumbnail label includes a thumbnail information label;

[0096] S103, based on the tag expansion signal triggered by the user on the thumbnail information tag, display the expanded information tag corresponding to the thumbnail information tag.

[0097] Preferably, the first moment usually occurs before the second moment.

[0098] In some embodiments, the note display area in the vectorized musical score provided by this invention refers to the display range calculated and allocated for each vectorized note (the display range can typically be defined by position, width, and height). Based on the note display area, it can be ensured that the user can select notes correctly, clearly, and without overlap.

[0099] In some embodiments, when a user clicks a mouse button, it is considered that the user has triggered the corresponding operation signal; and / or, when the trigger data applied by the user on the screen is greater than a preset trigger threshold, it is considered that the user has triggered the corresponding operation signal.

[0100] In some embodiments, the first trajectory and the second trajectory can be the trajectory of the user's operation signal change at corresponding moments. Correspondingly, the first moment can be the moment the user triggers the operation signal; the second moment can be the moment the user stops triggering the operation signal. It should be understood that the first and second moments are typically of very short duration, such as 0.1 seconds. See also... Figure 2 , Figure 2L1 and L2 in the figure represent the user's first trajectory and second trajectory at the first and second time points, respectively.

[0101] In some embodiments, the user is considered to need to select a continuous selection area only when the first track is in the note display area, or when the second track is in the note display area.

[0102] In some embodiments, see Figure 3 If an operation signal only triggers the first track, or if the time interval between the user triggering and stopping the operation signal is very short, such as less than or equal to 0.01 seconds, and the first track is in the note display area, then it is considered that the user needs to select a single note display area.

[0103] It should be understood that the first trajectory can be an operation point or a continuous operation trajectory of a continuous operation signal.

[0104] It should be understood that a continuous selected area can include multiple note display areas.

[0105] This invention provides a method for vectorized musical score selection of irregular shapes. The irregular shape selection method will be explained and illustrated below by way of example.

[0106] The musical score can include a coordinate system that serves as a reference for the position of operation signals.

[0107] In some embodiments, the origin O of the coordinate system can be located at any position on the musical score. The position of point O is only for determining the relative position of the operation signal and is not limited here. The coordinates of the origin O can be represented as (X0, Y0).

[0108] In some embodiments, a first display height can be determined based on a first trajectory, including: identifying the height of the first trajectory in the musical score, wherein the height can refer to the longitudinal distance Y1-Y0 between the starting point A(X1,Y1) of the first trajectory and the origin O of the coordinate system; and using the height Y1-Y0 of the first trajectory in the musical score as the first display height.

[0109] In some embodiments, when the user operation signal continues until the second time point, the second trajectory at the second time point is recorded.

[0110] In some embodiments, when a user triggers a second track at a second moment, and the second track is located in a note display area, it is assumed that the user has selected the note display area.

[0111] In some embodiments, the first display length can be determined based on the first trajectory and the second trajectory, including: identifying the starting point A (X1,Y1) of the first trajectory and the ending point B (X2,Y2) of the second trajectory, wherein the lateral distance X2-X1 between A and B is the first display length.

[0112] In some embodiments, see Figure 1 It can generate a continuous selection area based on the first display height and the first display length.

[0113] In some embodiments, visual emphasis elements can be added to the generated contiguous selected area. Visual emphasis elements refer to various visual elements used to highlight specific information, guide the viewer's attention, or enhance the visual experience, thereby enabling the user to obtain key information through intuitive visual cues.

[0114] For example, visual emphasis elements can be static graphic markers, dynamic visual effects, or a combination of both. Specifically, they can be color changes (e.g., highlighting, gradient colors), flashing effects (e.g., periodic flashing, pulse light effects, water ripple effects), arrow indicators (e.g., directional guidance, dynamic paths), icons and symbols, text labels (e.g., brief descriptions, numerical labels), shadows and outlines (e.g., projection effects, halo design, bold outlines), animation effects (e.g., explosions, floating bubbles), thickened or highlighted lines, etc., without limitation.

[0115] It should be understood that the continuous selection area selected by the vectorized music score irregular selection method provided by the present invention, wherein continuous emphasizes the duration of the operation signal over a certain period of time (e.g., the user continuously pressing the mouse).

[0116] In other words, based on the first and second tracks corresponding to the operation signals, the non-contiguous note display area selected by the user can be determined. The non-contiguous note display area can refer to the note display area corresponding to notes that are not adjacent in the playing sequence.

[0117] Furthermore, this invention uses vectorization to select irregularly shaped areas across lines, using the note display area as the selection unit. It generates continuous selection areas based on the note display area corresponding to continuous operation signals, which facilitates local selection operations, allowing users to understand the deeper operational intent behind the operation signals and supporting personalized needs in various scenarios.

[0118] In some embodiments, operations such as adding tags, copying, playing, viewing science information, and recommending musical clips can be performed locally on the continuously selected area based on the operation signal triggered by the user after generating the continuously selected area. For an example, the AI ​​teacher's science information interface after the user clicks to view science information can be found here. Figure 4 .

[0119] In some embodiments, a thumbnail can be generated based on a tag addition signal triggered by a user in the continuously selected area; wherein the thumbnail includes a thumbnail information tag.

[0120] In some embodiments, user-added abbreviation tags can be overlaid on the corresponding note display area as visual markers.

[0121] In some embodiments, the abbreviation label may include abbreviation information labels, wherein the abbreviation information labels enable users to locally annotate a single note or a continuous selection area.

[0122] In some embodiments, the expanded information label corresponding to the thumbnail information label can be displayed based on a label expansion signal triggered by the user on the thumbnail information label (for example, when the user clicks on the display area of ​​the corresponding thumbnail information label, it can be considered that the user has triggered the label expansion signal). See also: Figure 5 Expanding the information tabs can include various types of information such as user-added annotations and images.

[0123] In some embodiments, it also includes:

[0124] S104, determine whether the visual parameter of the abbreviation tag in the unit musical segment is greater than or equal to the visual parameter threshold of the abbreviation tag; the visual parameter of the abbreviation tag includes: the density of the abbreviation tag, or the interval between two abbreviation tags;

[0125] S105, if the execution result of S104 is yes, then perform a merging operation on the abbreviated information tags;

[0126] The merging operation refers to combining at least two abbreviated information tags into one abbreviated information tag, and combining the text content of at least two corresponding expanded information tags into one expanded information tag.

[0127] In some embodiments, the abbreviation information label may also be referred to as an information label.

[0128] It should be noted that, for the purpose of facilitating the structural division of musical scores, the "unit musical phrase" mentioned in this invention can refer to the smallest segment unit into which the score is divided by bar lines (vertical lines) and can be repeatedly trained. Merging the abbreviated information tags based on unit musical phrases better suits users' music reading habits.

[0129] Of course, in some embodiments, the length of a single musical segment can be flexibly adjusted according to the complexity of the music, which is not limited here.

[0130] Preferably, in some embodiments, a merging operation is performed on the abbreviated information tags located in the same unit musical phrase.

[0131] It should be noted that in some embodiments, when the continuous selection area selected by the user covers more than one unit segment, at least one unit segment covered by the continuous selection area can be regarded as a unit segment (which can be called a merged unit segment, that is, two or more unit segments are regarded as a merged unit segment), and the abbreviation information tags in the merged unit segment are merged.

[0132] It should be understood that this setting allows for adjustments to the range of individual musical segments while supporting user selection of irregular shapes, effectively improving the adaptability of the merging operation.

[0133] In some embodiments, the abbreviation visual parameter is a quantifiable visual indicator whose value can characterize the density of abbreviations or the spacing between two abbreviations.

[0134] The density of abbreviation tags can refer to the number of abbreviation tags in a unit of musical phrase.

[0135] The interval between abbreviation tags can refer to the average of the intervals between any two abbreviation tags.

[0136] It should be understood that if the visual parameter of the abbreviation label in a unit musical phrase is greater than or equal to the threshold of the visual parameter of the abbreviation label, then the abbreviation information label can be merged to optimize the readability of the sheet music display interface and avoid excessive abbreviation information labels from causing the display interface to be cluttered and affecting the user's playing experience.

[0137] In some embodiments, the merging operation may refer to combining at least two of the abbreviated information tags into one abbreviated information tag, and further, combining the text content in the corresponding at least two expanded information tags into one expanded information tag.

[0138] The order in which the contents of the expanded information tags are arranged can be determined according to the order in which the corresponding notes are played. For example, during a merging operation, the contents of the expanded information tags corresponding to the notes played first can be arranged first.

[0139] In some embodiments, the order of content arrangement during the merging operation can also be determined based on the level of professionalism of the content in the expanded information tabs; this is not limited here.

[0140] In some embodiments, S105 further includes:

[0141] Calculate the degree of association between at least two of the expanded information tags within the unit musical phrase; the degree of association is the semantic similarity of the text content in the expanded information tags;

[0142] Mark the abbreviated information tags corresponding to at least two expanded information tags whose degree of association is greater than or equal to the first degree of association as sibling merged tags;

[0143] Perform the merge operation on the sibling merge tags.

[0144] In some embodiments, when performing a merging operation, the degree of association between at least two expanded information tags can be calculated within a unit musical phrase. The degree of association refers to the semantic similarity of the text content in the expanded information tags; for example, the degree of association could be 90%. The semantic similarity of the text content can be obtained from a preset semantic mapping table or calculated from a large semantic model; no limitation is made here.

[0145] In some embodiments, semantic similarity can be calculated by extracting keywords (e.g., "playing too fast" or "playing too slow") from the text content of abbreviation information tags and calculating the semantic similarity between keywords of different abbreviation information tags.

[0146] Alternatively, in some embodiments, the greater the number of identical keywords present in two abbreviation tags, the greater the semantic similarity.

[0147] In some embodiments, the abbreviated information tags corresponding to at least two expanded information tags with a degree of association greater than or equal to the first degree of association can be marked as sibling merge tags; the merging operation is performed on the sibling merge tags.

[0148] The first level of association can be set by the user according to their needs.

[0149] It should be understood that this invention employs a tiered merging mechanism, prioritizing the merging of tags with a higher degree of relevance. This prioritization based on relevance has at least three advantages: 1) It ensures, to a certain extent, that the merged new tags have logical connections and focused content, avoiding semantic confusion caused by direct and abrupt splicing; 2) The merged new tags have continuity, reducing the information interpretation cost caused by significant differences in content within the merged new tags; 3) Prioritizing the merging of tags with high semantic similarity through a tiered strategy helps free up display space on the sheet music interface and reduces visual interference.

[0150] In some embodiments, the merging operation further includes:

[0151] Determine whether the sibling merge labels are adjacent; where adjacent means that the notes corresponding to the sibling merge labels are adjacent in terms of playing time.

[0152] If they are adjacent, then merge the sibling merge tags;

[0153] If they are not adjacent, determine whether the distance between the merged tags at the same level is greater than a preset distance;

[0154] If not, then merge the sibling merge tags.

[0155] In some embodiments, the present invention introduces distance as a limiting factor based on the priority merging mechanism. On the one hand, this can maximize the fit with the continuity of the music itself, and on the other hand, it can prevent erroneous merging operations due to excessive distance.

[0156] Among them, determining whether the same-level merge tags are adjacent can mean that the notes corresponding to the same-level merge tags are adjacent in terms of playing time.

[0157] In some embodiments, if sibling merge tags are adjacent, the merge operation can be performed directly; if they are not adjacent, it is necessary to determine whether the distance between the two sibling merge tags is greater than a preset distance. If the distance is less than or equal to the preset distance, the two sibling merge tags can still be merged.

[0158] In some embodiments, the distance between merging labels of the same level can refer to the display distance of the notes corresponding to the two labels on the score, or it can refer to the time interval between the playing of the notes corresponding to the two labels; no limitation is made here.

[0159] In some embodiments, it also includes:

[0160] If the distance between the sibling merged tags is greater than a preset distance, then an intermediate abbreviation information tag is identified, wherein the intermediate abbreviation information tag is the abbreviation information tag between at least two sibling merged tags;

[0161] Determine whether the degree of association between the intermediate abbreviation information tag and the sibling merged tag is greater than or equal to the second degree of association;

[0162] If so, then merge the sibling merge tag and the intermediate abbreviation information tag.

[0163] The second degree of association is less than the first degree of association.

[0164] In some embodiments, an intermediate abbreviation tag may refer to other abbreviation tags between two semantically highly similar but not adjacent sibling merge tags that are more than a preset distance apart. Essentially, it is an intermediate tag surrounded by highly related sibling merge tags.

[0165] It should be understood that in some special cases (for example, two sibling merged tags are semantically highly similar but not adjacent in position, and the distance between them is greater than a preset distance), the present invention has made an adaptive adjustment to the merging strategy by introducing a second degree of association, that is, merging intermediate abbreviation information tags with a degree of association greater than the second degree of association with sibling merged tags.

[0166] It should be noted that, while maintaining the correlation between the merged tags (merging tags of the same level with a correlation degree greater than or equal to the first correlation degree), this invention proposes a dynamic decision-making mechanism based on a dual correlation degree threshold. This mechanism can significantly reduce the visual parameters of the abbreviated tags while ensuring that the merging operation is logical, thereby further improving the efficiency of vectorized sheet music display.

[0167] In some embodiments, the method further includes the following steps prior to step S105:

[0168] S106, determine whether the text size in the expanded information tag corresponding to the abbreviated information tag is greater than or equal to the preset text size;

[0169] If the result of S106 is yes, then S105 will not be executed.

[0170] If the result of S106 is negative, then S105 will be executed.

[0171] In some embodiments, if the text size of the expanded information tag corresponding to the abbreviated information tag is greater than or equal to the preset text size, it indicates that the information content in the tag is too large and not suitable for merging; in this case, the merging operation is not performed. If the text size of the expanded information tag corresponding to the abbreviated information tag is less than the preset text size, it indicates that the information content in the tag is not large and suitable for merging; in this case, the merging operation can be performed.

[0172] In some embodiments, it also includes:

[0173] The abbreviation labels also include graphic labels;

[0174] If both the abbreviation information label and the graphic label exist simultaneously in a musical note display area;

[0175] The thumbnail information label and the graphic label are displayed at different display heights in the musical note display area.

[0176] In some embodiments, see Figure 6 , Figure 7 Abbreviations can also include graphic tags.

[0177] In some embodiments, if a user adds both abbreviated information labels and graphic labels to a note display area, the abbreviated information labels and graphic labels are displayed at different display heights in the note display area. By displaying different types of abbreviated labels in layers, the height difference facilitates the parallel and clear expression of complex information, effectively avoiding visual conflicts caused by overlapping displays and preventing users from misreading or missing key information.

[0178] Furthermore, different response strategies can be set for different types of thumbnail labels; for example, clicking a thumbnail information label triggers a label expansion signal, while clicking a graphic label can control the graphic label to scale or rotate.

[0179] For example, in some embodiments, the graphic label can be a sticker that can be used to display keywords (such as fast, slow), or the sticker can be used to display some preset graphics that can be selected by the user to represent different prompt meanings (such as fast, slow, high difficulty, etc.).

[0180] Alternatively, in some embodiments, the graphic label may also be a pre-stored emoji image.

[0181] It should be understood that graphic labels are highly condensed and can add fun to the long and tedious piano practice process through concise and easy-to-understand text (such as attention, slow, fast, etc.) or graphics (such as musical notes, expressions, etc.). At the same time, they can also help people intuitively understand the rich meaning behind the graphic labels they have added.

[0182] In some embodiments, graphic labels may be referred to as simple labels.

[0183] For example, with the help of “slow” graphic labels (or simple labels), users can remind themselves to slow down the playing speed at certain points to avoid rushing the beat.

[0184] In some embodiments, it also includes:

[0185] Obtain the expected number of merges, which is generated based on the visual parameters of the staff within the unit musical phrase; the visual parameters of the staff include: the number of notes within the unit musical phrase, and / or the number of musical notation marks;

[0186] A merger scheme is generated based on the expected number of mergers and the same-level merger tags;

[0187] The merge operation is performed according to the merge scheme.

[0188] It's important to note that staff visual parameters are indicators that objectively describe the musical complexity of a unit of musical phrase (such as the number of notes, the number of musical notation marks, etc.), reflecting the information intensity of the score itself, or in other words, its playing difficulty. They are used to predict the expected number of phrases to be merged, effectively preventing the over-merging of complex phrases from the perspective of limiting merging operations. On the other hand, thumbnail visual parameters quantify the tag density or tag spacing on the score interface after the user adds thumbnail tags, effectively preventing invalid merging from the perspective of merging operations.

[0189] It should be understood that the merging operation of abbreviated information tags is based on visual parameters of the abbreviated tags, while the merging operation is constrained according to the characteristics of the musical score based on visual parameters of the musical score. In other words, this invention proposes a dual mechanism in which merging operation rules and merging restriction rules work together. This can avoid the merged tags and the musical score forming a top-heavy display interface (i.e., the musical score is complex, but few tags remain after merging). In other words, it can ensure that the content / quantity of the merged tags is highly adaptable to the content and difficulty of the musical score itself. Furthermore, it helps to improve the adaptability and targeting of the merging operation for different types of musical scores.

[0190] In some embodiments, musical notation may include rests, clefs, key signatures, time signatures, slurs, and other musical notation symbols.

[0191] It should be understood that the number of notes and / or the number of musical notation marks can reflect the difficulty of playing a piece of music, or the complexity of the music itself. This invention uses the number of notes and / or the number of musical notation marks as visual parameters of the staff to determine the expected number of merging operations. This determines the threshold for merging operations within a single musical phrase, or the lower limit of the number of abbreviated information tags that should be retained, ensuring that the merging operation conforms to the complexity of the music and the difficulty of playing it.

[0192] In some embodiments, the expected merging quantity refers to the target number of abbreviated information tags that need to be merged within a unit of musical phrase, calculated based on the visual parameters of the musical score. Its core purpose is to provide a constraint on the merging quantity for subsequent merging operations, ensuring that the merging quantity matches the complexity of the musical score. For example, in some embodiments, generating a merging scheme based on the expected merging quantity and the sibling merging tags means that after the merging operation, the number of remaining abbreviated information tags belongs to the expected merging quantity (which can be a single value or a range of values). That is to say, for multiple tags belonging to the same sibling merging tag category, they can be flexibly selected to be merged into one or more tags, as long as the constraint of the expected merging quantity is met.

[0193] In some embodiments, a merger scheme may refer to a merger requirement calculated by comprehensively considering the expected number of mergers and the merge tags of peers, including multiple indicators necessary for the merger operation such as the merger order, the number of mergers, and the tags to be merged.

[0194] In some embodiments, it also includes:

[0195] Generating the continuous selection area based on the first display height and the first display length includes the following steps:

[0196] Before the second time point, identify the third trajectory at the third time point;

[0197] Calculate the height difference between the third trajectory and the first trajectory;

[0198] When the height difference is greater than a preset height threshold, a second display height at the third moment is generated based on the third trajectory.

[0199] The continuous selection area is generated based on the first display height, the second display height, and the first display length.

[0200] In some embodiments, a third trajectory at a third time point can be identified before the second time point. By calculating the height difference between the third trajectory and the first trajectory, it can be determined whether the height of the continuously selected area chosen by the user has changed, i.e., whether the note display area chosen by the user spans multiple lines.

[0201] In some embodiments, when the height difference is greater than a preset height threshold, a second display height at a third moment is generated based on the third trajectory. Further, a continuous selection area can be generated based on the first display height, the second display height, and the first display length.

[0202] In other words, this invention proposes a mid-segment signal recognition mechanism that can further determine the range of the continuously selected area chosen by the user based on the operation signal triggered at the third time between the first and second time points, thereby improving the ability to understand the user's true intentions.

[0203] This invention also proposes a vectorized musical score display system, wherein the vectorized musical score includes vectorized notes, and each vectorized note corresponds to a note display area; the system includes:

[0204] An operation signal acquisition module is used to acquire operation signals, including a first trajectory and a second trajectory. A continuous selection area is determined based on the first trajectory at a first moment and the second trajectory at the second moment. This includes: identifying the first trajectory at the first moment; determining a first display height based on the first trajectory when the first trajectory is within the note display area; identifying the second trajectory at the second moment; determining a first display length based on the first trajectory and the second trajectory when the second trajectory is within the note display area; and generating the continuous selection area based on the first display height and the first display length.

[0205] The thumbnail generation module is used to generate thumbnails based on the tag addition signal triggered by the user in the continuously selected area; wherein, the thumbnail includes thumbnail information tags;

[0206] The expand label display module is used to display the expand information label corresponding to the thumbnail information label based on the label expand signal triggered by the user on the thumbnail information label.

[0207] It should be understood that the vectorized score display system proposed in this invention can be used to implement the steps described in any of the above embodiments.

[0208] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0209] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a computer terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0210] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A vectorized profile display method, characterized by, The vectorized score includes vectorized notes, each of which corresponds to a note display area; The method includes: S101, obtaining an operation signal; the operation signal includes a first track and a second track; Determine a continuous selection area according to the first track at the first time and the second track at the second time; it includes: Identify the first track at the first time; When the first track is in the note display area, then determine the first display height according to the first track; Identify the second track at the second time; When the second track is in the note display area, then determine the first display length according to the first track and the second track; Generate the continuous selection area according to the first display height and the first display length; S102, generate a thumbnail label according to the user's adding label signal triggered in the continuous selection area; wherein the thumbnail label includes a thumbnail information label; S103, display the expansion information label corresponding to the thumbnail information label according to the label expansion signal triggered by the user in the thumbnail information label.

2. A vectorized profile display method according to claim 1, characterized in that Also includes: S104, judge whether the thumbnail label visual parameter of the thumbnail label in the unit music section is greater than or equal to the thumbnail label visual parameter threshold; The thumbnail label visual parameter includes: the density of the thumbnail label, or the interval between two thumbnail labels; S105, if the execution result of S104 is yes, then perform a merging operation on the thumbnail information label; Wherein, the merging operation refers to combining at least two thumbnail information labels into one thumbnail information label, and combining the text content in the corresponding at least two expansion information labels into one expansion information label.

3. A vectorized profile display method according to claim 2, characterized in that S105 also includes: Calculate the correlation degree of at least two expansion information labels in the unit music section; the correlation degree is the semantic similarity of the text content in the expansion information label; Label at least two expansion information labels corresponding to the thumbnail information label as a same level merging label if the correlation degree is greater than or equal to the first correlation degree; Perform the merging operation on the same level merging label.

4. A vectorized profile display method according to claim 3, characterized in that, The merging operation also includes: Judge whether the same level merging labels are adjacent; wherein, adjacent means that the notes corresponding to the same level merging labels are adjacent in playing time; If adjacent, then merge the same level merging labels; If not adjacent, judge whether the distance between the same level merging labels is greater than the preset distance; If not, then merge the same level merging labels.

5. A vectorized profile display method according to claim 4, characterized in that, Also includes: If the distance between the same level merging labels is greater than the preset distance, identify an intermediate thumbnail information label, which is the thumbnail information label between at least two same level merging labels; Judge whether the correlation degree between the intermediate thumbnail information label and the same level merging label is greater than or equal to the second correlation degree; If yes, then merge the same level merging labels and the intermediate thumbnail information label.

6. A vectorized profile display method according to claim 2, characterized in that Before step S105 also includes: S106, judging whether the text capacity in the expanded information label corresponding to the thumbnail information label is greater than or equal to a preset text capacity; If the execution result of S106 is yes, S105 is not executed; If the execution result of S106 is no, S105 is executed.

7. The method of claim 1, wherein, Further comprising: The thumbnail label further comprises a graphic label; If the thumbnail information label and the graphic label exist simultaneously in one of the note display areas; The thumbnail information label and the graphic label are displayed at different display heights in the note display area.

8. The method of claim 3, wherein the vectorized curve display is a vectorized curve display of a time-frequency domain. Further comprising: An expected merging quantity is obtained, which is generated according to a line spectrum visual parameter in the unit music section; The line spectrum visual parameter comprises a note quantity and / or a score mark quantity in the unit music section; A merging scheme is generated according to the expected merging quantity and the same-level merging label; The merging operation is performed according to the merging scheme.

9. The method of claim 1, wherein, Further comprising: Generating the continuous selection area according to the first display height and the first display length comprises the steps of: Before the second time, a third trajectory at a third time is identified; A height difference value between the third trajectory and the first trajectory is calculated; When the height difference value is greater than a preset height threshold, a second display height at the third time is generated according to the third trajectory; The continuous selection area is generated according to the first display height, the second display height and the first display length.

10. A vectorized score display system, the vectorized score comprising vectorized notes, each of the vectorized notes corresponding to a note display area; characterized in that, The system comprises: An operation signal acquisition module is configured to acquire an operation signal; the operation signal comprises a first trajectory and a second trajectory; a continuous selection area is determined according to the first trajectory at a first time and the second trajectory at a second time; this comprises: identifying the first trajectory at the first time; when the first trajectory is in the note display area, a first display height is determined according to the first trajectory; the second trajectory at the second time is identified; when the second trajectory is in the note display area, a first display length is determined according to the first trajectory and the second trajectory; the continuous selection area is generated according to the first display height and the first display length; A thumbnail label generation module is configured to generate a thumbnail label according to an adding label signal triggered by a user in the continuous selection area; the thumbnail label comprises a thumbnail information label; An expanded label display module is configured to display an expanded information label corresponding to the thumbnail information label according to a label expansion signal triggered by a user in the thumbnail information label.

Images