Vectorized music score display method and system

Abstract

The invention relates to the technical field of music score display, in particular to a vectorized music score display method and system. The vectorized music score comprises vectorized musical notes, and each vectorized musical note corresponds to a musical note display area; the method comprises the steps of obtaining an operation signal; determining a continuous selected area according to the first track at the first moment and the second track at the second moment; the method comprises the following steps: identifying a first track at a first moment; determining a first display height according to the first track; identifying a second track at a second moment; determining a first display length according to the first track and the second track; generating a continuous selected area according to the first display height and the first display length; generating a thumbnail label according to the label adding signal; wherein the thumbnail label comprises a thumbnail information label; and displaying an unfolded information label corresponding to the thumbnail information label according to a label unfolding signal triggered by a user on the thumbnail information label. According to the method, the label display efficiency in the vectorized music score can be optimized, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of music score display, in particular to a vectorized music score display method and system. BACKGROUND

[0002] With the continuous development of technology and the increasing demand for piano practice, new requirements are constantly being raised on how to use new technology to improve the efficiency of piano learning. Currently, the existing technology also attempts to optimize the piano score.

[0003] For example, patent application CN113360721A discloses a music score real-time translation method and terminal, a music score data structure library is constructed, the music score data structure library includes elements unique to each type of music score and common elements of each type of music score; a basic music score graphic library is established, the basic music score graphic library includes music score graphics of each type; a mapping relationship between the music score data structure library and the basic music score graphic library is established; a music score editing request is received, the music score editing request includes a music score graphic to be edited; the type of the music score data structure to be edited is determined according to the music score data structure library, the basic music score graphic library, the music score graphic to be edited, and the mapping relationship; the corresponding music score graphics are translated and edited between different music scores according to the type of the music score data structure to be edited; the common elements of each type of music score are introduced, the data of each type of music score is shared, the editing and refreshing efficiency is greatly improved, and real-time translation between each type of music score is realized, making the translation of music score instant and reliable.

[0004] For another example, patent application CN116863892A discloses an intelligent music score editing method and device, a computing device and a storage medium, which identifies the imported file according to the file type and extracts music score information; wherein the music score information includes key information, chord information, time signature information and lyric information; the editable music score file can be quickly generated and exported according to the imported file.

[0005] However, the applicant notices that the above-mentioned scheme can analyze and edit the piano score, but it is difficult to meet the diversified scene needs of users. Therefore, there is an urgent need for a method that can adapt to complex scenarios of music score display. SUMMARY

[0006] The purpose of the present application is to provide a vectorized music score display method and system, which partially solves or alleviates the above-mentioned deficiencies in the prior art, can optimize the label display efficiency in the vectorized music score, and improve the user experience.

[0007] In order to solve the above-mentioned technical problems, the present application specifically adopts the following technical solutions: The first aspect of the present application provides a vectorized score display method, the vectorized score comprising vectorized notes, each of the vectorized notes corresponding to a note display area; the method comprising: S101, obtaining an operation signal; the operation signal comprising a first track and a second track; determining a continuous selection area according to the first track at a first time and the second track at a second time; which comprises: identifying the first track at the first time; when the first track is in the note display area, then determining a first display height according to the first track; identifying the second track at the second time; when the second track is in the note display area, then determining a first display length according to the first track and the second track; generating the continuous selection area according to the first display height and the first display length; S102, generating a thumbnail label according to an adding label signal triggered by a user in the continuous selection area; wherein the thumbnail label comprises a thumbnail information label; S103, displaying an expanded information label corresponding to the thumbnail information label according to a label expansion signal triggered by a user in the thumbnail information label. In some embodiments, further comprising: S104, judging whether the thumbnail label visual parameter of the thumbnail label in a unit music section is greater than or equal to a thumbnail label visual parameter threshold; the thumbnail label visual parameter comprising: the density of the thumbnail label, or the interval between two thumbnail labels; S105, if the execution result of S104 is yes, then performing a merging operation on the thumbnail information label; wherein the merging operation refers to combining at least two thumbnail information labels into one thumbnail information label, and combining the text content in the corresponding at least two expanded information labels into one expanded information label.

[0008] In some embodiments, S105 further comprises: calculating the correlation degree of at least two expanded information labels in the unit music section; the correlation degree being the semantic similarity of the text content in the expanded information label; labeling at least two expanded information labels corresponding to the thumbnail information label as a same-level merging label if the correlation degree is greater than or equal to a first correlation degree; performing the merging operation on the same-level merging label.

[0009] In some embodiments, the merging operation further comprises: determining whether the sibling merging tags are adjacent; wherein adjacent means that the notes corresponding to the sibling merging tags are adjacent in playing time; if adjacent, merging the sibling merging tags; if not adjacent, determining whether the distance between the sibling merging tags is greater than a preset distance; if not, merging the sibling merging tags.

[0010] In some embodiments, further comprising: if the distance between the sibling merging tags is greater than a preset distance, identifying an intermediate abbreviated information tag, the intermediate abbreviated information tag being the abbreviated information tag between the at least two sibling merging tags; determining whether the degree of association between the intermediate abbreviated information tag and the sibling merging tags is greater than or equal to a second degree of association; if yes, merging the sibling merging tags and the intermediate abbreviated information tag.

[0011] In some embodiments, further comprising, before step S105: S106, determining whether the text capacity in the expanded information tag corresponding to the abbreviated information tag is greater than or equal to a preset text capacity; if the execution result of S106 is yes, S105 is not executed; if the execution result of S106 is no, S105 is executed.

[0012] In some embodiments, further comprising: the abbreviated tag further comprises a graphical tag; if the abbreviated information tag and the graphical tag exist simultaneously in one note display area; the abbreviated information tag and the graphical tag are displayed at different display heights in the note display area.

[0013] In some embodiments, further comprising: obtaining an expected merging number, the expected merging number being generated according to a line spectrum visual parameter within the unit music section; the line spectrum visual parameter comprising: the number of notes within the unit music section, and / or the number of score marks; generating a merging scheme according to the expected merging number and the sibling merging tags; performing the merging operation according to the merging scheme.

[0014] In some embodiments, further comprising: generating the continuous selection area according to the first display height and the first display length comprises the steps of: identify a third trajectory at a third time point before the second time point; calculate a height difference between the third trajectory and the first trajectory; when the height difference is greater than a preset height threshold, generate a second display height at the third time point according to the third trajectory; generate the continuous selection region according to the first display height, the second display height and the first display length.

[0015] In a second aspect, the application provides a vectorized score display system, the vectorized score comprising vectorized notes, each of the vectorized notes corresponding to a note display area; the system comprising: an operation signal acquisition module configured to acquire an operation signal, the operation signal comprising a first trajectory and a second trajectory, and determine a continuous selection region according to the first trajectory at a first time point and the second trajectory at a second time point, which comprises: identifying the first trajectory at the first time point; when the first trajectory is in the note display area, determining a first display height according to the first trajectory; identifying the second trajectory at the second time point; when the second trajectory is in the note display area, determining a first display length according to the first trajectory and the second trajectory; and generating the continuous selection region according to the first display height and the first display length; a thumbnail tag generation module configured to generate a thumbnail tag according to an add-tag signal triggered by a user in the continuous selection region, wherein the thumbnail tag comprises a thumbnail information tag; an expanded tag display module configured to display an expanded information tag corresponding to the thumbnail information tag according to a tag expansion signal triggered by a user in the thumbnail information tag.

[0016] Beneficial technical effects: The application supports cross-line and irregular selection by users through vectorization means and taking note display areas as selection units. The continuous selection region is generated according to the note display areas corresponding to the continuous operation signal, which is beneficial to local selection operation of users, obtaining and understanding of deep operation intention behind the operation signal, and support of individualized needs in various scenarios (such as playing and adding tags). Further, the application proposes a middle section signal identification mechanism, which can further determine the range of the continuous selection region selected by the user according to the operation signal triggered at the third time point between the first time point and the second time point, and improve the understanding ability of the real intention of the user. Meanwhile, the application not only supports irregular selection operation of users, but also sets a label visual optimization scheme of information thumbnail tags corresponding to the continuous selection region. Specifically, the label visual optimization scheme has the following technical effects: Firstly, the present application sets a hierarchical merging of the merging operation, that is, the merging operation is performed on the labels with greater correlation degree. This priority based on the correlation degree has at least the following three effects: 1) it can ensure the logical correlation and content focus of the new label after merging to some extent, and avoid semantic confusion caused by direct and harsh splicing; 2) the new label after merging has continuity, which reduces the information interpretation cost caused by large differences in content in the new label after merging; 3) the hierarchical strategy preferentially merges labels with high semantic similarity, which helps to release the display space of the score interface and reduce visual interference.

[0017] Secondly, the present application merges the intermediate abbreviated information label with a correlation degree greater than a second correlation degree under the premise of maintaining the label correlation (the same level merging label with a correlation degree greater than or equal to a first correlation degree). That is, the present application proposes a dynamic decision mechanism based on double correlation degree thresholds, which can more significantly reduce the visual parameters of the abbreviated label on the basis of ensuring that the merging operation is logical, and further improve the display efficiency of the vectorized score.

[0018] Thirdly, the merging operation is performed on the abbreviated information label based on the visual parameters of the abbreviated label, and the merging operation is limited based on the visual parameters of the line spectrum to match the characteristics of the score. That is, the present application proposes a dual mechanism in which the merging operation rule and the merging restriction rule cooperate with each other, which helps to improve the adaptability and pertinence of the merging operation for different types of scores. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. In all the drawings, similar elements or parts are generally identified by similar reference signs. In the drawings, each element or part is not necessarily drawn according to the actual proportion. Obviously, the drawings described below are some embodiments of the present application, and those skilled in the art can obtain other drawings according to these drawings without any creative labor.

[0020] Figure 1 A continuous selected area example diagram in an exemplary embodiment of the present application; Figure 2 An operation signal example diagram in an exemplary embodiment of the present application; Figure 3 A selected single note display area example diagram in an exemplary embodiment of the present application; Figure 4 A music theory popularization example diagram in an exemplary embodiment of the present application; Figure 5 An expanded information label example diagram in an exemplary embodiment of the present application; Figure 6 An example picture of a selected graphical mark in an example embodiment of the present application; Figure 7 An example picture of a display effect after adding a graphical mark in an example embodiment of the present application; Figure 8 An example picture of an operation of reducing a music score surface in an example embodiment of the present application; Figure 9 An example picture of an operation of enlarging a music score surface in an example embodiment of the present application; Figure 10 A flowchart of a vectorized music score display method in an example embodiment of the present application. DETAILED DESCRIPTION

[0021] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described below in connection with the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of the present application.

[0022] In this document, the suffixes such as "module", "part" or "unit" used for an element are merely intended for facilitating the description of the present application, and are not intended to have the specific meaning thereof. Therefore, "module", "part" or "unit" can be mixedly used.

[0023] In this document, the terms "upper", "lower", "inner", "outer", "front", "back", "one end", "the other end" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are merely intended to facilitate the description of the present application and simplify the description, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance.

[0024] In this document, unless otherwise explicitly specified and limited, the terms "mount", "provided with", "connected" and the like should be understood broadly, for example, "connected" can be fixedly connected, can be detachably connected, or integrally connected; can be mechanically connected, can be directly connected, or indirectly connected through an intermediate medium, can be the communication inside two elements. For those of ordinary skill in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0025] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0026] "plurality" means two or more, i.e., it includes both two, three, four, five, etc.

[0027] As used in this specification, the term "approximately" typically means + / - 5% of the stated value, more typically + / - 4% of the stated value, more typically + / - 3% of the stated value, more typically + / - 2% of the stated value, even more typically + / - 1% of the stated value, and even more typically + / - 0.5% of the stated value.

[0028] In this specification, certain embodiments can be disclosed in one specific format in a range. It should be understood that such "in a range" description is merely for the convenience and brevity, and should not be interpreted as a rigid limitation to the disclosed range. Therefore, the range description should be considered as having specifically disclosed all possible sub-ranges and individual numerical values within the range. For example, the description of the range 1-6 should be considered as having specifically disclosed the sub-ranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6, etc., as well as the individual numbers within the range, such as 1, 2, 3, 4, 5, and 6. The above rule applies regardless of the breadth of the range.

[0029] Glossary: Vectorized score refers to a kind of image processing technology, which automatically recognizes and converts music symbols (such as notes, rests, clefs, keys, time signatures, and ties) in scores into a digital form that can be understood, edited, and played by computers. The core is to parse the music symbols in the score into structured data, rather than just pixel information in the score image. Please refer to Figure 8 , Figure 9 This vectorization conversion enables users to select, play, and search the score locally, and also overcomes the problems of image format scores, such as blurring when zooming in, and inability to edit.

[0030] Vectorized note refers to the vectorization of notes in vectorized scores into selectable and editable note objects. Please refer to Figure 8 , Figure 9 It has the function of infinite zooming without distortion and supports arbitrary selection.

[0031] Embodiment One: Please refer to Figure 10 The present application proposes a vectorized score display method, which includes vectorized notes, and each vectorized note corresponds to a note display area. The method includes: S101, obtaining an operation signal and generating a continuous selection area according to the operation signal; For example, in some embodiments, the operation signal comprises a first trajectory and a second trajectory; determining a continuous selection region according to the first trajectory at a first time and the second trajectory at a second time; which comprises: identifying the first trajectory at the first time; when the first trajectory is in the note display region, then determining a first display height according to the first trajectory; identifying the second trajectory at the second time; when the second trajectory is in the note display region, then determining a first display length according to the first trajectory and the second trajectory; generating the continuous selection region according to the first display height and the first display length; S102, generating a thumbnail label according to a user's adding label signal triggered in the continuous selection region; wherein the thumbnail label comprises a thumbnail information label; S103, displaying an expanded information label corresponding to the thumbnail information label according to a user's label expansion signal triggered in the thumbnail information label. Preferably, the first time usually occurs before the second time.

[0032] In some embodiments, the note display region refers to the display range (the display range can usually be defined by position, width, height) calculated and assigned for each vectorized note in the vectorized score provided by the present application. According to the note display region, it can be ensured that the user selects the notes correctly, clearly and without overlap.

[0033] In some embodiments, when it is identified that the user clicks the mouse button, it is considered that the user triggers the corresponding operation signal; and / or, when it is identified that the user's trigger data on the screen is greater than a preset trigger threshold, it is considered that the user triggers the corresponding operation signal.

[0034] In some embodiments, the first trajectory and the second trajectory can be the operation signal change trajectories of the user at the corresponding time. Correspondingly, the first time can be the time when the user triggers the operation signal; the second time can be the time when the user stops triggering the operation signal. It should be understood that the first time and the second time are usually very short time lengths, for example, 0.1 seconds. Please refer to Figure 2 , Figure 2 L1 and L2 in FIG. 1 are respectively the first trajectory and the second trajectory of the user at the first time and the second time.

[0035] In some embodiments, when the first trajectory is in the note display region, or when the second trajectory is in the note display region, it is considered that the user needs to select the continuous selection region.

[0036] In some embodiments, please refer to Figure 3 , if the first track is triggered by the operation signal, or the time interval between the time when the user triggers and stops triggering the operation signal is very short, for example, less than or equal to 0.01 seconds, and the first track is in the note display area, it is considered that the user needs to select a single note display area.

[0037] It should be understood that the first track can be an operation point or a continuous operation track of the operation signal.

[0038] It should be understood that a continuous selection area can include multiple note display areas.

[0039] The present application provides a method for vectorizing and selecting a music score, which will be described below.

[0040] In the music score, a coordinate system used as a reference for the position of the operation signal can be set.

[0041] In some embodiments, the origin point O of the coordinate system can be at any position of the music score, and the position of the origin point O is only used to determine the relative position of the operation signal, which is not limited here. The coordinates of the origin point O of the coordinate system can be represented as (X0, Y0).

[0042] In some embodiments, the first display height can be determined according to the first track, including: identifying the height of the first track in the music score, wherein the height can refer to the vertical distance Y1-Y0 between the starting point A (X1, Y1) of the first track and the origin point O of the coordinate system; taking the height Y1-Y0 of the first track in the music score as the first display height.

[0043] In some embodiments, when the user operation signal lasts to the second time, the second track at the second time is recorded.

[0044] In some embodiments, when the user triggers the second track at the second time, and the second track is in a note display area, it is considered that the user selects the note display area.

[0045] In some embodiments, the first display length can be determined according to the first track and the second track, including: identifying the starting point A (X1, Y1) of the first track and the ending point B (X2, Y2) of the second track, and the horizontal distance X2-X1 between A and B is the first display length.

[0046] In some embodiments, please refer to Figure 1 , the continuous selection area can be generated according to the first display height and the first display length. In some embodiments, a visual emphasis element can be added to the generated continuous selection area. The visual emphasis element refers to various visualization elements used to highlight specific information, guide the viewer's attention, or enhance the visual experience, thereby enabling the user to obtain key information through intuitive visual cues.

[0047] For example, the visual emphasis element can be a static graphical marker or a dynamic visual effect, or a combination of the two. Specifically, it can be color change (e.g., highlighting, gradient color), flashing effect (e.g., periodic flashing, pulsing light effect, water ripple effect), arrow indication (e.g., direction guide, dynamic path), icon and symbol, text annotation (e.g., brief description, numerical label), shadow and outline (e.g., projection effect, halo design, bold outline), animation effect (e.g., explosion, floating bubble), line thickening or highlighting, etc., without limitation.

[0048] It should be understood that the continuous selection area selected by the vectorized score shape selection method provided by the present application emphasizes the duration of the operation signal within a certain time period (e.g., the user continuously pressing the mouse).

[0049] That is, according to the first trajectory and the second trajectory corresponding to the operation signal, the user-selected non-continuous note display area can be determined. The non-continuous note display area can refer to the note display area corresponding to notes that are not adjacent in the playing order.

[0050] Further, the present application supports cross-line shape selection by the user through vectorization means, taking the note display area as the selection unit. The continuous selection area is generated according to the note display area corresponding to the continuous operation signal, which is beneficial for the user to perform local selection operation, obtain and understand the deep operation intention behind the operation signal, and support individualized needs in various scenarios.

[0051] In some embodiments, the continuous selection area can be locally added with a label, copied, played, viewed, recommended for playing, etc., according to the operation signal triggered by the user after generating the continuous selection area. When the user clicks the AI teacher popular science interface for viewing popular science, please refer to Figure 4 .

[0052] In some embodiments, a thumbnail label can be generated according to the add label signal triggered by the user in the continuous selection area; wherein the thumbnail label includes a thumbnail information label.

[0053] In some embodiments, the thumbnail label added by the user can be superimposed and displayed on the corresponding note display area as a visualization marker.

[0054] In some embodiments, the thumbnail label can include a thumbnail information label, wherein the thumbnail information label supports the user to locally annotate a single note or a continuously selected region.

[0055] In some embodiments, the expanded information label corresponding to the thumbnail information label can be displayed according to a label expansion signal triggered by the user in the thumbnail information label (for example, when the user clicks the display area of the corresponding thumbnail information label, it can be considered that the user triggers the label expansion signal), please refer to Figure 5 The expanded information label can include various types of information added by the user, such as annotation information and picture information.

[0056] In some embodiments, the method further comprises: S104, determining whether the thumbnail label visual parameter of the thumbnail label in the unit music section is greater than or equal to the thumbnail label visual parameter threshold; the thumbnail label visual parameter includes the density of the thumbnail label or the interval between two thumbnail labels; S105, if the execution result of S104 is yes, performing a merging operation on the thumbnail information label; The merging operation refers to combining at least two thumbnail information labels into one thumbnail information label, and combining the text content in the corresponding at least two expanded information labels into one expanded information label.

[0057] In some embodiments, the thumbnail information label can also be referred to as an information label.

[0058] It should be noted that in order to facilitate the structural division of the score, the "unit music section" mentioned in the present application can refer to the smallest paragraph unit that can be repeatedly trained by dividing the score by the bar line (vertical line). Performing a merging operation on the thumbnail information label in units of unit music sections can better adapt to the user's score recognition habits.

[0059] Of course, in some embodiments, the length of the unit music section can also be flexibly adjusted according to the complexity of the music piece, which is not limited here.

[0060] Preferably, in some embodiments, the merging operation is performed on the thumbnail information labels located in the same unit music section.

[0061] It should be noted that in some embodiments, when the continuously selected region selected by the user covers more than one unit music section, at least one unit music section covered by the continuously selected region can be taken as a unit music section (which can be referred to as a merged unit music section, that is, two or more unit music sections are taken as a merged unit music section), and the merging operation is performed on the thumbnail information labels in the merged unit music section.

[0062] It should be understood that such a setting can adjust the range of unit music segments on the basis of supporting user special selection, effectively improving the adaptability of the merging operation.

[0063] In some embodiments, the thumbnail label visual parameter is a quantifiable visual indicator, and the value thereof can represent the density of the thumbnail label or the interval between two thumbnail labels.

[0064] The density of the thumbnail label can refer to the number of thumbnail labels in a unit music segment.

[0065] The interval between the thumbnail labels can refer to the average interval between each two of the plurality of thumbnail labels.

[0066] It should be understood that if the thumbnail label visual parameter in the unit music segment is greater than or equal to the thumbnail label visual parameter threshold value, the merging operation can be performed on the thumbnail information label to optimize the readability of the score display interface and avoid too many thumbnail information labels causing the display interface to be cluttered and affecting the user's playing experience.

[0067] In some embodiments, the merging operation can refer to combining at least two of the thumbnail information labels into one of the thumbnail information labels, and further combining the text content in the corresponding at least two of the expanded information labels into one of the expanded information labels.

[0068] The content arrangement order when combining the expanded information labels can be determined according to the playing order of the corresponding notes, for example, the content in the expanded information label corresponding to the note played first can be arranged first during the merging operation.

[0069] In some embodiments, the arrangement order of the content during the merging operation can also be determined according to the professional degree of the content in the expanded information label, which is not limited here.

[0070] In some embodiments, S105 further comprises: calculating the correlation degree of at least two of the expanded information labels in the unit music segment; the correlation degree being the semantic similarity of the text content in the expanded information labels; marking the thumbnail information labels corresponding to at least two of the expanded information labels with a correlation degree greater than or equal to a first correlation degree as sibling merging labels; performing the merging operation on the sibling merging labels.

[0071] In some embodiments, the correlation degree of at least two expansion information tags can be calculated in a unit piece when performing the merging operation. The correlation degree refers to the semantic similarity of the text content in the expansion information tag, for example, the correlation degree can be 90%. The semantic similarity of the text content can be obtained according to a preset semantic mapping table, or can be calculated according to a semantic large model, which is not limited here.

[0072] In some embodiments, the calculation method of semantic similarity can be to extract keywords (such as "faster" and "slower") in the text content of the thumbnail information tag, and calculate the semantic similarity between the keywords of different thumbnail information tags.

[0073] Alternatively, in some embodiments, the more the same keywords exist in two thumbnail information tags, the greater the semantic similarity.

[0074] In some embodiments, the thumbnail information tags corresponding to the at least two expansion information tags with a correlation degree greater than or equal to a first correlation degree can be marked as same-level merging tags; and the merging operation is performed on the same-level merging tags.

[0075] The first correlation degree can be set by the user according to his needs.

[0076] It should be understood that the present application sets a hierarchical merging operation for the merging operation, that is, the tags with greater correlation degree are preferentially merged. This priority based on the correlation degree has at least the following three effects: 1) it can ensure the logical correlation and content focus of the new tag after merging to some extent, and avoid the semantic confusion caused by direct and harsh splicing; 2) the new tag after merging has continuity, which can reduce the information interpretation cost caused by large differences in content in the new tag after merging; 3) preferentially merging tags with high semantic similarity through hierarchical strategy helps to release the display space of the music interface and reduce visual interference.

[0077] In some embodiments, the merging operation further comprises: determining whether the same-level merging tags are adjacent; wherein adjacent refers to the notes corresponding to the same-level merging tags being adjacent in playing time; if adjacent, merging the same-level merging tags; if not adjacent, determining whether the distance between the same-level merging tags is greater than a preset distance; if not, merging the same-level merging tags.

[0078] In some embodiments, the present application introduces distance as a limiting factor on the basis of the preferential merging mechanism. On the one hand, it can best fit the continuity of music itself, and on the other hand, it can also prevent the mis-merging operation caused by too far distance.

[0079] wherein, whether the sibling merge tags are adjacent is judged, and adjacent can mean that the notes corresponding to the sibling merge tags are adjacent in playing time.

[0080] In some embodiments, if the sibling merge tags are adjacent, the merging operation can be directly performed; if not, it is necessary to judge whether the distance between the two sibling merge tags is greater than a preset distance. If the distance is less than or equal to the preset distance, the two sibling merge tags can still be merged.

[0081] In some embodiments, the distance between the sibling merge tags can mean the display distance of the notes corresponding to the two tags on the score, or can mean the playing time interval of the notes corresponding to the two tags, which is not limited here.

[0082] In some embodiments, further comprising: if the distance between the sibling merge tags is greater than a preset distance, an intermediate abbreviated information tag is identified, the intermediate abbreviated information tag being the abbreviated information tag between the at least two sibling merge tags; judging whether the association degree between the intermediate abbreviated information tag and the sibling merge tags is greater than or equal to a second association degree; if yes, merging the sibling merge tags and the intermediate abbreviated information tag.

[0083] wherein, the second association degree is less than the first association degree.

[0084] In some embodiments, the intermediate abbreviated information tag can mean other abbreviated information tags between two sibling merge tags that are highly similar in semantics but not adjacent in position and have a distance greater than a preset distance, and the essence is an intermediate tag surrounded by highly associated sibling merge tags.

[0085] It should be understood that in some special cases (for example, two sibling merge tags that are highly similar in semantics but not adjacent in position and have a distance greater than a preset distance), the present application adaptively adjusts the merging strategy by introducing a second association degree, that is, merging the intermediate abbreviated information tag with an association degree greater than the second association degree with the sibling merge tags.

[0086] It should be noted that the present application merges the intermediate abbreviated information tag with an association degree greater than the second association degree on the premise of maintaining the association between the merged tags (the sibling merge tags with an association degree greater than or equal to the first association degree), that is, the present application proposes a dynamic decision mechanism based on double association degree thresholds, which can more significantly reduce the visual parameters of abbreviated tags on the basis of ensuring that the merging operation conforms to logic, and further improves the display efficiency of vectorized score.

[0087] In some embodiments, before step S105, the method further includes: S106, determining whether the text capacity of the expanded information tag corresponding to the abbreviated information tag is greater than or equal to a preset text capacity; If the result of S106 is yes, S105 is not executed; If the result of executing S106 is no, then execute S105.

[0088] In some embodiments, if the text capacity of the expanded information tag corresponding to the abbreviated information tag is greater than or equal to the preset text capacity, it indicates that the information content in the tag is too much and is not suitable for merging, and the merge operation is not performed. If the text capacity of the expanded information tag corresponding to the abbreviated information tag is less than the preset text capacity, it indicates that the information content in the tag is not much and is suitable for merging, and the merge operation can be performed.

[0089] In some embodiments, further comprising: The abbreviated label also includes a graphic label; If the abbreviated information label and the graphic label exist in one of the note display areas at the same time; The abbreviated information label and the graphic label are displayed at different display heights in the musical note display area.

[0090] In some embodiments, see Figure 6 、 Figure 7 , abbreviated tags can also include graphic tags.

[0091] In some embodiments, if a user adds a thumbnail information label and a graphic label to a note display area at the same time, the thumbnail information label and the graphic label will be displayed at different display heights in the note display area. By displaying different types of thumbnail labels in layers and using height differences to facilitate the clear and parallel expression of complex information, the visual conflict caused by overlapping displays can be effectively avoided, preventing users from misreading or missing key information.

[0092] Furthermore, different response strategies can be set for different types of thumbnail tags; for example, if a user clicks on a thumbnail information tag, a tag expansion signal is triggered, and if a user clicks on a graphic tag, the graphic tag can be controlled to scale or rotate.

[0093] For example, in some embodiments, the graphic label can be a sticker that can be used to display keywords (such as fast, slow), or the sticker can be used to display some preset graphics that can be selected by the user to represent different prompt meanings (such as fast, slow, high difficulty, etc.).

[0094] Alternatively, in some embodiments, the graphic label may also be a pre-stored emoticon package picture.

[0095] It should be understood that graphic labels are highly concise and can add interest to the long and boring piano practice process through concise, intuitive and easy-to-understand text (such as attention, slow, fast, etc.) or graphics (such as notes, expressions, etc.). At the same time, they can also help you intuitively understand the rich meanings behind the graphic labels you added.

[0096] In some embodiments, the graphic label may be referred to as a simple label.

[0097] For example, with the help of a “slow” graphic label (or simply a label), the user can remind himself to slow down the playing speed to avoid rushing the beat.

[0098] In some embodiments, further comprising: Obtaining an expected number of merges, where the expected number of merges is generated based on visual parameters of the musical notation within the unit music segment; the visual parameters of the musical notation include: the number of notes within the unit music segment, and / or the number of musical notation marks; generating a merging solution according to the expected number of merges and the same-level merge tags; The merging operation is performed according to the merging scheme.

[0099] It's important to note that the visual parameters for the score objectively describe the musical complexity of a musical passage (e.g., number of notes, number of notations, etc.). They reflect the information intensity of the score itself, or the difficulty of playing it. They are used to predict the expected number of merges in a merge operation, effectively preventing excessive merging of complex passages by limiting the number of merges. The visual parameters for thumbnail labels quantify the label density, or the label spacing, of the score interface after the user adds thumbnails. This effectively prevents invalid merges during merge operations.

[0100] It should be understood that the merge operation for the thumbnail information tags is performed based on the visual parameters of the thumbnail labels, while the merge operation is restricted to suit the characteristics of the score based on the visual parameters of the line staff. In other words, the present invention proposes a dual mechanism of merging operation rules and merging restriction rules that work together to avoid a top-heavy display interface of the merged labels and score (i.e., a complex score with few remaining labels after merging). In other words, it ensures that the merged content / quantity is highly compatible with the content and difficulty of the score itself, further helping to improve the adaptability and pertinence of the merge operation for different types of scores.

[0101] In some embodiments, the music score markings may include rests, clefs, key signatures, time signatures, slurs, and other music score symbols.

[0102] It should be understood that the number of notes and / or the number of score marks can reflect the difficulty of playing the score or the complexity of the score itself to some extent. The number of notes and / or the number of score marks are used as a line score visual parameter to determine the expected merging number, so as to determine the threshold of the unit music section merging operation or the lower limit of the number of abbreviated information tags to be retained, and ensure that the merging operation matches the score complexity and playing difficulty.

[0103] In some embodiments, the expected merging number refers to the target number of abbreviated information tags that need to be merged in the unit music section, which is calculated based on the line score visual parameter. The core is to provide a constraint on the merging number for subsequent merging operations, so as to ensure that the merging number matches the score complexity. For example, in some embodiments, the merging scheme is generated according to the expected merging number and the same-level merging tags, which means that after the merging operation, the number of remaining abbreviated information tags belongs to the expected merging number (which can be a numerical value or a numerical interval). That is, for multiple tags belonging to the same-level merging tags, they can be flexibly selected to be merged into one or more tags, as long as the constraint of the expected merging number is met.

[0104] In some embodiments, the merging scheme can refer to the merging requirements calculated by comprehensively considering the expected merging number and the same-level merging tags, which include multiple indexes necessary for the merging operation, such as merging order, merging number, and tags to be merged.

[0105] In some embodiments, the method further comprises: Generating the continuous selection area according to the first display height and the first display length comprises the steps of: Before the second time, a third trajectory at a third time is identified; A height difference between the third trajectory and the first trajectory is calculated; When the height difference is greater than a preset height threshold, a second display height at the third time is generated according to the third trajectory; The continuous selection area is generated according to the first display height, the second display height, and the first display length.

[0106] In some embodiments, a third trajectory at a third time can be identified before the second time. By calculating the height difference between the third trajectory and the first trajectory, it is determined whether the height of the continuous selection area selected by the user changes, that is, whether the note display area selected by the user crosses the line.

[0107] In some embodiments, when the height difference is greater than a preset height threshold, a second display height at the third time is generated according to the third trajectory, and further, the continuous selection area can be generated according to the first display height, the second display height, and the first display length.

[0108] That is to say, the application proposes a middle section signal recognition mechanism, which can further determine the range of the continuous selection region selected by the user according to the operation signal triggered at the third time between the first time and the second time, and improve the understanding ability of the real intention of the user.

[0109] The application also proposes a vectorized score display system, which includes vectorized notes, each of which corresponds to a note display area. The operation signal acquisition module is used to acquire an operation signal, and the operation signal includes a first track and a second track. The continuous selection region is determined according to the first track at the first time and the second track at the second time, which includes: identifying the first track at the first time; when the first track is in the note display area, the first display height is determined according to the first track; identifying the second track at the second time; when the second track is in the note display area, the first display length is determined according to the first track and the second track; and the continuous selection region is generated according to the first display height and the first display length. The thumbnail label generation module is used to generate a thumbnail label according to an add label signal triggered by the user in the continuous selection region. The thumbnail label includes a thumbnail information label. The expanded label display module is used to display an expanded information label corresponding to the thumbnail information label according to a label expansion signal triggered by the user in the thumbnail information label.

[0110] It should be understood that the vectorized score display system proposed by the application can be used to implement the steps described in any of the above embodiments.

[0111] It should be noted that in this document, the term "comprises", "comprising", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or other elements inherent to such a process, method, article or device. Without more limitations, the element defined by the statement "comprises a" does not exclude the presence of additional identical elements in the process, method, article or device that includes the element.

[0112] Those skilled in the art can clearly understand the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, also can be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application essentially or say the part of contribution to the prior art can be embodied in the form of software product, the computer software product is stored in a storage medium (such as ROM / RAM, disk, optical disk), including a plurality of instructions to make a computer terminal (may be a mobile phone, computer, server, or network equipment, etc.) executes the method described in various embodiments of the present application.

[0113] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, the above-mentioned specific embodiments are only illustrative, but not limited, those skilled in the art can make many forms under the inspiration of the present application without departing from the purpose of the present application and the scope protected by the claims, which all belong to the protection of the present application.

Claims

1. A method for displaying vectorized music scores, characterized in that: The vectorized music score includes vectorized notes, and each vectorized note corresponds to a note display area; Methods include: S101, obtaining an operation signal; the operation signal includes a first track and a second track; Determining continuously selected areas according to the first track at a first moment and the second track at a second moment includes: identifying the first trajectory at the first moment; When the first track is in the note display area, determining a first display height according to the first track; identifying the second trajectory at the second moment; When the second track is in the note display area, determining a first display length according to the first track and the second track; generating the continuous selected area according to the first display height and the first display length; S102, generating a thumbnail tag according to a tag-adding signal triggered by the user in the continuously selected area; wherein the thumbnail tag includes a thumbnail information tag; S103: Displaying an expanded information tag corresponding to the thumbnail information tag according to a tag expansion signal triggered by the user at the thumbnail information tag.

2. A vectorized music score display method according to claim 1, characterized in that: Also includes: S104, determining whether a thumbnail label visual parameter of the thumbnail label in the unit music segment is greater than or equal to a thumbnail label visual parameter threshold; The visual parameters of the thumbnail labels include: the density of the thumbnail labels, or the interval between two thumbnail labels; S105, if the result of S104 is yes, performing a merging operation on the abbreviated information tag; The merging operation refers to combining at least two of the abbreviated information tags into one abbreviated information tag, and combining the text contents of the corresponding at least two expanded information tags into one expanded information tag.

3. A method for displaying vectorized music scores according to claim 2, characterized in that: The S105 also includes: Calculating the degree of association between at least two of the expansion information tags in the unit music section; the degree of association is the semantic similarity of the text contents in the expansion information tags; marking the abbreviated information tags corresponding to at least two expanded information tags whose correlation degree is greater than or equal to the first correlation degree as same-level merged tags; The merge operation is performed on the same-level merge tags.

4. A method for displaying vectorized music scores according to claim 3, characterized in that: The merging operation further includes: Determine whether the merged tags of the same level are adjacent; wherein adjacent means that the notes corresponding to the merged tags of the same level are adjacent in playing time; If they are adjacent, merge the same-level merge tags; If they are not adjacent, determine whether the distance between the merged tags at the same level is greater than a preset distance; If not, merge the sibling merge tags.

5. A method for displaying vectorized music scores according to claim 4, characterized in that: Also includes: If the distance between the merge tags at the same level is greater than a preset distance, identifying an intermediate abbreviated information tag, where the intermediate abbreviated information tag is the abbreviated information tag between at least two merge tags at the same level; Determining whether the correlation degree between the intermediate abbreviated information tag and the same-level merge tag is greater than or equal to a second correlation degree; If so, merge the same-level merge tag and the intermediate abbreviated information tag.

6. A method for displaying vectorized music scores according to claim 2, characterized in that: Before step S105, the method further includes: S106, determining whether the text capacity of the expanded information tag corresponding to the abbreviated information tag is greater than or equal to a preset text capacity; If the result of S106 is yes, S105 is not executed; If the result of executing S106 is no, then execute S105.

7. The method for displaying a vectorized music score according to claim 1, wherein: Also includes: The abbreviated label also includes a graphic label; If the abbreviated information label and the graphic label exist in one of the note display areas at the same time; The abbreviated information label and the graphic label are displayed at different display heights in the musical note display area.

8. The method for displaying vectorized music scores according to claim 3, wherein: Also includes: Obtaining an expected number of merges, where the expected number of merges is generated according to visual parameters of the line scores within the unit music segment; The line score visual parameters include: the number of notes in the unit music section, and / or the number of music score markings; generating a merging solution according to the expected number of merges and the same-level merge tags; The merging operation is performed according to the merging scheme.

9. The method for displaying vectorized music scores according to claim 1, wherein: Also includes: Generating the continuous selected area according to the first display height and the first display length comprises the steps of: Before the second moment, identifying a third trajectory at a third moment; Calculating a height difference between the third trajectory and the first trajectory; When the height difference is greater than a preset height threshold, generating a second display height at the third moment according to the third trajectory; The continuous selected area is generated according to the first display height, the second display height and the first display length.

10. A vectorized music score display system, wherein the vectorized music score includes vectorized notes, and each vectorized note corresponds to a note display area; The system includes: An operation signal acquisition module is configured to acquire an operation signal; the operation signal includes a first trajectory and a second trajectory; determine a continuous selected area based on the first trajectory at a first moment and the second trajectory at a second moment; the module comprises: identifying the first trajectory at the first moment; when the first trajectory is within the note display area, determining a first display height based on the first trajectory; identifying the second trajectory at the second moment; when the second trajectory is within the note display area, determining a first display length based on the first trajectory and the second trajectory; and generating the continuous selected area based on the first display height and the first display length. a thumbnail tag generating module, configured to generate a thumbnail tag according to a tag adding signal triggered by a user in the continuously selected area; wherein the thumbnail tag includes a thumbnail information tag; The expanded tag display module is used to display the expanded information tag corresponding to the abbreviated information tag according to the tag expansion signal triggered by the user on the abbreviated information tag.

Images