Vivid display method and storage medium for music scores
By displaying the pitch-related Colvin gesture icons in the music score and melody line animation combining the theme, the problem of the Colvin gesture relationship not reflected and the melody line expression in the prior art is solved, and a more vivid music score display effect is achieved.
Patent Information
- Application Number
- CN202210758443.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-29
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2042-06-29
AI Technical Summary
In the existing electronic teaching of music scores, the relationship between Colvin's gestures and body position is not effectively reflected, the melody line is expressed in a single effect, and there is a lack of a combination of animation and themes.
By displaying the Colvin gesture icon in the score, its vertical coordinates are positively correlated with the pitch, the horizontal coordinates are consistent with the position of the notes, and the texture of the melody line is displayed in combination with the song theme and content, in line with the animation effect.
The relationship between Colvin's gestures and body position is realized in the music score, and the melody line is expressed more vividly and vividly through the combination of animation and theme.
Smart Images

Figure CN115132156B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of multimedia technology, and in particular to a method for vividly displaying music scores and a storage medium. Background Art
[0002] Colvin gestures and melody lines are important tools for music score reading. The melody line refers to a curve that fluctuates with the direction of the pitch in the score, thus intuitively reflecting the changes in the melody of the score. Colvin gestures, also known as Kelvin gestures, use seven different gestures and different high and low positions in front of the body to represent seven different solfeggios, thereby reflecting the high and low relationship of the sung notes in space.
[0003] These two functions also need to be integrated into the existing electronic music score teaching.
[0004] The existing scheme, for Colvin gestures, generally displays the gestures of the corresponding notes above or below the notes in the music score with a uniform vertical height (y coordinate); this method loses the important relationship between Colvin gestures and body positions: if in the same octave, the gesture of Re should be higher than the gesture of Do, and it is best to draw the vertical position of Re higher than Do;
[0005] For melody lines, a curve is usually displayed below the notes, and the height of the curve reflects the pitch of the notes; there are also independent displays of melody lines in a specific area of the screen. These display methods rarely have animations, or the animation methods are stereotyped; nor are they combined with the theme and content of the song. The "lively, lively, and vivid" characteristics of the melody line are lost. Summary of the invention
[0006] In view of the above problems, the present application provides a method for vividly displaying music scores, which is used to solve the technical problems that the above existing music scores cannot reflect the relationship between Colvin's gestures and body positions, and the melody line expression effect is single.
[0007] To achieve the above object, the inventor provides a method for vividly displaying a music score, comprising the following steps:
[0008] Display the notes in the music score;
[0009] The Colvin gesture icon corresponding to each note is displayed, the longitudinal coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, and the transverse coordinate of the Colvin gesture icon is consistent with the transverse coordinate of the corresponding note.
[0010] In some technical solutions, the method for vividly displaying music scores further includes the steps of:
[0011] The melody line corresponding to the notes is displayed, and the melody line reflects the pitch change of each of the notes.
[0012] In some technical solutions, the “displaying a melody line corresponding to the note, wherein the melody line displays the pitch change of each note” comprises the following steps:
[0013] Calculating the pitch value of each note, and linearly converting the pitch value into the longitudinal coordinate of the melody point;
[0014] Taking the horizontal center point of the note as the horizontal coordinate of the melody point;
[0015] Obtaining the melody points corresponding to the notes in turn, and connecting the melody points with a smooth curve to draw a melody line;
[0016] The melody line is displayed.
[0017] In some technical solutions, the “displaying the Colvin gesture icon corresponding to each of the notes, wherein the longitudinal coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note” comprises the following steps:
[0018] Read the solfeggios of each note, and select the Colvin gesture icon corresponding to the solfeggios;
[0019] Calculating the pitch value of each note, linearly converting the pitch value to obtain a converted coordinate value, and offsetting the converted coordinate value as the longitudinal coordinate center point of the Colvin gesture icon;
[0020] The horizontal center point of the musical note is used as the horizontal coordinate center point of the Colvin gesture icon; and the Colvin gesture icon corresponding to each musical note is displayed according to the coordinate position.
[0021] In some technical solutions, the “displaying a melody line corresponding to the note, wherein the melody line displays the pitch change of each note” further includes the following steps:
[0022] Presetting the texture of the melody line according to the theme and / or content of the music score;
[0023] When displaying the melody line corresponding to the note, applying the texture should render the melody line.
[0024] In some technical solutions, the Colvin gesture icon and the melody line are gradually displayed according to the playing progress of the music score. Specifically, according to the playing progress of the music score, the currently playing notes are highlighted along the playing direction of the music score, and the Colvin gesture icon and the melody line corresponding to the played notes are displayed.
[0025] In some technical solutions, the method for vividly displaying music scores further includes the steps of:
[0026] A theme icon of the music score is drawn at the end of the currently displayed melody line or the Colvin gesture icon, and the theme icon moves with the playing progress of the music score. The theme icon is preset according to the theme and / or content of the music score.
[0027] In some technical solutions, the method for vividly displaying music scores further includes the steps of:
[0028] An animation effect for the Colvin gesture icon and / or the melody line is set, wherein the animation effect for the Colvin gesture icon is used to dynamically highlight the Colvin gesture icon corresponding to the currently playing note; and the animation effect for the melody line is used to display the played notes and the portion of the melody line corresponding to the currently playing note.
[0029] In some technical solutions, the method for vividly displaying music scores further includes the steps of:
[0030] A mask bar is preset, and the mask bar is used to mask the unplayed part of the Colvin gesture icon and / or the melody line. The mask bar moves with the playing progress, so that the Colvin gesture icon and / or the melody line are gradually displayed according to the playing progress of the music score.
[0031] In order to solve the above technical problems, the present invention also provides another technical solution:
[0032] A computer storage medium stores a computer program, which, when executed by a processor, implements the method for vividly displaying a music score as described in any one of the above technical solutions.
[0033] Different from the prior art, in the vivid display method of the music score of the above technical solution, the horizontal coordinates of the Colvin gesture icon are consistent with the corresponding notes, and the vertical coordinates of the Colvin gesture icon of each note in the music score are positively correlated with the pitch of the corresponding note. Therefore, the heights of the Colvin gestures corresponding to different notes in the music score are also different. The height of the Colvin gesture can not only show the pitch of different Colvin gestures, but also show the relationship between the Colvin gesture and the position of the demonstrator's body during the actual demonstration. In addition, in the above technical solution, the textures of different melody lines are displayed in combination with the theme and content of the song, and the animation display is combined to more vividly express the melody of the song.
[0034] The above-mentioned records related to the invention content are only an overview of the technical solution of the present application. In order to enable ordinary technicians in the field to more clearly understand the technical solution of the present application, and then implement it according to the text of the specification and the contents recorded in the drawings, and to make the above-mentioned purpose and other purposes, features and advantages of the present application easier to understand, the following is an explanation in combination with the specific implementation mode and drawings of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] The drawings are only used to illustrate the principles, implementation methods, applications, characteristics and effects of the specific embodiments of the present application and other related contents, and shall not be considered as limitations of the present application.
[0036] In the drawings of the specification:
[0037] Figure 1 It is a flowchart of the method for vividly displaying music scores described in the specific implementation method;
[0038] Figure 2 is a flowchart of the steps for displaying the melody line according to the specific implementation method;
[0039] Figure 3 A flowchart of the steps for displaying the Colvin gesture image described in the specific implementation method;
[0040] Figure 4 A flowchart of the specific steps of the vivid display method of the music score described in the specific implementation method;
[0041] Figure 5 A schematic diagram of the display positions of the Colvin gesture icon and the melody line described in the specific implementation manner;
[0042] Figure 6 A schematic diagram showing the area of Colvin's gesture and melody line using masking techniques for a specific implementation;
[0043] Figure 7 A schematic diagram showing the theme icon for a specific implementation;
[0044] Figure 8 It is a schematic diagram showing an animation of the Colvin gesture described in the specific implementation method;
[0045] Fig. 9 This is a schematic diagram of the melody line texture animation effect described in the specific implementation method;
[0046] Fig.10 A schematic diagram of a computer storage medium according to a specific embodiment; DETAILED DESCRIPTION
[0047] In order to explain in detail the possible application scenarios, technical principles, specific schemes that can be implemented, and the purposes and effects that can be achieved, the following is a detailed description of the specific embodiments listed in conjunction with the accompanying drawings. The embodiments described herein are only used to more clearly illustrate the technical solutions of the present application, and are therefore only used as examples, and cannot be used to limit the scope of protection of the present application.
[0048] Reference to "embodiment" herein means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The term "embodiment" appearing in various places in the specification does not necessarily refer to the same embodiment, nor does it particularly limit its independence or association with other embodiments. In principle, in the present application, as long as there is no technical contradiction or conflict, the various technical features mentioned in the embodiments can be combined in any way to form a corresponding implementable technical solution.
[0049] Unless otherwise defined, the technical terms used in this document have the same meanings as those generally understood by those skilled in the art to which this application belongs; the use of relevant terms in this document is only for describing specific embodiments and is not intended to limit this application.
[0050] In the description of this application, the term "and / or" is an expression used to describe the logical relationship between objects, indicating that three relationships may exist, for example, A and / or B, which means: A exists, B exists, and A and B exist at the same time. In addition, the character " / " in this article generally indicates that the objects before and after are in an "or" logical relationship.
[0051] In the present application, terms such as “first” and “second” are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship of quantity, priority or sequence between these entities or operations.
[0052] Without further limitations, in this application, the words "include", "comprises", "has" or other similar expressions used in the sentences are intended to cover non-exclusive inclusion. These expressions do not exclude the presence of additional elements in the process, method or product including the elements, so that the process, method or product including a series of elements may include not only those limited elements, but also other elements not explicitly listed, or also include elements inherent to such process, method or product.
[0053] Similar to the understanding in the Examination Guidelines, in this application, expressions such as "greater than", "less than", "exceed" and the like are understood to exclude the number itself; expressions such as "above", "below", "within" and the like are understood to include the number itself. In addition, in the description of the embodiments of this application, "multiple" means more than two (including two), and similar expressions related to "multiple" are also understood in this way, such as "multiple groups", "multiple times", etc., unless otherwise clearly and specifically limited.
[0054] See also Figures 1 to 9This embodiment provides a method for vividly displaying a music score. In the method for vividly displaying a music score, the Colvin gesture icons can be displayed at different vertical positions in the music score according to the pitches of the corresponding notes, thereby displaying the positional relationship between different Colvin gesture icons and the body, making it easier for users to recognize the music score.
[0055] like Figure 1 As shown, the vivid display method of the music score comprises the following steps:
[0056] S101, displaying the notes in the music score;
[0057] S201, displaying the Colvin gesture icon corresponding to each note, wherein the longitudinal coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, and the transverse coordinate of the Colvin gesture icon is consistent with the transverse coordinate of the corresponding note.
[0058] In step S101, the notes in the score are displayed in rows. The score contains multiple rows of notes, and the notes can be arranged from left to right and from top to bottom. The notes in the score can be simplified notation notes, for example, 1-Do, 2-Ri. The notes in the present invention are not limited to simplified notation notes. In some embodiments, the notes in the score can also be five-line notation notes or other commonly used international notes.
[0059] In step S102, the horizontal coordinate of the Colvin gesture icon corresponds to the horizontal position of the Colvin gesture icon on the music score page, and the vertical coordinate of the Colvin gesture icon corresponds to the vertical position of the Colvin gesture icon on the music score page. The vertical coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note. Since the notes in the music score are displayed in rows, the higher the pitch of the notes in the same row, the higher the display position of the Colvin gesture icon corresponding to the notes is (i.e., the larger the vertical coordinate). For notes in different rows, since the positions of the rows are different, the display position height of the Colvin gesture icon corresponding to the notes has no comparative significance.
[0060] In this embodiment, when displaying the Colvin gesture icons corresponding to each of the notes, all the notes on the current display page of the score can be displayed first, and then the Colvin gesture icons corresponding to the currently playing notes can be synchronously displayed according to the progress of the score playing, while the Colvin gesture icons corresponding to the notes that have been played will remain displayed until the next line of notes or the next display page of the score is played.
[0061] In this embodiment, the horizontal coordinate of the Colvin gesture icon is consistent with the horizontal coordinate of the corresponding note, and the vertical coordinate of the Colvin gesture icon of each note in the score is positively correlated with the pitch of the corresponding note. Therefore, the height of the Colvin gesture corresponding to different notes in the score is also different. The height of the Colvin gesture can not only show the pitch of different Colvin gestures, but also show the relationship between the Colvin gesture and the position of the demonstrator's body during the actual demonstration. Because the Colvin gesture is demonstrated by a demonstrator such as a teacher or conductor, different notes are expressed not only by different hand shapes during the demonstration, but also by the position relationship between the demonstrator's palm and body. For example, the Colvin gesture of the higher pitch Xi (corresponding to the simplified musical notation note 7) is at the same height as the arm, while the Colvin gesture of the lower pitch Do (corresponding to the simplified musical notation note 1) is at the same height as the navel. In the existing score, each Colvin gesture is displayed at a uniform vertical height (y coordinate), so the information expressed by the Colvin gesture and the demonstrator's body position is lost. In this embodiment, the vertical coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, so that the high and low positions of the Colvin gesture display can show the relationship between the Colvin gesture and the position of the presenter's body during the actual demonstration.
[0062] In some embodiments, the method for vividly displaying the music score further includes the step of: displaying the melody line corresponding to the notes, wherein the melody line reflects the pitch change of each of the notes. The melody line refers to a straight line or a curve formed by the direction of the pitch of each note in the music score. The display method of the melody line can be the same as the display method of the Colvin gesture icon, that is, according to the progress of the music score playing, the melody line corresponding to the currently playing note is synchronously displayed, and the melody line corresponding to the already played note is retained until the next line of notes or the next display page of the music score is played. In this embodiment, the Colvin gesture icon and the melody line are displayed simultaneously in the music score, so as to better express the pitch and melody of the song.
[0063] In the above-mentioned implementation mode, the textures of different melody lines are displayed in combination with the theme and content of the song, and animation display is combined to express the melody of the song more vividly.
[0064] like Figure 2 As shown, in some implementations, the “displaying the melody line corresponding to the note, wherein the melody line displays the pitch change of each note” includes the following steps:
[0065] S201, calculating the pitch value of each note, and linearly converting the pitch value into the longitudinal coordinate of a melody point;
[0066] S202, taking the horizontal center point of the note as the horizontal coordinate of the melody point;
[0067] S203, sequentially obtaining the melody points corresponding to the notes, and connecting the melody points with a smooth curve to draw a melody line;
[0068] S204: Display the melody line.
[0069] Among them, in step S201, the pitch value of the note can be represented by a MIDI value, and the pitch range of the current row of notes can be known through the MIDI value. In step S203, the horizontal coordinate of the center point of each note is used as the horizontal coordinate of the melody point, and the vertical coordinate obtained by linearly converting the pitch value is used as the vertical coordinate of the melody point, and the melody point corresponding to the note is drawn, and the melody line is drawn by connecting the melody points with a smooth curve. Through this implementation, the melody point of each note can be efficiently drawn.
[0070] like Figure 5 As shown, when drawing the melody line, it can be estimated that the maximum height of the Colvin gesture icon in each row of notes is h1, and the maximum height of the melody line is h2. Then the Colvin gesture icon and the melody line will occupy at most the vertical space of h1+h2; when the height of the note row + lyrics row after rendering is h0, the melody line drawing range is [h0+h1+h2, h0+h1]. (For ease of understanding, the following description can take h0=300,h1=30,h2=150);
[0071] Map the pitch range of the note linearly to the vertical coordinate, which is the vertical coordinate (i.e., y coordinate) of the curve path point (i.e., melody point). For example, if the pitch range [60,72] is linearly mapped to [h0+h1, h0+h1+h2], then when the pitch is 60, it corresponds to y=h0+h1=330, when the pitch is 72, it corresponds to y=h0+h1+h2=480, when the pitch is 66, it corresponds to y=(480-330) / (72-60)×6+330=405…
[0072] like Figure 3 As shown, in some embodiments, the “displaying the Colvin gesture icon corresponding to each of the notes, wherein the vertical coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note” includes the following steps:
[0073] S301, reading the solfeggios of each note, and selecting the Colvin gesture icon corresponding to the solfeggios;
[0074] S302, calculating the pitch value of each note, linearly converting the pitch value to obtain a converted coordinate value, and offsetting the converted coordinate value as the longitudinal coordinate center point of the Colvin gesture icon;
[0075] S303, using the horizontal center point of the note as the horizontal coordinate center point of the Colvin gesture icon;
[0076] S304, displaying the Colvin gesture icon corresponding to each of the notes according to the coordinate position.
[0077] The Colvin hand gesture icons corresponding to each solfeggio are pre-stored in the system, so in step S301, the corresponding Colvin hand gesture icons can be obtained according to the solfeggio.
[0078] In step S302, the horizontal center point of the note, i.e., the horizontal coordinate (x), is used as the horizontal center point of the Colvin gesture image of the note. Then, the horizontal coordinate range of the Colvin gesture image of the note is: [horizontal center point of the note - icon width / 2, horizontal center point of the note + icon width / 2]. The pitch value of the note is linearly converted to obtain the converted coordinate value. The converted coordinate value is offset as the vertical coordinate center point of the Colvin gesture icon, i.e., the converted coordinate value plus the first offset value is used as the vertical coordinate center point of the Colvin gesture icon; then, the vertical coordinate center point of the Colvin gesture image of the note is: converted coordinate value + first offset value. Since the vertical coordinate of the melody point is obtained by linear conversion of the pitch value of the note, the vertical coordinate center point of the Colvin gesture image of the same note can also be expressed as: melody point vertical coordinate + first offset value.
[0079] In some implementations, the step of “displaying a melody line corresponding to the notes, wherein the melody line displays the pitch changes of each of the notes” further includes the following steps:
[0080] Presetting the texture of the melody line according to the theme and / or content of the music score;
[0081] When displaying the melody line corresponding to the note, the texture is applied to render the melody line.
[0082] Among them, the appropriate color and texture can be selected according to the theme and / or content of the song; if the song is a patriotic song, a red line can be used; if the song describes the spring scenery, a tree branch and leaf texture can be used. In this embodiment, according to the characteristics of the theme and / or content of the song, melody lines of different colors and textures are displayed, so that the melody line can more vividly and vividly express the information of the song.
[0083] In some embodiments, the Colvin gesture icon and the melody line are gradually displayed according to the playing progress of the music score. Specifically, according to the playing progress of the music score, the currently playing notes are highlighted along the playing direction of the music score, and the Colvin gesture icon and the melody line corresponding to the played notes are displayed.
[0084] In some implementations, the method for vividly displaying music scores further comprises the steps of:
[0085] A mask bar is preset, and the mask bar is used to mask the unplayed part of the Colvin gesture icon and / or the melody line. The mask bar moves with the playing progress, that is, the mask bar of the Colvin gesture icon and / or the melody line corresponding to the played notes is erased, so that the Colvin gesture icon and / or the melody line are gradually displayed according to the playing progress of the music score.
[0086] like Figure 6 As shown, before the notes are played, you need to cover all rows of Colvin gesture icons and melody line areas with a mask, and then get the current playing progress of the score, that is, get the currently playing note, highlight the currently playing note, and get the melody point coordinates and Colvin gesture icon display area corresponding to the note. Calculate the rightmost boundary of the melody point coordinates and Colvin gesture icon display area in the above steps, which is the leftmost boundary of the "invisible mask". As the score plays, execute the above steps in a loop to update the mask area.
[0087] In some implementations, the method for vividly displaying music scores further comprises the steps of:
[0088] A theme icon of the music score is drawn at the end of the currently displayed melody line or the Colvin gesture icon, and the theme icon moves with the playing progress of the music score. The theme icon is preset according to the theme and / or content of the music score.
[0089] In this embodiment, the music score is played from left to right. When the music score is playing, a preset theme icon is drawn on the rightmost side of the visible part of the melody line. The icon is selected according to the theme and content of the song. For example, if the song describes the scenery of spring, icons such as swallows and flowers can be used.
[0090] like Figure 7 As shown, in this embodiment, a theme icon related to the song content is displayed at the end of the melody line, and during the music score playback, the theme icon moves continuously with the playback progress, thereby making the melody line's performance information richer and more vivid.
[0091] In some implementations, the method for vividly displaying music scores further comprises the steps of:
[0092] The animation effect of the Colvin gesture icon and / or the melody line is set. The animation effect of the Colvin gesture icon is used to dynamically highlight the Colvin gesture icon corresponding to the currently playing note; the animation effect of the melody line is used to display the melody line portion corresponding to the played note and the currently playing note. The animation effects include gradually enlarging and reducing the Colvin gesture icon, shaking the texture on the melody line (such as the texture of leaves) to simulate wind blowing, and other effects.
[0093] like Figure 4As shown, based on the above embodiments, the present invention provides a specific embodiment of a method for vividly displaying a music score, and the method for vividly displaying a music score comprises the following steps:
[0094] S401, when editing the music score, creating melody line textures, texture animations and melody line theme icons according to the theme and content of the song;
[0095] S402, when rendering the score, render the note line first, then render the melody line and Colvin gesture;
[0096] S403, when the score is played, use masking technology to "progress display" the Colvin gesture and melody line area;
[0097] S404, when the music score is playing, the "theme icon" is displayed on the right edge of the "progress";
[0098] S405, while the score is playing, synchronously displaying the animation effect of Colvin's hand gestures and the animation effect of the melody line texture;
[0099] In step S401, information such as melody line texture, texture animation, melody line theme icon, etc. is recorded in the score file. In step S402, if the score includes song lines, the song lines are rendered after the note lines are rendered, and the song lines are rendered before the melody line and the Colvin gesture.
[0100] In step S403, the melody line is rendered and the Colvin gesture icon is rendered. The melody line rendering includes the following steps:
[0101] Calculate the pitch value (MIDI value) of each note in the current playing line. The pitch range of the current line can be known through the pitch value.
[0102] Program preset: Figure 5 As shown, the maximum height of the Colvin gesture icon is h1, and the maximum height of the melody line is h2. The Colvin gesture and melody line occupy a maximum vertical space of h1+h2. Therefore, when the height of the note line + lyrics line after rendering is h0, the melody line drawing range is [h0+h1, h0+h1+h2]. (For ease of understanding, the following description can take h0=300,h1=30,h2=150);
[0103] Linearly map the pitch range to the vertical coordinate, which is the y coordinate of the melody point on the melody line path. For example, if the pitch range [60,72] is linearly mapped to [h0+h1, h0+h1+h2], then when the pitch is 60, it corresponds to y=330, when the pitch is 72, it corresponds to y=480, when the pitch is 66, it corresponds to y=405...;
[0104] Get the horizontal center point of each drawn note, which is the x coordinate of the melody point;
[0105] Use the spline curve formula through the control points (such as CatmullRom, Lagrange interpolation, etc.) to draw a spline curve through each melody point. This curve is the melody line path.
[0106] Read the melody line texture set in the above steps, and apply the texture to the melody line path to get the final melody line graphic.
[0107] The steps to render the Colvin gesture icon are as follows:
[0108] Read the names of the notes in the music file and select the corresponding Colvin gesture pictures;
[0109] The horizontal center point of the note, i.e. the horizontal coordinate (x), is used as the horizontal center point of the Colvin gesture image of the note. The horizontal coordinate range of the Colvin gesture image of the note is: [horizontal center point of the note - icon width / 2, horizontal center point of the note + icon width / 2]. The pitch value of the note is linearly converted to obtain the converted coordinate value. The converted coordinate value is offset as the vertical coordinate center point of the Colvin gesture icon, that is, the converted coordinate value plus the first offset value is used as the vertical coordinate center point of the Colvin gesture icon; then the vertical coordinate center point of the Colvin gesture image of the note is: converted coordinate value + first offset value. Since the vertical coordinate of the melody point is obtained by linear conversion of the pitch value of the note, the vertical coordinate center point of the Colvin gesture image of the same note can also be expressed as: melody point vertical coordinate + first offset value. Specifically, for example, the vertical coordinate center point of the Colvin gesture picture is set as follows: when the pitch is 66, the corresponding melody point y=405, the first offset value can be taken as the Colvin gesture picture height / 2+the second offset value. In order to avoid the melody point overlapping with the bottom of the Colvin gesture picture, the Colvin gesture picture is offset upward by the second offset value, so that the melody line is separated from the Colvin gesture picture. The second offset value can be set based on experience. Then the vertical coordinate range of the Colvin gesture picture is: [converted coordinate value + second offset value, converted coordinate value + Colvin gesture picture height + second offset value] or [melody point vertical coordinate + second offset value, melody point vertical coordinate + Colvin gesture picture height + second offset value].
[0110] like Figure 6 As shown, in step S403, when the score is played, the masking technology is used to perform "progress display" on the Colvin gesture and melody line area, including the following steps:
[0111] Before playing the score, use a mask to cover the area displayed by the Colvin gesture icons and melody lines in all rows;
[0112] Get the current playing progress of the note, that is, highlight the currently playing note;
[0113] Get the melody point coordinates on the melody line corresponding to the note and the Colvin gesture icon display area;
[0114] Calculate the rightmost boundary of the melody point coordinates and the Colvin gesture icon display area in the above steps, which is the leftmost boundary of the "invisible mask";
[0115] Updates the mask region based on the leftmost edge of the Invisibility Mask.
[0116] like Figure 7 As shown, the specific steps in the above step S404 are as follows:
[0117] Based on the melody point coordinates calculated in the above implementation manner and the "rightmost boundary" of the Colvin gesture icon display area, the current playback position (i.e., the rightmost boundary) is used as the horizontal center point of the theme icon;
[0118] Substitute the horizontal center point of the theme icon as the x-coordinate into the spline curve of the melody line to obtain the y-coordinate value, which is used as the vertical center point of the theme icon;
[0119] Align the center of the theme icon to the position determined by the x and y coordinates calculated in the above steps.
[0120] like Figure 8 As shown, in step S405, when the music score is played, the animation effect of the Colvin gesture icon is achieved by the following steps:
[0121] After the above step of updating the mask area, select the Colvin gesture icon corresponding to the currently playing note (i.e. the currently highlighted note);
[0122] The Colvin gesture icon corresponding to the currently playing note is enlarged, and when the current note is finished playing, the Colvin gesture icon corresponding to the current note returns to normal size, thereby making the Colvin gesture icon corresponding to the currently playing note enlarged and dynamically displayed as it becomes smaller after playing.
[0123] like Fig. 9 As shown, in step S405, the melody line texture animation effect is achieved by the following steps:
[0124] When the current row of notes is highlighted, the animation effect is always displayed;
[0125] Read the texture animation effect recorded in the score (may be an animation configuration file, a map sequence, or a 3D script), and the program updates the melody line texture in an independent thread according to the animation effect configuration; as follows Fig. 9 , which uses zoom + transparent gradient to simulate the starlight twinkling effect.
[0126] In the above implementation mode, the Colvin gesture icon is displayed in combination with the melody line in the music score, so that the vertical coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, and the heights of the Colvin gestures corresponding to different notes in the music score are also different, thereby showing the relationship between the Colvin gesture and the pitch of the note; and in the above implementation mode, by combining the theme and content of the song, using a melody line style that matches the content of the song, and coordinating with a marching animation, the melody of the song is expressed more vividly.
[0127] like Fig.10 To solve the above technical problems, the present invention also provides another implementation method:
[0128] A computer storage medium 100 stores a computer program, which, when executed by a processor, implements the method for vividly displaying a music score as described in any one of the above embodiments.
[0129] Finally, it should be noted that although the above embodiments have been described in the specification and drawings of this application, this does not limit the scope of patent protection of this application. All technical solutions generated by replacing or modifying equivalent structures or equivalent processes based on the essential concept of this application using the contents recorded in the specification and drawings of this application, as well as directly or indirectly implementing the technical solutions of the above embodiments in other related technical fields, are included in the scope of patent protection of this application.
Claims
1. A method for vividly displaying a music score, characterized in that: The following steps are involved: Display the notes in the music score; Displaying the Colvin gesture icon corresponding to each note, wherein the longitudinal coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, and the transverse coordinate of the Colvin gesture icon is consistent with the transverse coordinate of the corresponding note; Also includes the steps: Displaying a melody line corresponding to the note, wherein the melody line reflects the pitch change of each note; The Colvin gesture icon and the melody line are gradually displayed according to the playing progress of the music score, specifically: according to the playing progress of the music score, the currently playing note is highlighted along the playing direction of the music score, and the Colvin gesture icon and the melody line corresponding to the played note are displayed; Also includes the steps: A theme icon of the music score is drawn at the end of the currently displayed melody line or the Colvin gesture icon, and the theme icon moves with the playing progress of the music score. The theme icon is preset according to the theme and / or content of the music score.
2. The method for vividly displaying music scores according to claim 1, characterized in that: The step of displaying the melody line corresponding to the notes, wherein the melody line displays the pitch changes of each note, comprises the following steps: Calculating the pitch value of each note, and linearly converting the pitch value into the longitudinal coordinate of the melody point; Taking the horizontal center point of the note as the horizontal coordinate of the melody point; Obtaining the melody points corresponding to the notes in turn, and connecting the melody points with a smooth curve to draw a melody line; The melody line is displayed.
3. The method for vividly displaying music scores according to claim 2, characterized in that: The displaying of the Colvin gesture icon corresponding to each note, wherein the longitudinal coordinate of the Colvin gesture icon is positively correlated with the pitch of the corresponding note, comprises the following steps: Read the solfeggios of each note, and select the Colvin gesture icon corresponding to the solfeggios; Calculating the pitch value of each note, linearly converting the pitch value to obtain a converted coordinate value, and offsetting the converted coordinate value as the longitudinal coordinate center point of the Colvin gesture icon; The horizontal center point of the note is used as the horizontal coordinate center point of the Colvin gesture icon; The Colvin gesture icon corresponding to each of the notes is displayed according to the coordinate position.
4. The method for vividly displaying music scores according to claim 1, characterized in that: The step of displaying the melody line corresponding to the notes, wherein the melody line displays the pitch changes of each note, further comprises the following steps: Presetting the texture of the melody line according to the theme and / or content of the music score; When displaying the melody line corresponding to the note, the texture is applied to render the melody line.
5. The method for vividly displaying music scores according to claim 1, characterized in that: Also includes the steps: An animation effect for the Colvin gesture icon and / or the melody line is set, wherein the animation effect for the Colvin gesture icon is used to dynamically highlight the Colvin gesture icon corresponding to the currently playing note; and the animation effect for the melody line is used to display the portion of the melody line corresponding to the played note.
6. The method for vividly displaying music scores according to claim 1, characterized in that: Also includes the steps: A mask bar is preset, and the mask bar is used to mask the unplayed part of the Colvin gesture icon and / or the melody line. The mask bar moves with the playing progress, so that the Colvin gesture icon and / or the melody line are gradually displayed according to the playing progress of the music score.
7. A computer storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method for vividly displaying a music score as described in any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
System and device of digital music
CN102930861A
Musical composition making method and apparatus
CN106098045A
Comprehensive conversion method and comprehensive conversion system for various music scores
CN113674584A