A method and terminal for generating music rhythm teaching files

Abstract

The present invention discloses a method and a terminal for generating a music rhythm teaching file, which comprises the steps of loading audio to be played, determining a time axis corresponding to the audio to be played according to the audio to be played; playing the audio to be played, locating a time point corresponding to an interaction point on the time axis according to the audio to be played, and adding a corresponding interaction mark at the time point; generating the music rhythm teaching file according to the audio to be played, the interaction mark and the corresponding time point; locating the time point corresponding to the interaction point in real time as the audio to be played is played, and adding a corresponding interaction mark at the corresponding time point, thereby achieving alignment between the located interaction point and the audio to be played, and improving the synchronization between songs and action icons in the music rhythm teaching file.

Description

Technical Field

[0001] The present invention relates to the field of music teaching file production, and in particular to a method and a terminal for generating a music rhythm teaching file. Background Art

[0002] In music teaching in kindergartens and primary schools, Orff music rhythm is a good way to cultivate students' perception and reaction ability, comprehension ability, coordination ability of various parts of the body or heart and brain, memory, creativity, and communication ability. Orff music rhythm courseware needs to play a background music, and icons appear with the beat of the music during the playback to prompt students to make corresponding actions. At present, the way to make music rhythm teaching files in teaching is usually to use PPT. The existing practice is generally to insert a song in PPT, insert action icons in several pages of PPT, set these PPTs to automatically switch to play at a fixed time interval or manually switch PPT to play when the teacher is in use. In this way, during the PPT playback process, when adjacent pages are transitioned, due to the time interval, it is difficult to synchronize the song playback with the PPT playback, especially the song playback is difficult to synchronize with the action icon time point in the PPT. At the same time, because the beat of the song is not uniform, some sounds are long and some are short, and if the same transition time is set when each PPT page switches to play, it is also easy to cause the problem of the song playback and the action icon time point in the PPT being out of sync. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide a method and a terminal for generating a music rhythm teaching file, so as to improve the synchronization between songs and action icons in the music rhythm teaching file.

[0004] In order to solve the above technical problems, a technical solution adopted by the present invention is:

[0005] A method for generating a music rhythm teaching file comprises the steps of:

[0006] S1, loading the audio to be played, and determining the time axis corresponding to the audio to be played;

[0007] S2, playing the audio to be played, locating the time point corresponding to the interactive point on the time axis according to the audio to be played, and adding a corresponding interactive mark at the time point;

[0008] S3. Generate the music rhythm teaching file according to the audio to be played, the interactive identifier and its corresponding time point.

[0009] In order to solve the above technical problems, another technical solution adopted by the present invention is:

[0010] A terminal for generating a music rhythm teaching file comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, each step in the method for generating the music rhythm teaching file is implemented.

[0011] The beneficial effects of the present invention are as follows: when generating a music rhythm teaching file, first load the audio to be played, determine the corresponding time axis according to the audio to be played, then play the audio to be played, locate the time point corresponding to the interaction point on the time axis according to the audio to be played, and add the corresponding interaction mark at the time point; as the audio to be played is played, the time point corresponding to the interaction point is located in real time, and the corresponding interaction mark is added at the corresponding time point, so that the located interaction point is aligned with the audio to be played, and the synchronization of songs and action icons in the music rhythm teaching file is improved; the time point of the interaction mark is set according to the time axis corresponding to the audio to be played, so that when the audio to be played is played, the interaction mark is played synchronously according to the time point of the interaction mark, and there is no need to perform operations such as page turning, so as to realize the synchronous playback of the audio to be played and the interaction mark; the production of music rhythm teaching files is simplified and accurate, and the synchronization of the interaction mark and the audio to be played is enhanced. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A flowchart of a method for generating a music rhythm teaching file according to an embodiment of the present invention;

[0013] Figure 2 The present invention is a schematic diagram of the structure of a terminal for generating a music rhythm teaching file according to an embodiment of the present invention. DETAILED DESCRIPTION

[0014] In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in combination with the implementation modes and the accompanying drawings.

[0015] Please refer to Figure 1 , a method for generating a music rhythm teaching file, comprising the steps of:

[0016] S1, loading the audio to be played, and determining the time axis corresponding to the audio to be played;

[0017] S2, playing the audio to be played, locating the time point corresponding to the interactive point on the time axis according to the audio to be played, and adding a corresponding interactive mark at the time point;

[0018] S3. Generate the music rhythm teaching file according to the audio to be played, the interactive identifier and its corresponding time point.

[0019] From the above description, it can be seen that the beneficial effects of the present invention are: when generating a music rhythm teaching file, the audio to be played is first loaded, the corresponding time axis is determined according to the audio to be played, and then the audio to be played is played, and the time point corresponding to the interaction point is located on the time axis according to the audio to be played, and the corresponding interaction mark is added at the time point; as the audio to be played is played, the time point corresponding to the interaction point is located in real time, and the corresponding interaction mark is added at the corresponding time point, so that the located interaction point is aligned with the audio to be played, and the synchronization of songs and action icons in the music rhythm teaching file is improved; the time point of the interaction mark is set according to the time axis corresponding to the audio to be played, so that when the audio to be played is played, the interaction mark is played synchronously according to the time point of the interaction mark, and there is no need to perform operations such as turning pages, so as to realize the synchronous playback of the audio to be played and the interaction mark; the production of music rhythm teaching files is simplified and accurate, and the synchronization of the interaction mark and the audio to be played is enhanced.

[0020] Further, the interactive points include preset lyrics;

[0021] The S1 further comprises:

[0022] Determine the first start and end time of each word in the lyrics of the audio to be played according to the audio to be played;

[0023] The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes:

[0024] The preset lyrics are identified according to the audio to be played, and the time point corresponding to the interactive point is located on the time axis according to the first start and end times of the words corresponding to the identified preset lyrics.

[0025] From the above description, it can be seen that by setting the preset lyrics as the interactive point, when the preset lyrics are played, the time point corresponding to the interactive point is located according to the first start and end time of the words corresponding to the preset lyrics, thereby ensuring the synchronization of the interactive mark and the preset lyrics playback.

[0026] Further, the interaction points include audio drum beats;

[0027] The S1 further comprises:

[0028] Determine a second start and end time of each audio drum beat in the audio to be played according to the audio to be played;

[0029] The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes:

[0030] The audio drum beats are identified according to the audio to be played, and the time point corresponding to the interactive point is located on the time axis according to the second start and end time corresponding to the identified audio drum beats.

[0031] From the above description, it can be seen that by setting audio drum beats as interactive points, when playing the audio drum beats, the time point corresponding to the interactive point is located according to the second start and end time corresponding to the audio drum beats, thereby ensuring the synchronization of the interactive logo and the audio drum beat playback. At the same time, the interactive points can be either preset lyrics or audio drum beats, which increases the diversity of interactive points.

[0032] Furthermore, the S1 further includes:

[0033] Converting the audio to be played into a waveform in the time domain;

[0034] The S2 further includes:

[0035] Determine the starting point of the interactive point of the audio to be played according to the waveform;

[0036] The position of the interaction point on the time axis is fine-tuned according to the starting point of the interaction point.

[0037] As can be seen from the above description, by comparing the waveform of the audio to be played and fine-tuning the position of the interaction point on the time axis, the synchronization between the interaction mark and the audio to be played is further ensured.

[0038] Further, determining the starting point of the interactive point of the audio to be played according to the waveform includes:

[0039] Traverse each time point in the waveform in chronological order, and for the traversed time points:

[0040] Determine whether the amplitude of the waveform increases to a first preset ratio of the maximum amplitude of the waveform within a first preset time starting from the time point, if so, the time point is the starting point of a target object, when the interactive point is a preset lyric, the target object is a word in the sung lyrics, when the interactive point is an audio drum beat, the target object is the audio drum beat;

[0041] A starting point corresponding to the interaction point is determined according to the interaction point and the starting points of all identified target objects.

[0042] From the above description, it can be seen that by traversing each time point in the waveform graph and comparing the amplitude of the waveform corresponding to the preset time period starting from each time point with the maximum amplitude of the waveform to determine whether the time point is the starting point of the target object, the starting point corresponding to the interaction point is located, thereby ensuring the accuracy of the determined starting point of the interaction point.

[0043] Furthermore, the step S2 further includes the following steps:

[0044] receiving a preview request, the preview request including a preview segment;

[0045] The corresponding audio to be played is played according to the preview segment, and the corresponding interaction mark is displayed at the corresponding time point during the playing process.

[0046] From the above description, it can be seen that unlike the existing preview which must start from the beginning of the song to be played, the preview of the present application can start from any position of the song to be played, which greatly improves the flexibility of the preview, and can start the preview from any time point of the audio to be played, which greatly improves the efficiency of producing music rhythm teaching files.

[0047] Furthermore, the music rhythm teaching file also includes configuration information;

[0048] When playing the music rhythm teaching file, displaying the first area and the second area according to the configuration information, the first area is larger than the second area;

[0049] The first area displays the interactive logo of the currently playing video;

[0050] The second area previews the interactive logo that is about to be played.

[0051] From the above description, it can be seen that by setting two areas of different sizes, the larger area displays the currently playing interactive logo, and the smaller area previews the interactive logo to be played, the interactive logo to be played can be previewed while the current interactive logo is playing, further improving the flexibility of the preview.

[0052] Furthermore, the configuration information also includes information on whether each of the interactive identifiers wraps;

[0053] The first area and the second area respectively draw adjacent interactive marks in different rows;

[0054] When playing the music rhythm teaching file, when the interactive logo of the corresponding row of the first area is played, the interactive logo previewed in the corresponding row of the second area is updated to the first area for display, and the second area loads the interactive logo displayed in the next row.

[0055] From the above description, it can be seen that when playing, when the interactive logo of the corresponding row in the first area is played, the interactive logo previewed in the corresponding row in the second area is automatically played, and at the same time, the interactive logo displayed in the next row of preview is automatically loaded in the second area, realizing automatic scrolling playback, and realizing automatic preview of the interactive logo to be played while ensuring synchronous playback.

[0056] Furthermore, the configuration information also includes information for highlighting the currently displayed interactive identifier;

[0057] When playing the music rhythm teaching file, the currently playing interactive mark is highlighted according to the configuration information.

[0058] It can be seen from the above description that by highlighting the currently playing interactive logo, the user can intuitively see the currently playing interactive logo, thereby further improving the user experience.

[0059] Please refer to Figure 2 A terminal for generating a music rhythm teaching file includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, each step in the method for generating the music rhythm teaching file is implemented.

[0060] The method and terminal for generating the music rhythm teaching file of the present invention can be applied to various music rhythm teaching that requires interaction, such as Orff music rhythm courseware, etc., and are described below through specific implementation methods:

[0061] Embodiment 1

[0062] Please refer to Figure 1 , a method for generating a music rhythm teaching file, comprising the steps of:

[0063] S1, loading the audio to be played, and determining the time axis corresponding to the audio to be played;

[0064] Specifically, create a new music rhythm teaching file on the PC and import a song as the audio to be played;

[0065] Initialize a time axis according to the audio to be played, and align the time points of displaying the lyrics and notes of the audio to be played;

[0066] S2, playing the audio to be played, locating the time point corresponding to the interactive point on the time axis according to the audio to be played, and adding a corresponding interactive mark at the time point;

[0067] As the audio to be played is played, a progress bar will be displayed on the timeline, and the corresponding song lyrics and notes will be displayed synchronously. Therefore, when an interactive point is identified through the audio to be played, the time point corresponding to the interactive point is directly located on the timeline, and the corresponding interactive mark is inserted at the time point. The interactive mark can be an interactive icon, such as clapping, stomping, etc.

[0068] In order to insert the interactive logo, the audio to be played can be stopped or paused when the interactive point is identified, and the audio to be played can be continued after the interactive logo is inserted;

[0069] S3, generating the music rhythm teaching file according to the audio to be played, the interactive identifier and the corresponding time point;

[0070] After playing the generated music rhythm teaching file, as the audio is played, according to each interactive identifier and its corresponding time point, when the audio is played to the corresponding time point, the corresponding interactive identifier will be played synchronously.

[0071] Embodiment 2

[0072] This embodiment further defines the types of interactive points. In this embodiment, the interactive points include preset lyrics, which may be emotional words.

[0073] Specifically, the S1 further includes:

[0074] Determine the first start and end time of each word in the lyrics of the audio to be played according to the audio to be played;

[0075] The human voice in the audio to be played can be separated, and the first start and end time of each word of the lyrics in the audio to be played can be determined according to the separated human voice;

[0076] In an optional implementation, the D3NET algorithm or the Spleeter algorithm can be used to separate the human voice from the song audio; then the GOP algorithm is used to determine the first start and end time of each word of the lyrics in the audio to be played from the separated human voice;

[0077] The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes:

[0078] Identify the preset lyrics according to the audio to be played, and locate the time point corresponding to the interaction point on the time axis according to the first start and end time of the words corresponding to the identified preset lyrics;

[0079] Specifically, an emotional word library in lyrics is established in advance. When a song is selected, the lyrics corresponding to the song are obtained, and then the emotional words in the lyrics are identified in real time according to the emotional word library. When an emotional word is played, the lyrics are paused or stopped, and an interactive marker is inserted at the corresponding position on the timeline according to the timestamp of the emotional word obtained in advance; if the emotional word is multiple words, the interactive marker is inserted at the timeline position corresponding to the first word.

[0080] Embodiment 3

[0081] This embodiment further defines another type of interactive point. In this embodiment, the interactive point includes audio drum beats;

[0082] Specifically, the S1 further includes:

[0083] Determine a second start and end time of each audio drum beat in the audio to be played according to the audio to be played;

[0084] The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes:

[0085] Identify the audio drum beats according to the audio to be played, and locate the time point corresponding to the interaction point on the time axis according to the second start and end time corresponding to the identified audio drum beats;

[0086] During the song playing process, when an audio drum beat in the song is recognized, the song is stopped or paused, and an interactive mark is inserted at the drum beat position of the timeline synchronously;

[0087] The interactive point may be a preset lyric, an audio drum beat, or a combination of preset lyrics and audio drum beats. The type of the interactive point may be adaptively set and dynamically modified as needed.

[0088] Embodiment 4

[0089] This embodiment further limits fine-tuning the position of the interaction point on the time axis:

[0090] Specifically, the S1 further includes:

[0091] Converting the audio to be played into a waveform in the time domain;

[0092] The initialized time axis is aligned with the converted waveform time point, lyrics display time point and note time point respectively. During the song playback, the waveform, song lyrics and song notes can be displayed synchronously.

[0093] The S2 further includes:

[0094] Determine the starting point of the interactive point of the audio to be played according to the waveform;

[0095] Fine-tuning the position of the interaction point on the time axis according to the starting point of the interaction point;

[0096] Wherein, determining the starting point of the interactive point of the audio to be played according to the waveform includes:

[0097] Traverse each time point in the waveform in chronological order, and for the traversed time points:

[0098] Determine whether the amplitude of the waveform increases to a first preset ratio of the maximum amplitude of the waveform within a first preset time starting from the time point, if so, the time point is the starting point of a target object, when the interactive point is a preset lyric, the target object is a word in the sung lyrics, when the interactive point is an audio drum beat, the target object is the audio drum beat;

[0099] The first preset time and the first preset ratio can be flexibly and adaptively changed according to different songs;

[0100] A starting point corresponding to the interaction point is determined according to the interaction point and the starting points of all identified target objects.

[0101] Embodiment 5

[0102] This embodiment further defines that the step S2 further includes the following steps:

[0103] receiving a preview request, the preview request including a preview segment;

[0104] Play the corresponding audio to be played according to the preview segment, and display the corresponding interactive mark at the corresponding time point during the playback;

[0105] During the creation of music rhythm teaching files, you can preview the effect at any time, and save the teaching file after confirming the effect.

[0106] Wherein, the music rhythm teaching file also includes configuration information;

[0107] When playing the music rhythm teaching file, displaying the first area and the second area according to the configuration information, the first area is larger than the second area;

[0108] The first area displays the interactive logo of the currently playing video;

[0109] The second area previews the interactive logo that is about to be played;

[0110] In another optional implementation, the configuration information further includes information on whether each of the interactive identifiers wraps;

[0111] After obtaining multiple interactive points corresponding to the played songs on the timeline, appropriate interactive icons can be assigned to the interactive points according to the music style and rhythm of the played songs, and line break information can be input at appropriate interactive points;

[0112] The first area and the second area respectively draw adjacent interactive marks in different rows;

[0113] When playing the music rhythm teaching file, when the interactive mark of the corresponding row of the first area is played, the interactive mark of the corresponding row of the second area is updated to the first area for display, and the second area loads the interactive mark of the next row for display;

[0114] Wherein, the configuration information also includes information for highlighting the currently displayed interactive logo;

[0115] When playing the music rhythm teaching file, highlighting the currently playing interactive mark according to the configuration information;

[0116] After the music rhythm teaching file is produced, when it is played, the music rhythm teaching file obtained by the teaching host includes: a song file and a configuration file, and the configuration file records multiple action identification information, each action identification information includes: the time of appearance, the action icon and whether to wrap;

[0117] According to the configuration file, the action icon corresponding to the interactive identification line currently being played is drawn with a larger area, and the action icon of the next line of the interactive identification line currently being played is drawn with a smaller area;

[0118] When playing a song, when the song reaches the time when a certain action icon appears, the action icon is highlighted. When the last action icon in a row is highlighted, the display switches to the action icon in the next row. In this way, as the song progresses, the action icons are highlighted in sequence, and students make corresponding actions according to the action icons, such as clapping their hands or stomping their feet, to achieve the effect of combining music rhythm with body rhythm.

[0119] Embodiment 6

[0120] Please refer to Figure 2 A terminal for generating a music rhythm teaching file includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, each step in a method for generating a music rhythm teaching file described in any one of embodiments 2 to 5 is implemented.

[0121] In summary, the present invention provides a method and terminal for generating a music rhythm teaching file. When making a music rhythm teaching file, the audio to be played is loaded, and the time axis corresponding to the audio to be played is determined according to the audio to be played. When playing the audio to be played, the time point corresponding to the interaction point is located on the time axis, and an interaction mark corresponding to the time point is added to the time point. The interaction point includes preset lyrics and audio drum beats. During the audio playback process, the time points corresponding to the preset lyrics and audio drum beats are located on the time axis according to the first start and end times and the second start and end times corresponding to each of them. After the time points corresponding to the interaction points are located, the positions of the interaction points on the time axis are fine-tuned by converting the audio to be played into a waveform diagram, a configuration file is generated according to the finally determined time points and their corresponding interaction marks, and then a music rhythm teaching file is generated according to the audio to be played and the configuration file. The music rhythm teaching file is produced efficiently and flexibly, which ensures the synchronization of songs and action icons when the music rhythm teaching file is played.

[0122] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for generating a music rhythm teaching file, characterized in that: Includes steps: S1, loading the audio to be played, and determining the time axis corresponding to the audio to be played; S2, playing the audio to be played, locating the time point corresponding to the interactive point on the time axis according to the audio to be played, and adding a corresponding interactive mark at the time point; S3, generating the music rhythm teaching file according to the audio to be played, the interactive identifier and the corresponding time point; The S1 further comprises: Converting the audio to be played into a waveform in the time domain; The S2 further includes: Determine the starting point of the interactive point of the audio to be played according to the waveform; Fine-tuning the position of the interaction point on the time axis according to the starting point of the interaction point; Determining the starting point of the interactive point of the audio to be played according to the waveform includes: Traverse each time point in the waveform in chronological order, and for the traversed time points: Determine whether the amplitude of the waveform increases to a first preset ratio of the maximum amplitude of the waveform within a first preset time starting from the time point, and if so, the time point is a starting point of a target object; Determine a starting point corresponding to the interaction point according to the interaction point and the starting points of all identified target objects; Wherein, the interactive points include preset lyrics and audio drum beats. When the interactive points are preset lyrics, the target objects are words in the lyrics. When the interactive points are audio drum beats, the target objects are the audio drum beats.

2. The method for generating a music rhythm teaching file according to claim 1, characterized in that: The S1 further comprises: Determine the first start and end time of each word in the lyrics of the audio to be played according to the audio to be played; The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes: The preset lyrics are identified according to the audio to be played, and the time point corresponding to the interactive point is located on the time axis according to the first start and end times of the words corresponding to the identified preset lyrics.

3. A method for generating a music rhythm teaching file according to claim 1 or 2, characterized in that: The S1 further comprises: Determine a second start and end time of each audio drum beat in the audio to be played according to the audio to be played; The step of locating the time point corresponding to the interactive point on the time axis according to the audio to be played includes: The audio drum beats are identified according to the audio to be played, and the time point corresponding to the interactive point is located on the time axis according to the second start and end time corresponding to the identified audio drum beats.

4. The method for generating a music rhythm teaching file according to claim 1 or 2, characterized in that: The step S2 also includes the following steps: receiving a preview request, the preview request including a preview segment; The corresponding audio to be played is played according to the preview segment, and the corresponding interaction mark is displayed at the corresponding time point during the playing process.

5. The method for generating a music rhythm teaching file according to claim 1 or 2, characterized in that: The music rhythm teaching file also includes configuration information; When playing the music rhythm teaching file, displaying the first area and the second area according to the configuration information, the first area is larger than the second area; The first area displays the interactive logo of the currently playing video; The second area previews the interactive logo that is about to be played.

6. The method for generating a music rhythm teaching file according to claim 5, characterized in that: The configuration information also includes information on whether each interactive identifier wraps; The first area and the second area respectively draw adjacent interactive marks in different rows; When playing the music rhythm teaching file, when the interactive logo of the corresponding row of the first area is played, the interactive logo previewed in the corresponding row of the second area is updated to the first area for display, and the second area loads the interactive logo displayed in the next row.

7. The method for generating a music rhythm teaching file according to claim 6, characterized in that: The configuration information also includes information for highlighting the currently displayed interactive identifier; When playing the music rhythm teaching file, the currently playing interactive mark is highlighted according to the configuration information.

8. A terminal for generating music rhythm teaching files, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, each step in the method for generating a music rhythm teaching file as described in any one of claims 1 to 7 is implemented.

Images