Musical instrument ensemble method and device for terminal

Abstract

The present invention discloses a method and device for instrument ensemble for a terminal. The method includes: obtaining the instrument category of the current performance terminal in the ensemble room by responding to a song request received by the ensemble room; downloading the instrument resource file corresponding to the song request according to the instrument category, and reporting a preparation completion signal to the ensemble room; when receiving a start signal sent by the ensemble room, generating a guide button and instrument accompaniment according to the instrument resource file and playing the ensemble stream data and instrument accompaniment pushed by the ensemble room; responding to a trigger operation on the guide button, adjusting the playback volume of the instrument accompaniment and the current interface animation until the instrument accompaniment ends. This more effectively reduces the degree of instrument asynchrony when the user uses the instrument simulation software, and can accurately achieve instrument ensemble under network transmission.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile terminals, and in particular to a method and device for musical instrument ensemble in a terminal. Background Art

[0002] With the rapid development of the Internet, many professional instrument simulation software have been launched on the market. These software simulate instruments and combine the user's corresponding music theory knowledge to achieve a realistic simulation of music playing.

[0003] However, these instrument simulation software require users to know how the instruments are actually used in order to play them effectively, and most of them are affected by audio transmission delays, which only allows users to play them locally.

[0004] Due to the delay in audio transmission, it is easy for users to encounter instrument asynchrony when using instrument simulation software to perform an ensemble, making it impossible to achieve accurate instrument ensemble. Summary of the Invention

[0005] The present invention provides a method and device for musical instrument ensemble for a terminal, which solves the technical problem that due to the delay of audio transmission, instruments are easily out of sync when users use musical instrument simulation software to perform an ensemble, and accurate musical instrument ensemble cannot be achieved.

[0006] The present invention provides a musical instrument ensemble method for a terminal, comprising:

[0007] In response to a song request received by the ensemble room, obtaining a musical instrument category of a current performance terminal in the ensemble room;

[0008] Downloading the instrument resource file corresponding to the song request according to the instrument category, and reporting a preparation completion signal to the ensemble room;

[0009] When receiving a start signal sent by the ensemble room, generating a guide button and an instrument accompaniment according to the instrument resource file and playing the ensemble stream data and the instrument accompaniment pushed by the ensemble room;

[0010] In response to the triggering operation on the guide button, the playing parameters of the instrument accompaniment and the current interface animation are adjusted until the playing of the instrument accompaniment ends.

[0011] Optionally, upon receiving a start signal sent by the ensemble room, generating a guide button and an instrument accompaniment according to the instrument resource file and playing the ensemble streaming data and the instrument accompaniment pushed by the ensemble room includes:

[0012] When a start signal is received from the ensemble room, the instrument resource file is parsed to obtain the instrument accompaniment, beat information, and full song tempo mark corresponding to the instrument type;

[0013] Calculating the start and end times of each note in the instrumental accompaniment according to the beat information and the full song tempo mark;

[0014] Mapping the corresponding notes to the preset initial keys according to the start and end times, and generating a key sequence record;

[0015] updating the key type of the initial key in the key sequence record according to the start and end times, generating and displaying a guide key;

[0016] The ensemble streaming data and the instrumental accompaniment pushed by the ensemble room are played.

[0017] Optionally, the start and end times include a trigger time and an end time; and the step of updating the key type of the initial key in the key sequence record according to the start and end times, generating and displaying a guide key, includes:

[0018] Calculating a trigger time difference between the termination moment and the trigger moment;

[0019] If the trigger time difference is greater than or equal to a preset long press threshold, the key type of the initial key in the key sequence record is updated to a long press key to generate a guide key;

[0020] When there are multiple long-press keys associated with the same triggering time of the guide keys, the long-press keys are changed to personalized playing keys corresponding to the instrument type, and a single new guide key is generated and displayed;

[0021] When there are multiple initial keys whose trigger time difference is less than the preset shielding threshold, the key type of the initial key in the key timing record is updated to a key to be shielded, and a predetermined number of keys to be shielded are merged to generate a guide key.

[0022] Optionally, the playback parameters include a playback volume; and the step of adjusting the playback parameters of the instrumental accompaniment and the current interface animation in response to the triggering operation of the guide button until the playback of the instrumental accompaniment ends includes:

[0023] In response to a trigger operation on the guide button, calculating a degree of synchronization between the trigger operation and the triggering of the guide button until the playing of the instrument accompaniment ends;

[0024] If the trigger synchronization degree is less than or equal to a preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to a preset increase, and the current interface animation corresponding to the increase is displayed;

[0025] If the trigger synchronization degree is greater than a preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to a preset reduction amplitude, and the current interface animation corresponding to the reduction amplitude is displayed.

[0026] Optionally, the playback parameters include playback content; and the step of adjusting the playback parameters of the instrumental accompaniment and the current interface animation in response to the triggering operation of the guide button until the playback of the instrumental accompaniment ends includes:

[0027] In response to a trigger operation on the guide button, calculating a degree of synchronization between the trigger operation and the triggering of the guide button until the playing of the instrument accompaniment ends;

[0028] If the trigger synchronization degree is less than or equal to a preset synchronization threshold, the playback content is adjusted to play the instrumental accompaniment and preset chords, and the current interface animation corresponding to the playback content is displayed;

[0029] If the trigger synchronization degree is greater than a preset synchronization threshold, the playback content is adjusted to play a preset chord, and the current interface animation corresponding to the playback content is displayed.

[0030] Optionally, the method further includes:

[0031] When receiving the ensemble streaming data pushed by the ensemble room, comparing the ensemble timestamp carried by the ensemble streaming data with the current timestamp corresponding to the instrument accompaniment;

[0032] If the ensemble timestamp is different from the current timestamp, the instrument accompaniment is calibrated to the instrument accompaniment corresponding to the ensemble timestamp.

[0033] Optionally, the method further includes:

[0034] When a viewer terminal accesses the ensemble room, the ensemble stream data of the ensemble room is pushed to the viewer terminal.

[0035] Optionally, the method further comprises:

[0036] In response to the song request, all the performance terminals in the ensemble room at the current moment are locked;

[0037] When it is detected that any performance terminal exits the ensemble room or a new performance terminal joins the ensemble room, the generation of the guide button corresponding to the target instrument category is stopped, and the instrument accompaniment of the target instrument category is output at a preset volume.

[0038] Optionally, the method further includes:

[0039] When the playing of the instrument accompaniment ends, the occurrence ratio of the trigger synchronization degree that is less than or equal to the preset synchronization threshold is calculated, and an accuracy score is generated and displayed.

[0040] The present invention also provides a musical instrument ensemble device for a terminal, comprising:

[0041] The instrument category acquisition module is used to respond to the song request received by the ensemble room and obtain the instrument category of the current performance terminal in the ensemble room;

[0042] A resource download module, configured to download the instrument resource file corresponding to the song request according to the instrument category, and report a preparation completion signal to the ensemble room;

[0043] a guide generating module configured to generate a guide button and an instrument accompaniment according to the instrument resource file and play the ensemble stream data and the instrument accompaniment pushed by the ensemble room when receiving a start signal sent by the ensemble room;

[0044] The accompaniment adjustment module is used to respond to the trigger operation of the guide button and adjust the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment is completed.

[0045] It can be seen from the above technical solutions that the present invention has the following advantages:

[0046] The present invention responds to song request requests received by the ensemble room and obtains the instrument category of the current performance terminal in the ensemble room. It then downloads the instrument resource file corresponding to the song request according to the instrument category and reports a preparation completion signal to the ensemble room. Upon receiving a start signal from the ensemble room, it generates a guide button and instrument accompaniment according to the instrument resource file and plays the ensemble stream data and instrument accompaniment pushed by the ensemble room. In response to a trigger operation on the guide button, it adjusts the playback volume of the instrument accompaniment and the current interface animation until the instrument accompaniment ends. This effectively reduces the degree of instrument asynchrony when users use instrument simulation software and accurately implements instrument ensembles over network transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0048] Figure 1A flowchart of a method for performing musical instrument ensemble in a terminal provided in the first embodiment of the present invention;

[0049] Figure 2 A schematic diagram of an application of a musical instrument ensemble method for simulating guitar in a terminal provided by an embodiment of the present invention;

[0050] Figure 3 A schematic diagram of an application of a musical instrument ensemble method for simulating a piano for a terminal provided by an embodiment of the present invention;

[0051] Figure 4 A schematic diagram of an application of a method for simulating a drum set using an instrument ensemble for a terminal provided by an embodiment of the present invention;

[0052] Figure 5 A flowchart of a method for performing musical instrument ensemble in a terminal provided in the second embodiment of the present invention;

[0053] Figure 6 This is a structural block diagram of a musical instrument ensemble device for a terminal provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0054] An embodiment of the present invention provides an instrument ensemble method and device for a terminal, which is used to solve the technical problem that due to the delay of audio transmission, instruments are easily out of sync when users use instrument simulation software to perform an ensemble, and accurate instrument ensemble cannot be achieved.

[0055] In order to make the purpose, features, and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0056] See also Figure 1 , Figure 1 This is a flowchart of the steps of a musical instrument ensemble method for a terminal provided in the first embodiment of the present invention.

[0057] The present invention provides a musical instrument ensemble method for a terminal, the method comprising:

[0058] Step 101, in response to a song request received by an ensemble room, obtain the instrument category of the current performance terminal in the ensemble room;

[0059] An ensemble room is a live broadcast room or voice room that allows multiple people to play musical instruments online at the same time. The basic settings on the page display include avatars used to identify the users associated with each performance terminal, as well as the types of instruments used. It also includes virtual instruments used in the performance and corresponding guide buttons. The types of instruments include but are not limited to guitars, pianos, and drums, etc. Figure 2 The virtual instrument shown is a guitar, and its personalized playing keys can be strumming, Figure 3 The virtual instrument shown is a piano, and its personalized keys can be long notes. Figure 4 The virtual instrument shown is a drum kit, and its personalized key can be a roll, that is, hitting a drum through even and dense strokes.

[0060] A song request refers to a request message sent by any performance terminal in the ensemble room, wherein the song request may include a specific song title, or be generated in response to a click instruction in a song list pushed in the ensemble room.

[0061] In the embodiment of the present application, when a user requests a song in the ensemble room through his / her performance terminal, the song request is sent to the ensemble room. At this time, any performance terminal can obtain the instrument category in the ensemble room.

[0062] Step 102: Download the instrument resource file corresponding to the song request according to the instrument category, and report the preparation completion signal to the ensemble room;

[0063] After determining the instrument category, the instrument resource file corresponding to the song request is downloaded according to the instrument category. After the download is completed, a preparation completion signal is reported to the server in the ensemble room, waiting for the start of the performance of the subsequent song.

[0064] It should be noted that instrument resource files may include but are not limited to MIDI files and animation resource files. The instrument resource files can generate instrument accompaniment and operation guidance information adapted to the instrument type by parsing MIDI files, and the animation resource files can parse and generate interface animation related to the operation guidance information.

[0065] Step 103: When a start signal is received from the ensemble room, a guide key and an instrument accompaniment are generated according to the instrument resource file, and the ensemble stream data and the instrument accompaniment pushed by the ensemble room are played;

[0066] After the ensemble room server receives the ready signal from all the performance terminals, it sends a start signal to each performance terminal. The performance terminal then parses the downloaded instrument resource file and generates the corresponding instrument type guide button and instrument accompaniment. At the same time, it pulls the ensemble stream data from other performance terminals and plays it simultaneously with the current instrument accompaniment.

[0067] Step 104 , in response to the triggering operation on the guide button, adjusting the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment ends.

[0068] In a specific implementation, if the performance terminal receives a trigger operation for a guide button, the difference between the time point of the trigger operation and the time point of the guide button is calculated, that is, the difference between the user trigger start time and the trigger end time compared with the trigger time and the end time respectively, and whether the trigger synchronization degree between the trigger operation and the guide button is less than or equal to the threshold value is determined. If so, it is determined that the trigger operation of the guide button is correct. At this time, the playback volume of the instrument accompaniment can be adjusted according to the preset increase amplitude, and the current interface animation corresponding to the increase amplitude is displayed. Otherwise, it is determined that the trigger operation of the guide button is wrong. At this time, the playback volume of the instrument accompaniment can be adjusted according to the preset decrease amplitude, and the current interface animation corresponding to the decrease amplitude is displayed. The triggering of each guide button is judged one by one until the instrument accompaniment ends.

[0069] In this embodiment of the present application, by responding to a song request received by the ensemble room, the instrument category of the current performance terminal in the ensemble room is obtained; the instrument resource file corresponding to the song request is downloaded according to the instrument category, and a preparation completion signal is reported to the ensemble room; when a start signal is received from the ensemble room, a guide button and instrument accompaniment are generated according to the instrument resource file, and the ensemble stream data and instrument accompaniment pushed by the ensemble room are played; in response to a trigger operation on the guide button, the playback volume of the instrument accompaniment and the current interface animation are adjusted until the instrument accompaniment is finished. This effectively reduces the degree of instrument asynchrony when the user uses the instrument simulation software, and can accurately achieve instrument ensemble under network transmission.

[0070] See also Figure 5 , Figure 5 This is a flowchart of a method for performing musical instrument ensemble in a terminal provided in the second embodiment of the present invention.

[0071] The present invention provides a musical instrument ensemble method for a terminal, the method comprising:

[0072] Step 501: In response to a song request received by an ensemble room, obtain the instrument category of the current performance terminal in the ensemble room;

[0073] Step 502: Download the instrument resource file corresponding to the song request according to the instrument category, and report a preparation completion signal to the ensemble room;

[0074] In the embodiment of the present application, the specific implementation process of steps 501-502 is similar to that of steps 101-102 and will not be repeated here.

[0075] It's worth noting that users can create an ensemble room by selecting a room type. They can also provide further options, such as the number of instruments in the room and the specific instrument categories. The same instrument category can be associated with multiple performance terminals simultaneously, in which case the terminal with the best trigger synchronization will be selected for instrument accompaniment playback. Once the user has selected all of the above options, an ensemble room with multiple instrument categories is created.

[0076] In addition, the ensemble room can also be password-protected to facilitate the joining of users and friends. After the ensemble room is created, any performance terminal corresponding to its instrument category can apply for song request. At this time, the ensemble room pushes a random song list or a frequently used song list of the user associated with the performance terminal for selection. If a selection instruction is received, a song request is generated. At this time, each performance terminal begins to obtain the instrument category in the ensemble room, downloads the corresponding instrument resource file and reports the preparation completion signal to the ensemble room, waiting for the start of the song ensemble.

[0077] Step 503: When a start signal is received from the ensemble room, the instrument resource file is parsed to obtain the instrument accompaniment, beat information, and full song tempo mark corresponding to the instrument type;

[0078] In an embodiment of the present application, after receiving the preparation completion signal reported by all performance terminals, the ensemble room will send a start signal to each performance terminal, and each performance terminal will parse the instrument resource file to obtain the instrument accompaniment, beat information and full song speed mark corresponding to its instrument type.

[0079] It should be noted that the instrument resource file can be a MIDI file. MIDI (Musical Instrument Digital Interface) is the most widely used music standard format in the music arrangement industry and can be called "music that computers can understand." It uses digital control signals of musical notes to record music.

[0080] The tempo of the entire piece is marked in BPM, which stands for beats per minute. It's a tempo standard independent of the score, generally based on a quarter note as one beat. 60 BPM means 60 quarter notes (or equivalent note combinations) are played evenly throughout a minute. Generally, a quarter note is counted as one beat, and describing a beat is simply describing one quarter note at the current BPM. A 60 BPM piece's tempo corresponds to a tempo of 60 quarter notes (or equivalent note combinations) played evenly throughout a minute, meaning a quarter note (or equivalent note combination) should have a duration of 1 second, which provides the performer with a realistic playing speed. Beat information refers to beats, which are fixed musical notations. A quarter note is generally considered to be one beat, and all other notes are strictly divided according to a beat. Therefore, beats are simply the link between notes and time, and do not inherently possess time or tempo properties. The time signature is a standard marking for musical notation, describing how many beats of notes can be written in a measure.

[0081] Step 504, calculating the start and end times of each note in the instrumental accompaniment according to the beat information and the tempo mark of the entire song;

[0082] In an embodiment of the present application, the entire instrumental accompaniment is divided according to the beat information to determine the number of beats in each measure of the instrumental accompaniment. At the same time, the interval time of each beat is determined according to the speed mark of the entire song. In combination with the real time, the start and end times corresponding to each note in the instrumental accompaniment are calculated.

[0083] The start and end times refer to the triggering and ending times of the notes.

[0084] Step 505 , mapping the corresponding notes to the preset initial keys according to the start and end times, and generating a key sequence record;

[0085] After calculating the start and end times corresponding to the notes, the notes corresponding to the notes can be mapped to the initial keys preset on the performance terminal according to the start and end times to generate a key sequence record.

[0086] The key sequence record refers to a sequence record file containing information such as the guide keys and the corresponding triggering time and ending time.

[0087] Step 506: Update the key type of the initial key in the key sequence record according to the start and end times, generate a guide key, and display it;

[0088] Optionally, the start and end times include a trigger time and an end time, and step 506 may include the following sub-steps:

[0089] Calculate the trigger time difference between the termination moment and the trigger moment;

[0090] If the trigger time difference is greater than or equal to the preset long press threshold, the key type of the initial key in the key sequence record is updated to a long press key, generating a guide key;

[0091] When there are multiple long-press keys associated with the same triggering moment of the guide key, the long-press key is changed to a personalized performance key corresponding to the instrument type, and a single new guide key is generated and displayed;

[0092] When there are multiple initial keys whose trigger time difference is less than the preset shielding threshold, the key type of the initial key in the key sequence record is updated to a key to be shielded, and a predetermined number of keys to be shielded are merged to generate a guide key.

[0093] In this embodiment, the initial key type for each note is initially set to single-click. The trigger time difference between the end and trigger times of each note is calculated. If the trigger time difference is greater than or equal to a preset long-press threshold, the initial key type for that note should be a long-press key. The key type is then updated from single-click to long-press, and a guide button is generated and displayed.

[0094] At the same time, if there are a preset number of long-press keys associated with the same guide key triggering time, it indicates that it can be converted into a personalized performance key at this time. The long-press key can be changed to a personalized performance key corresponding to the instrument type, such as a guitar can be changed to a strumming operation key, a piano can be changed to a long note operation key, a drum set can be changed to a roll operation key, etc., thereby generating a single new guide button and displaying it to avoid the user having to press multiple guide buttons at the same time.

[0095] When there are multiple initial keys whose trigger time difference is less than the preset shielding threshold, it indicates that the initial key belongs to a densely triggered operation. At this time, in order to further reduce the complexity of the user's operation, the key type of the initial key in the key timing record is updated to a key to be shielded, and a predetermined number of keys to be shielded are merged to generate a guide key, thereby shielding some key operations according to the preset intervals and reducing the difficulty of triggering.

[0096] Step 507: Play the ensemble streaming data and instrumental accompaniment pushed by the ensemble room.

[0097] In an embodiment of the present application, while generating a guide button, the ensemble room will pull the instrumental accompaniment of other performance terminals except the current performance terminal and mix the streams, generate ensemble stream data and push it to the current performance terminal, and play the ensemble stream data and instrumental accompaniment pushed by the ensemble room through the current performance terminal.

[0098] Step 508 , in response to the triggering operation on the guide button, adjusting the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment ends.

[0099] Optionally, the playback parameter includes a playback volume; step 508 may include the following sub-steps:

[0100] In response to the trigger operation for the guide button, the degree of synchronization between the trigger operation and the trigger of the guide button is calculated until the playing of the instrument accompaniment ends;

[0101] If the trigger synchronization degree is less than or equal to the preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to the preset increase amplitude, and the current interface animation corresponding to the increase amplitude is displayed;

[0102] If the trigger synchronization degree is greater than the preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to the preset reduction amplitude, and the current interface animation corresponding to the reduction amplitude is displayed.

[0103] In this embodiment, in response to the user's triggering operation on the guide button on the current performance terminal, the degree of synchronization between the triggering operation and the guide button can be calculated according to the duration and direction of the triggering operation. If the triggering synchronization degree is less than or equal to the preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to the preset increase amplitude, and the current interface animation corresponding to the increase amplitude is displayed at the same time, so as to increase the proportion of users who have correctly triggered the operation in the ensemble. If the triggering synchronization degree is greater than the preset synchronization threshold, it indicates that the user's triggering operation is highly incorrect. At this time, the playback volume of the instrument accompaniment is reduced according to the preset decrease amplitude, and the current interface animation corresponding to the decrease amplitude is displayed at the same time, so as to prevent the incorrect user from disrupting the harmony of the ensemble.

[0104] In another example of the present application, the playback parameter includes playback content; step 508 may include the following steps:

[0105] In response to the trigger operation for the guide button, the degree of synchronization between the trigger operation and the trigger of the guide button is calculated until the playing of the instrument accompaniment ends;

[0106] If the trigger synchronization degree is less than or equal to the preset synchronization threshold, the playback content is adjusted to play instrument accompaniment and preset chords, and the current interface animation corresponding to the playback content is displayed;

[0107] If the trigger synchronization degree is greater than the preset synchronization threshold, the playback content is adjusted to play the preset chord, and the current interface animation corresponding to the playback content is displayed.

[0108] In an embodiment of the present application, in response to the user's triggering operation on the guide key on the current performance terminal, the degree of synchronization between each triggering operation and the guide key can be calculated according to the duration and direction of the triggering operation of the guide key until the instrument accompaniment is finished.

[0109] If the trigger synchronization level is less than or equal to the preset synchronization threshold, the playback content is adjusted to play the instrumental accompaniment and the preset chords simultaneously, and the current interface animation playing simultaneously is displayed. If the trigger synchronization level is greater than the preset synchronization threshold, the playback content is adjusted to play only the preset chords, and the current interface animation corresponding to the preset chords is also displayed. This effectively prevents user errors from disrupting the performance rhythm, while effectively increasing the diversity of the performance based on the original song.

[0110] It is worth mentioning that when the trigger synchronization degree is greater than the preset synchronization threshold multiple times, the preset chord guide key can also be called to replace the subsequent guide keys to change the instrument accompaniment output by the instrument type to a chord accompaniment.

[0111] In one example of the present invention, the method further includes:

[0112] When the instrument accompaniment ends, the occurrence ratio of the trigger synchronization degree that is less than or equal to the preset synchronization threshold is calculated, and an accuracy score is generated and displayed.

[0113] In an embodiment of the present application, after the instrumental accompaniment is finished, in order to effectively evaluate the user's performance quality, the proportion of trigger synchronization levels that are less than or equal to a preset synchronization threshold in the entire instrumental accompaniment can be counted to generate an accuracy score and displayed on the current performance terminal for the user to view.

[0114] Furthermore, the method further comprises the following steps:

[0115] When receiving the ensemble stream data pushed by the ensemble room, compare the ensemble timestamp carried in the ensemble stream data with the current timestamp corresponding to the instrument accompaniment;

[0116] If the ensemble timestamp is different from the current timestamp, the instrument accompaniment is calibrated to the instrument accompaniment corresponding to the ensemble timestamp.

[0117] In an embodiment of the present application, when the current performance terminal receives the ensemble stream data pushed by the ensemble room, the instrumental accompaniment can be calibrated by further comparing the ensemble timestamp carried in the ensemble stream data with the current timestamp corresponding to the instrumental accompaniment. If the ensemble timestamp is different from the current timestamp, the instrumental accompaniment is calibrated to the instrumental accompaniment at the time corresponding to the ensemble timestamp.

[0118] In the specific implementation, in order to synchronize the progress of each performance terminal, the ensemble timestamp of the initiator of the song request can be used as the basis to further calibrate the instrument accompaniment of the remaining performance terminals, thereby solving the problem of lag and asynchrony caused by network problems.

[0119] In another example of the present invention, the method further comprises the following steps:

[0120] When a viewer terminal accesses the ensemble room, the ensemble stream data of the ensemble room is pushed to the viewer terminal.

[0121] In a specific implementation, when an audience terminal is connected to the ensemble room, the ensemble room can pull the instrument accompaniment of all the performance terminals for mixed streams, generate ensemble stream data and push it to the audience terminal.

[0122] During the performance, the performance terminal will pull the instrument accompaniment stream of each ensemble member, so that it can be combined with its own instrument accompaniment stream to form a complete instrumental performance. For the audience, the stream mixed together by all the performance terminals will be pulled.

[0123] Furthermore, the method may further comprise the following steps:

[0124] In response to a song request, all the performance terminals in the ensemble room at the current moment are locked;

[0125] When it is detected that any performance terminal exits the ensemble room or a new performance terminal joins the ensemble room, the generation of the guide button corresponding to the target instrument category of the performance terminal is stopped, and the instrument accompaniment of the target instrument category is output according to the preset volume.

[0126] In this embodiment, when the ensemble room receives a song request, all the performance terminals in the ensemble room at the current moment can be locked. If any performance terminal exits the ensemble room during the performance, or a new performance terminal joins the ensemble room, it indicates that the performance terminal may miss a certain instrument accompaniment. At this time, the generation of the guide button of the target instrument category corresponding to the performance terminal can be stopped to cancel the performance qualification of the performance terminal in this ensemble. At the same time, in order to ensure the ensemble quality of the remaining performance terminals, the instrument accompaniment of the target instrument category can be input according to the preset volume.

[0127] In this embodiment of the present application, by responding to a song request received by the ensemble room, the instrument category of the current performance terminal in the ensemble room is obtained; the instrument resource file corresponding to the song request is downloaded according to the instrument category, and a preparation completion signal is reported to the ensemble room; when a start signal is received from the ensemble room, a guide button and instrument accompaniment are generated according to the instrument resource file, and the ensemble stream data and instrument accompaniment pushed by the ensemble room are played; in response to a trigger operation on the guide button, the playback volume of the instrument accompaniment and the current interface animation are adjusted until the instrument accompaniment is finished. This effectively reduces the degree of instrument asynchrony when the user uses the instrument simulation software, and can accurately achieve instrument ensemble under network transmission.

[0128] See also Figure 6 , Figure 6 This is a structural block diagram of a musical instrument ensemble device for a terminal provided in Embodiment 3 of the present invention.

[0129] The present invention provides a musical instrument ensemble device for a terminal, comprising:

[0130] The instrument category acquisition module 601 is used to respond to the song request received by the ensemble room and obtain the instrument category of the current performance terminal in the ensemble room;

[0131] Resource download module 602, used to download the instrument resource file corresponding to the song request according to the instrument category, and report the preparation completion signal to the ensemble room;

[0132] The guide generation module 603 is used to generate the guide button and the instrument accompaniment according to the instrument resource file and play the ensemble stream data and instrument accompaniment pushed by the ensemble room when receiving the start signal sent by the ensemble room;

[0133] The accompaniment adjustment module 604 is used to respond to the triggering operation of the guide button and adjust the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment ends.

[0134] Optionally, the guidance generation module 603 includes:

[0135] The resource parsing submodule is used to parse the instrument resource file when receiving the start signal sent by the ensemble room, and obtain the instrument accompaniment, beat information and full song speed mark corresponding to the instrument type;

[0136] The start and end time calculation submodule is used to calculate the start and end time corresponding to each note in the instrument accompaniment according to the beat information and the full song speed mark;

[0137] A keystroke record generation submodule is used to map the corresponding notes to the preset initial keys according to the start and end times, and generate a keystroke timing record;

[0138] The guide button update submodule is used to update the button type of the initial button in the button sequence record according to the start and end times, generate the guide button and display it;

[0139] The accompaniment playback submodule is used to play the ensemble stream data and instrument accompaniment pushed by the ensemble room.

[0140] Optionally, the start and end times include a trigger time and an end time; the guide button update submodule is specifically used to:

[0141] Calculate the trigger time difference between the termination moment and the trigger moment;

[0142] If the trigger time difference is greater than or equal to the preset long press threshold, the key type of the initial key in the key sequence record is updated to a long press key, generating a guide key;

[0143] When there are multiple long-press keys associated with the same triggering moment of the guide key, the long-press key is changed to a personalized performance key corresponding to the instrument type, and a single new guide key is generated and displayed;

[0144] When there are multiple initial keys whose trigger time difference is less than the preset shielding threshold, the key type of the initial key in the key sequence record is updated to a key to be shielded, and a predetermined number of keys to be shielded are merged to generate a guide key.

[0145] Optionally, the playback parameter includes a playback volume; the accompaniment adjustment module 604 is specifically configured to:

[0146] In response to the trigger operation for the guide button, the degree of synchronization between the trigger operation and the trigger of the guide button is calculated until the playing of the instrument accompaniment ends;

[0147] If the trigger synchronization degree is less than or equal to the preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to the preset increase amplitude, and the current interface animation corresponding to the increase amplitude is displayed;

[0148] If the trigger synchronization degree is greater than the preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to the preset reduction amplitude, and the current interface animation corresponding to the reduction amplitude is displayed.

[0149] Optionally, the playback parameters include playback content; the accompaniment adjustment module 604 is specifically configured to:

[0150] In response to the trigger operation for the guide button, the degree of synchronization between the trigger operation and the trigger of the guide button is calculated until the playing of the instrument accompaniment ends;

[0151] If the trigger synchronization degree is less than or equal to the preset synchronization threshold, the playback content is adjusted to play instrument accompaniment and preset chords, and the current interface animation corresponding to the playback content is displayed;

[0152] If the trigger synchronization degree is greater than the preset synchronization threshold, the playback content is adjusted to play the preset chord, and the current interface animation corresponding to the playback content is displayed.

[0153] Optionally, the device further comprises:

[0154] A timestamp comparison module is used to compare the ensemble timestamp carried in the ensemble stream data with the current timestamp corresponding to the instrument accompaniment when receiving the ensemble stream data pushed by the ensemble room;

[0155] The instrument accompaniment calibration module is used to calibrate the instrument accompaniment to the instrument accompaniment corresponding to the ensemble timestamp if the ensemble timestamp is different from the current timestamp.

[0156] Optionally, the device further comprises:

[0157] The ensemble stream push module is used to push the ensemble stream data of the ensemble room to the audience terminal when the audience terminal accesses the ensemble room.

[0158] Optionally, the device further comprises:

[0159] The terminal locking module is used to respond to song request and lock all the performance terminals in the ensemble room at the current moment;

[0160] The performance interruption module is used to stop generating the guide button corresponding to the target instrument category of the performance terminal when it detects that any performance terminal exits the ensemble room or a new performance terminal joins the ensemble room, and output the instrument accompaniment of the target instrument category at a preset volume.

[0161] Optionally, the device further comprises:

[0162] The performance scoring module is used to calculate the occurrence ratio of the trigger synchronization degree that is less than or equal to the preset synchronization threshold when the instrument accompaniment is finished, generate an accuracy score and display it.

[0163] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, modules and sub-modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0164] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0165] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0166] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features thereof can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A musical instrument ensemble method for a terminal, characterized in that: The method comprises: In response to a song request received by the ensemble room, obtaining a musical instrument category of a current performance terminal in the ensemble room; Downloading the instrument resource file corresponding to the song request according to the instrument category, and reporting a preparation completion signal to the ensemble room; When receiving a start signal sent by the ensemble room, generating a guide button and an instrument accompaniment according to the instrument resource file and playing the ensemble stream data and the instrument accompaniment pushed by the ensemble room; In response to the triggering operation on the guide button, adjusting the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment ends; The method further comprises: When a viewer terminal accesses the ensemble room, the ensemble stream data of the ensemble room is pushed to the viewer terminal.

2. The method according to claim 1, characterized in that The step of generating a guide button and an instrument accompaniment according to the instrument resource file and playing the ensemble streaming data and the instrument accompaniment pushed by the ensemble room upon receiving a start signal sent by the ensemble room comprises: When a start signal is received from the ensemble room, the instrument resource file is parsed to obtain the instrument accompaniment, beat information, and full song tempo mark corresponding to the instrument category; Calculating the start and end times of each note in the instrumental accompaniment according to the beat information and the full song tempo mark; Mapping the corresponding notes to the preset initial keys according to the start and end times, and generating a key sequence record; updating the key type of the initial key in the key sequence record according to the start and end times, generating and displaying a guide key; The ensemble streaming data and the instrumental accompaniment pushed by the ensemble room are played.

3. The method according to claim 2, characterized in that The start and end times include a trigger time and an end time; and the step of updating the key type of the initial key in the key sequence record according to the start and end times, generating and displaying a guide key, includes: Calculating a trigger time difference between the termination moment and the trigger moment; If the trigger time difference is greater than or equal to a preset long press threshold, the key type of the initial key in the key sequence record is updated to a long press key to generate a guide key; When there are multiple long-press keys associated with the same triggering time of the guide keys, the long-press keys are changed to personalized playing keys corresponding to the instrument category, and a single new guide key is generated and displayed; When there are multiple initial keys whose trigger time difference is less than the preset shielding threshold, the key type of the initial key in the key timing record is updated to a key to be shielded, and a predetermined number of keys to be shielded are merged to generate a guide key.

4. The method according to claim 1, wherein The playback parameters include a playback volume; and the step of adjusting the playback parameters of the instrumental accompaniment and the current interface animation in response to the triggering operation of the guide button until the playback of the instrumental accompaniment ends includes: In response to a trigger operation on the guide button, calculating a degree of synchronization between the trigger operation and the triggering of the guide button until the playing of the instrument accompaniment ends; If the trigger synchronization degree is less than or equal to a preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to a preset increase, and the current interface animation corresponding to the increase is displayed; If the trigger synchronization degree is greater than a preset synchronization threshold, the playback volume of the instrument accompaniment is adjusted according to a preset reduction amplitude, and the current interface animation corresponding to the reduction amplitude is displayed.

5. The method according to claim 1, characterized in that The playback parameters include playback content; the step of adjusting the playback parameters of the instrumental accompaniment and the current interface animation in response to the triggering operation of the guide button until the playback of the instrumental accompaniment ends includes: In response to a trigger operation on the guide button, calculating a degree of synchronization between the trigger operation and the triggering of the guide button until the playing of the instrument accompaniment ends; If the trigger synchronization degree is less than or equal to a preset synchronization threshold, the playback content is adjusted to play the instrumental accompaniment and preset chords, and the current interface animation corresponding to the playback content is displayed; If the trigger synchronization degree is greater than a preset synchronization threshold, the playback content is adjusted to play a preset chord, and the current interface animation corresponding to the playback content is displayed.

6. The method according to claim 1, wherein The method further comprises: When receiving the ensemble streaming data pushed by the ensemble room, comparing the ensemble timestamp carried by the ensemble streaming data with the current timestamp corresponding to the instrument accompaniment; If the ensemble timestamp is different from the current timestamp, the instrument accompaniment is calibrated to the instrument accompaniment corresponding to the ensemble timestamp.

7. The method according to claim 6, characterized in that The method further comprises: In response to the song request, all the performance terminals in the ensemble room at the current moment are locked; When it is detected that any performance terminal exits the ensemble room or a new performance terminal joins the ensemble room, the generation of the guide button corresponding to the target instrument category is stopped, and the instrument accompaniment of the target instrument category is output at a preset volume.

8. The method according to claim 4 or 5, characterized in that The method further comprises: When the playing of the instrument accompaniment ends, the occurrence ratio of the trigger synchronization degree that is less than or equal to the preset synchronization threshold is calculated, and an accuracy score is generated and displayed.

9. A musical instrument ensemble device for a terminal, characterized in that: include: The instrument category acquisition module is used to respond to the song request received by the ensemble room and obtain the instrument category of the current performance terminal in the ensemble room; A resource download module, configured to download the instrument resource file corresponding to the song request according to the instrument category, and report a preparation completion signal to the ensemble room; a guide generating module configured to generate a guide button and an instrument accompaniment according to the instrument resource file and play the ensemble stream data and the instrument accompaniment pushed by the ensemble room when receiving a start signal sent by the ensemble room; An accompaniment adjustment module, configured to respond to a trigger operation on the guide button and adjust the playing parameters of the instrument accompaniment and the current interface animation until the playing of the instrument accompaniment ends; The device also includes: The ensemble stream pushing module is used to push the ensemble stream data of the ensemble room to the viewer terminal when the viewer terminal accesses the ensemble room.

Images