Music synthesis method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a music synthesis method and device, equipment and a storage medium. The method includes allocating a first musical instrument to a first virtual object based on a user operation associated with the first virtual object; and in response to the first virtual object and the one or more virtual objects satisfying a preset condition, playing target music, the one or more virtual objects being allocated with one or more second musical instruments, the target music comprising a first playing audio corresponding to the first musical instrument and one or more playing audios corresponding to the one or more second musical instruments. Therefore, the experience of playing music together with other users is provided for the user, so that the sense of participation and creation fun of the user are improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for music synthesis. Background Art

[0002] With the rapid development of computer technology, users can interact with other users in various ways. For example, users can interact with other users through role-playing (RP) gameplay, which can improve the user experience. Users can perform certain creations (e.g., video creation) through RP gameplay. Therefore, a more convenient way to create music is expected to improve user participation and create fun. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for music synthesis is provided. The method includes: assigning a first musical instrument to the first virtual object based on a user operation associated with the first virtual object; and playing target music in response to the first virtual object and one or more virtual objects satisfying a preset condition, the one or more virtual objects being assigned with one or more second musical instruments, the target music including a first performance audio corresponding to the first musical instrument and one or more performance audio corresponding to the one or more second musical instruments.

[0004] In a second aspect of the present disclosure, a device for music synthesis is provided. The device includes: an instrument assignment module configured to assign a first instrument to a first virtual object based on a user operation associated with the first virtual object; and a music playing module configured to play target music in response to the first virtual object and one or more virtual objects satisfying a preset condition, the one or more virtual objects being assigned with one or more second instruments, the target music including a first performance audio corresponding to the first instrument and one or more performance audio corresponding to the one or more second instruments.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments according to the present disclosure may be implemented;

[0010] FIG. 2A to FIG. 2E A schematic diagram showing an example interface for music synthesis according to some embodiments of the present disclosure is shown;

[0011] FIG. 3A to FIG. 3D A schematic diagram showing an example interface for music synthesis according to other embodiments of the present disclosure is shown;

[0012] Figure 4 A flowchart showing an example process of music synthesis according to some embodiments of the present disclosure;

[0013] Figure 5 A schematic structural block diagram showing an example apparatus for music synthesis according to some embodiments of the present disclosure; and

[0014] Figure 6 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0015] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0016] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0017] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0018] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects are subject to the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user knows and confirms. Accordingly, when implementing each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0019] In this specification and the embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the subject of personal information, or it is necessary to perform a contract, etc.), and will only be processed within the scope of regulations or agreements. If a user refuses to process personal information other than the necessary information for basic functions, it will not affect the user's use of basic functions.

[0020] As mentioned above, users can create something (e.g., video creation) through the gameplay of RP. Conventionally, the gameplay of role-playing allows users to interact through language, discussion, costume play, performance, and creation.

[0021] The embodiment of the present disclosure proposes a scheme for music synthesis. The scheme includes: assigning a first musical instrument to the first virtual object based on a user operation associated with the first virtual object; and playing target music in response to the first virtual object and one or more virtual objects satisfying a preset condition, the one or more virtual objects are assigned with one or more second musical instruments, and the target music includes a first performance audio corresponding to the first musical instrument and one or more performance audios corresponding to the one or more second musical instruments. Thus, the user is provided with the experience of playing music with other users, thereby improving the user's sense of participation and creative fun.

[0022] Various example implementations of the solution are described in detail below in conjunction with the accompanying drawings.

[0023] Example Environment

[0024] Figure 1 A schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented is shown. In the example environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or an attached device of the terminal device 110. Exemplarily, the application 120 can be a content generation application, a content sharing application, or a social application, which can provide services related to media content to the user 140, including browsing, commenting, forwarding, creation (e.g., shooting and / or editing), publishing, etc. of content. "Media content" can include one or more types of content, such as video, image, gif, image set, audio, text, etc. The application 120 can support the user 140 in creating multimedia content. Such multimedia content can include image data and audio data.

[0025] exist Figure 1 In the environment 100 of the application 120, the terminal device 110 can present the user interface 150 of the application 120. The user interface 150 may include various interfaces that the application 120 can provide, such as a content presentation interface, a content creation interface, a content publishing interface, a message interface, a personal homepage, and the like. The application 120 may provide a content browsing function to browse various types of content published in the application 120. The application 120 may also provide a content creation function, including shooting, uploading, editing and / or publishing media content. In some embodiments, a client of a virtual scene may be deployed in the application 120 or in the terminal device 110, and the client of the virtual scene may provide services of the virtual scene. Such virtual scenes may include, for example, but are not limited to games (such as role-playing games), virtual reality scenes, and the like.

[0026] In some embodiments, the terminal device 110 communicates with the server 130 to provide the service of the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0027] It should be understood that the structure and function of each element in the environment 100 are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0028] Some example embodiments of the present disclosure will continue to be described with reference to the accompanying drawings. It should be understood that the pages shown in the accompanying drawings are merely examples, and various page designs may actually exist. The various graphic elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect. In addition, hereinafter, the example embodiments will be described mainly with respect to the server 130. It should be understood that the actions described with respect to the server 130 may be performed by the server 130 in collaboration with the terminal device 110. Alternatively, it can be understood that the actions described with respect to the server 130 in collaboration with the terminal device 110 may be performed by the application 120 on the terminal device 110, or may be performed by the application 120 in collaboration with its service end (e.g., server 130).

[0029] Example Interaction

[0030] In some embodiments, the server 130 assigns the first musical instrument to the first virtual object based on the user operation associated with the first virtual object. In some examples, the user 140 corresponding to the first virtual object can select the first musical instrument in the page 150 provided by the terminal device 110 to play the performance audio corresponding to the first musical instrument. Subsequently, the server 130 receives the user operation of the user 140 selecting the first musical instrument sent by the terminal device 110, and then assigns the first musical instrument to the first virtual object.

[0031] In some examples, a virtual object may be created based on a configuration operation of a user. In some embodiments, a virtual object may be generated based on image data and a description text input by a user. A virtual object may include a visual representation of a virtual object and the capabilities of the virtual object (e.g., conversation capabilities, data processing capabilities, etc.). In some scenarios, such a virtual object may also be referred to as a digital avatar or a virtual avatar. Acquisition of the image data of a virtual object may include: a terminal device acquires at least one image based on a configuration operation of a user. Image data of the virtual object is determined based on at least one acquired image. As an example, a configuration operation may include selecting an image from an album or taking an image using a camera component. As an example, at least one image may be an image in an album or an image taken by calling a camera component. As an example, a visual representation of a virtual object may be generated based on image data and a description text input by a user.

[0032] In some embodiments, if the server 130 determines that the first virtual object and one or more virtual objects meet a preset condition, the target music is played. In some embodiments, one or more virtual objects are assigned one or more second musical instruments, and the target music includes a first performance audio corresponding to the first musical instrument and one or more performance audios corresponding to the one or more second musical instruments. In an embodiment of the present disclosure, playing music described relative to the server 130 may refer to the server 130 sending relevant data of the music to the terminal device so that the terminal device or a device attached to the terminal device plays the music.

[0033] In some examples, if the server 130 determines that the first virtual object and the one or more virtual objects are in the same target virtual scene, and the first virtual object and the one or more virtual objects are respectively equipped with a first musical instrument and one or more second musical instruments, the target music including the performance audio of the first musical instrument and the performance audio of the one or more second musical instruments is played. Figure 2DThe example interface 200D shown is when the target virtual scene 210 includes musical instrument 211, musical instrument 212, and musical instrument 213. If musical instrument 211, musical instrument 212, and musical instrument 213 are respectively assigned to virtual object 145-1, virtual object 145-2, and virtual object 145-3, the server 130 can generate a complete target music. The target music includes the performance audio corresponding to musical instrument 211, musical instrument 212, and musical instrument 213. In some examples, musical instrument 211, musical instrument 212, and musical instrument 213 can be the same instrument or different instruments, which is not limited in the present disclosure.

[0034] In some examples, if the instrument 211 and the instrument 212 are respectively assigned to the virtual object 145-1 and the virtual object 145-2, the server 130 may also generate a complete target music. The target music includes the performance audio corresponding to the instrument 211 and the instrument 212. Figure 2A and Figure 2E Detailed description: When a first virtual object and one or more virtual objects are in the same target virtual scene, target music is played.

[0035] In other examples, if the server 130 determines that the first virtual object is authorized to interact with one or more virtual objects, and the first virtual object and the one or more virtual objects are respectively equipped with a first musical instrument and one or more second musical instruments, the server 130 plays the target music including the performance audio of the first musical instrument and the performance audio of the one or more second musical instruments. Figure 3A and Figure 3D Detailed description: When the first virtual object is authorized to interact with one or more virtual objects, target music is played.

[0036] The following first refers to FIG. 2A to FIG. 2E The invention describes that when the first virtual object and one or more virtual objects are in the same target virtual scene, target music is played. FIG. 2A to FIG. 2E Example interfaces 200A to 200E for music synthesis according to some embodiments of the present disclosure are shown. It should be understood that the virtual objects 145-1, 145-2, 145-3, ..., 145-N included in the drawings may be collectively or individually referred to as virtual objects 145. Virtual objects 145-1, 145-2, 145-3, ..., 145-N correspond to users 140-1, 140-2, 140-3, ..., 140-N, respectively. For ease of discussion, users 140-1, 140-2, 140-3, ..., 140-N may be collectively or individually referred to as users 140.

[0037] In some embodiments, the server 130 may assign the first musical instrument to the first virtual object in the following manner: The server 130 cooperates with the terminal device 110 to present a target virtual scene for music synthesis, where the target virtual scene includes at least the first musical instrument. Figure 2A In the example interface 200A shown, the terminal device 110 can present a target virtual scene 210, and the target virtual scene 210 can include musical instruments 211, 212, 213, and the like. As an example, the target virtual scene can be a music stage in a cloud game. In an embodiment of the present disclosure, the presentation of the target virtual scene described with respect to the server 130 can refer to the server 130 sending the relevant data of the scene to the terminal device, so that the terminal device or a device attached to the terminal device presents the target virtual scene.

[0038] In some embodiments, if the server 130 detects that the first virtual object is located in an area associated with the first musical instrument, the server 130 presents an interactive control for selecting the first musical instrument in the target virtual scene. Figure 2A As shown, when the virtual object 145-1 approaches the fixed musical instrument 211 displayed in the target virtual scene 210 (e.g., a music stage), the server 130 cooperates with the terminal device 110 to present the interactive control 215 in the target virtual scene 210. For example, the interactive control 215 can be a dot. In the embodiment of the present disclosure, the presentation of the interactive control described with respect to the server 130 can refer to the server 130 sending the relevant data of the interactive control to the terminal device so that the terminal device or the device attached to the terminal device presents the interactive control.

[0039] Subsequently, if the server 130 receives a trigger on the interactive control, it assigns the first musical instrument to the first virtual object. Figures 2A to 2B In the example interfaces 200A to 200B shown, if the server 130 receives a trigger operation of the user 140 on the interactive control 215 sent from the terminal device 110, the instrument 211 is assigned to the virtual object 145-1. It can be understood that after the user 140 clicks the interactive control 215, the corresponding virtual object 145-1 will occupy the music position 220.

[0040] like Figure 2B In the example interface 200B shown, after the virtual object 145-1 is assigned the instrument 211, the server 130 cooperates with the terminal device 110 to present a music selection control 221 and a control 222 for removing the instrument 211. In some embodiments, if the server 130 receives a music selection indication for the first instrument, it presents a selection panel for at least one candidate music. Figure 2B to Figure 2CIn the example interfaces 200B to 200C shown, if the server 130 receives a trigger on the music selection control 221 from the user 140 sent from the terminal device 110, it presents a selection panel 231 for at least one candidate music. In the embodiment of the present disclosure, the presentation of the music selection control and selection panel described with respect to the server 130 may refer to the server 130 sending the relevant data of the music selection control and selection panel to the terminal device, so that the terminal device or the device attached to the terminal device presents the music selection control and selection panel.

[0041] In some embodiments, the server 130 receives a selection of a first music from at least one candidate music via a selection panel. Then, the server 130 obtains an audio of the first music played by a first instrument as the first performance audio. Figure 2C In the example interface 200C shown, if the terminal device 110 detects that the user 140 clicks on the predetermined music 232 in the selection panel 231, the predetermined music 232 selected by the user 140 is sent to the server 130. Subsequently, the server 130 uses the audio of the performance part of the instrument 211 in the predetermined music 232 as the first performance audio. In some embodiments, the performance audio of a certain instrument playing a certain music has a sound effect that matches the type of the instrument. For example, if the instrument is a saxophone, the performance audio of the music A played by the saxophone has a sound effect that matches the type of the saxophone.

[0042] In some examples, the audio of the first music may be pre-generated audio. In some examples, the user 140 may click the slot corresponding to the predetermined music 232 to select and play the predetermined music 232. Accordingly, the user 140 clicks the slot corresponding to the predetermined music 232 again to pause playing the predetermined music 232.

[0043] In some embodiments, if the server 130 does not receive a music selection instruction for the first instrument, the server 130 obtains the audio of the predetermined music played by the first instrument as the first performance audio. In some examples, when the user 140 does not click the music selection control 221 to select the predetermined music, the performance audio played by the instrument 211 is the audio played by the instrument 211 in the default music.

[0044] In some embodiments, during the playing of the first performance audio, the server 130 may present a control for providing a music selection indication in a first predetermined style. Figure 2B In the example interface 200B, during the first performance audio playback corresponding to the musical instrument 211, the music selection control 221 is presented in a predetermined pattern 223. For example, the predetermined pattern 223 may be an outer circle corresponding to the music selection control 221 that is enlarged and / or reduced, an audio wave, and the like.

[0045] In some embodiments, during the playing of the first performance audio, the server 130 may also present a special effect in the area associated with the first instrument to indicate that the first instrument is being played. Figure 2B In the example interface 200B shown, during the playback of the first performance audio corresponding to the instrument 211, the special effects 224 of the performance are also displayed on the instrument 211. Figure 2D In the example interface 200D shown, after the target music is synthesized and is being played, the music selection control 221 is presented in a predetermined style 223. Accordingly, the special effects 224, 241, and 242 being played are displayed on the musical instrument 211, the musical instrument 212, and the musical instrument 213, respectively. In the embodiment of the present disclosure, the presentation of special effects described with respect to the server 130 may refer to the server 130 sending the relevant data of the special effects to the terminal device, so that the terminal device or the device attached to the terminal device presents the special effects.

[0046] In some embodiments, when all instruments in the target virtual scene are assigned, if other virtual objects configured with instruments are in or near the target virtual scene, the corresponding performance audio of the instruments they carry will not be added to the target music. Figure 2E In the example interface 200E shown, assuming that the target virtual scene 210 includes musical instruments 251, 212, and 213, when musical instruments 251, 212, and 213 are all filled, if the virtual object 145-1 configured with musical instrument 211 is in or near the target virtual scene, the performance audio corresponding to the musical instrument 211 carried by it will not be added to the target music. In this case, the server 130 can also present a prompt message 252 for prompting that it is impossible to play together.

[0047] Therefore, in the game role-playing (RP) stage scene, the user can choose any instrument on the stage to play, and only play the part belonging to the instrument. When all the instruments on the stage are played by the user, a complete piece of music can be synthesized. Figure 3A and Figure 3D The invention describes playing target music when the first virtual object has authorized interaction with one or more virtual objects. FIG. 3A to FIG. 3D Example interfaces 300A to 300D for music synthesis according to other embodiments of the present disclosure are shown.

[0048] In some embodiments, if the server 130 receives an interaction request from the first virtual object to one or more virtual objects, it presents a request control for sending a joint performance request. In some examples, the first virtual object equipped with a musical instrument can send a joint performance request to other virtual objects. Figure 3AIn the example interface 300A shown, if the server 130 receives a request from the user 140 corresponding to the virtual object 145-1 assigned with the musical instrument 312 to click on the virtual object 145-2 assigned with the musical instrument 311, the interactive interface 310 is presented. The interactive interface includes a request control 313 for sending a request for playing together. In some examples, the musical instrument 311 and the musical instrument 312 may be the same musical instrument or different musical instruments, which is not limited in the present disclosure. In the embodiments of the present disclosure, the presentation of the request control and the interactive interface described with respect to the server 130 may refer to the server 130 sending the relevant data of the request control and the interactive interface to the terminal device, so that the terminal device or the device attached to the terminal device presents the request control and the interactive interface.

[0049] In some embodiments, if the server 130 detects a trigger operation on the request control, it sends a joint performance request to the client device corresponding to one or more virtual objects. Then, if the server 130 receives an authorization operation for one or more virtual objects, it plays the target music.

[0050] like Figure 3A As shown, if the server 130 detects that the user 140 corresponding to the virtual object 145-1 clicks the request control 313, it sends a joint performance request to the client device corresponding to the virtual object 145-2. Subsequently, if the server 130 detects an authorization operation for the virtual object 145-2, it plays the target music including the performance audio corresponding to the musical instrument 312 and the musical instrument 311 respectively.

[0051] For example, if the server 130 detects that the virtual object 145-1 assigned to the instrument A sends a request for joint performance to the virtual object 145-2 assigned to the instrument B and the virtual object 145-3 assigned to the instrument C, and after receiving authorization for the virtual objects 145-2 and 145-3, it plays the target music including the performance audio corresponding to the instruments A, B, and C respectively.

[0052] In some embodiments, if the server 130 receives an interaction request from the first virtual object to the second virtual object that is not assigned with a musical instrument, the server 130 presents a request control for sending a joint performance request in a second predetermined style. In some examples, if the other virtual object is not assigned with a musical instrument, the request control for sending a joint performance request is grayed out. Figure 3B In the example interface 300B shown, if the server 130 receives an interaction request from the virtual object 145 - 1 to the virtual object 145 - 2 to which no musical instrument is assigned, the request control 321 is presented in a grayed-out style.

[0053] In some embodiments, if the server 130 detects a trigger operation on the request control presented in the second predetermined style, the server 130 presents the first prompt information that the joint performance request is not applicable to the second virtual object. Figure 3B As shown, if the server 130 detects a trigger operation on the grayed-out request control 321, it presents prompt information 322 indicating that the joint performance request is not applicable to the virtual object 145-2. For example, the prompt information 322 may be that the other party does not have a handheld instrument and cannot perform together.

[0054] In some embodiments, if the server 130 detects an interaction request from the first virtual object to the third virtual object assigned with a musical instrument before the first musical instrument is assigned to the first virtual object, the server 130 presents a request control for sending a joint performance request in a third predetermined style. In some examples, if other virtual objects are assigned with musical instruments, the request control for sending a joint performance request is highlighted. Figure 3C In the example interface 300C shown, before the virtual object 145 - 1 is assigned a musical instrument, if the server 130 detects an interaction request from the virtual object 145 - 1 to the virtual object 145 - 2 assigned with the musical instrument 311 , the request control is presented in a highlighted style.

[0055] In some embodiments, if the server 130 receives a trigger operation on the request control presented in the third predetermined style, it presents a second prompt information for selecting a musical instrument for the first virtual object. Figure 3C As shown, if the server 130 detects a trigger operation on the request control 331 presented in a highlighted state, it presents the prompt information 332 of the virtual object 145-1. For example, the prompt information 332 may be that you need to hold the instrument in hand to play together.

[0056] like Figure 3D In the example interface 300D shown, if the server 130 receives an interaction request from a virtual object 145-1 that is not assigned a musical instrument to a virtual object 145-2 that is not assigned a musical instrument, the request control 341 is presented in a grayed-out style. Subsequently, if the server 130 detects a trigger operation on the request control 341 presented in a grayed-out state, it presents a prompt message 342 for the virtual object 145-1. For example, the prompt message 342 may be that you need to hold the musical instrument in order to play together. In this way, the user can request other users who are assigned a musical instrument to play together in any scenario while holding the musical instrument.

[0057] In summary, through the disclosed embodiments, the user corresponding to the virtual object being played can switch the music. Furthermore, based on multiple different instruments, a new piece of music can be synthesized by randomly combining music, thereby increasing the user's creativity and interest in music.

[0058] Example Process

[0059] Figure 4 4 is a flowchart showing an example process 400 of music synthesis according to some embodiments of the present disclosure. Process 400 may be implemented at server 130, for example, but this is only exemplary. Figure 1 4. The process 400 is described below.

[0060] like Figure 4 As shown, at block 410 , the server 130 assigns a first musical instrument to the first virtual object based on a user operation associated with the first virtual object.

[0061] In box 420, the server 130 plays the target music in response to the first virtual object and one or more virtual objects satisfying a predetermined condition, the one or more virtual objects are assigned one or more second musical instruments, and the target music includes a first performance audio corresponding to the first musical instrument and one or more performance audios corresponding to the one or more second musical instruments.

[0062] In some embodiments, assigning a first musical instrument to a first virtual object includes: presenting a target virtual scene for music synthesis, the target virtual scene including at least the first musical instrument; in response to the first virtual object being located in an area associated with the first musical instrument, presenting an interactive control for selecting the first musical instrument in the target virtual scene; and in response to triggering the interactive control, assigning the first musical instrument to the first virtual object.

[0063] In some embodiments, the first performance audio is determined by: in response to receiving a music selection indication for a first musical instrument, presenting a selection panel for at least one candidate music; receiving a selection of a first music from at least one candidate music via the selection panel; and obtaining audio of the first music played with the first musical instrument as the first performance audio.

[0064] In some embodiments, the first performance audio is determined by: in response to not receiving a music selection indication for the first musical instrument, acquiring audio of predetermined music played with the first musical instrument as the first performance audio.

[0065] In some embodiments, process 400 also includes performing at least one of the following during the playing of the first performance audio: presenting controls for providing music selection indications in a first predetermined style, or presenting special effects in an area associated with the first instrument to indicate that the first instrument is being played.

[0066] In some embodiments, playing the target music includes: in response to receiving an interaction request issued by a first virtual object to one or more virtual objects, presenting a request control for sending a request for playing together; in response to a triggering operation on the request control, sending a request for playing together to client devices corresponding to the one or more virtual objects; and in response to receiving an authorization operation for the one or more virtual objects, playing the target music.

[0067] In some embodiments, process 400 also includes: in response to receiving an interaction request from a first virtual object to a second virtual object to which no musical instrument is assigned, presenting a request control for sending a request to play together in a second predetermined style; and in response to a triggering operation on the request control presented in the second predetermined style, presenting a first prompt message that the request to play together is not applicable to the second virtual object.

[0068] In some embodiments, process 400 also includes: before assigning a first musical instrument to a first virtual object, in response to an interaction request issued by the first virtual object to a third virtual object assigned with a musical instrument, presenting a request control for sending a request for playing together in a third predetermined style; and in response to a triggering operation on the request control presented in the third predetermined style, presenting a second prompt information for selecting a musical instrument for the first virtual object.

[0069] Example devices and equipment

[0070] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 5 A schematic structural block diagram of an example apparatus 500 for music synthesis according to some embodiments of the present disclosure is shown. The apparatus 500 may be implemented as or included in the server 130. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0071] like Figure 5As shown, the device 500 includes a musical instrument assignment module 510, which is configured to assign a first musical instrument to the first virtual object based on a user operation associated with the first virtual object. The device 500 also includes a music playing module 520, which is configured to play target music in response to the first virtual object and one or more virtual objects satisfying a predetermined condition, the one or more virtual objects being assigned with one or more second musical instruments, and the target music including a first performance audio corresponding to the first musical instrument and one or more performance audio corresponding to the one or more second musical instruments.

[0072] In some embodiments, the instrument assignment module 510 is further configured to present a target virtual scene for music synthesis, the target virtual scene including at least a first instrument; in response to the first virtual object being located in an area associated with the first instrument, present an interactive control for selecting the first instrument in the target virtual scene; and in response to triggering the interactive control, assign the first instrument to the first virtual object.

[0073] In some embodiments, the first performance audio is determined by: in response to receiving a music selection indication for a first musical instrument, presenting a selection panel for at least one candidate music; receiving a selection of a first music from at least one candidate music via the selection panel; and obtaining audio of the first music played with the first musical instrument as the first performance audio.

[0074] In some embodiments, the first performance audio is determined by: in response to not receiving a music selection indication for the first musical instrument, acquiring audio of predetermined music played with the first musical instrument as the first performance audio.

[0075] In some embodiments, the apparatus 500 further comprises an execution module configured to present a control for providing a music selection indication in a first predetermined style, or to present a special effect for indicating that the first instrument is being played in an area associated with the first instrument.

[0076] In some embodiments, the music playback module 520 is further configured to present a request control for sending a request for a joint performance in response to receiving an interaction request issued by the first virtual object to one or more virtual objects; to send a request for a joint performance to a client device corresponding to one or more virtual objects in response to a triggering operation on the request control; and to play the target music in response to receiving an authorization operation for one or more virtual objects.

[0077] In some embodiments, the device 500 also includes a prompt information presentation module, which is configured to, in response to receiving an interaction request issued by a first virtual object to a second virtual object to which no musical instrument is assigned, present a request control for sending a request for playing together in a second predetermined style; and in response to a triggering operation on the request control presented in the second predetermined style, present a first prompt information that the request for playing together is not applicable to the second virtual object.

[0078] In some embodiments, the prompt information presentation module is further configured to, before assigning the first musical instrument to the first virtual object, present a request control for sending a request for playing together in a third predetermined style in response to an interaction request issued by the first virtual object to a third virtual object assigned with a musical instrument; and present a second prompt information for selecting a musical instrument for the first virtual object in response to a triggering operation on the request control presented in the third predetermined style.

[0079] like Figure 6 As shown, the electronic device 600 is in the form of a general electronic device. The components of the electronic device 600 may include, but are not limited to, one or more processors or processing units 610, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 620. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 600.

[0080] The electronic device 600 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 600.

[0081] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 6As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0082] The communication unit 640 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0083] The input device 650 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 660 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 600, or communicate with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0084] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0085] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0086] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0087] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0088] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0089] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for music synthesis, comprising: assigning a first musical instrument to the first virtual object based on a user operation associated with the first virtual object; as well as In response to the first virtual object and one or more virtual objects satisfying a predetermined condition, target music is played, the one or more virtual objects are assigned one or more second musical instruments, and the target music includes a first performance audio corresponding to the first musical instrument and one or more performance audios corresponding to the one or more second musical instruments.

2. The method of claim 1 , wherein assigning the first musical instrument to the first virtual object comprises: presenting a target virtual scene for music synthesis, wherein the target virtual scene includes at least the first musical instrument; In response to the first virtual object being located in the area associated with the first musical instrument, presenting an interactive control for selecting the first musical instrument in the target virtual scene; and In response to triggering of the interactive control, the first musical instrument is assigned to the first virtual object.

3. The method according to claim 1, wherein the first performance audio is determined by: In response to receiving a music selection indication for the first instrument, presenting a selection panel for at least one candidate music; receiving, via the selection panel, a selection of a first music from among the at least one candidate music; and The audio of the first music being played with the first musical instrument is obtained as the first performance audio.

4. The method according to claim 1, wherein the first performance audio is determined by: In response to not receiving a music selection instruction for the first musical instrument, audio of predetermined music played by the first musical instrument is acquired as the first performance audio.

5. The method according to claim 3, further comprising, during the playing of the first performance audio, performing at least one of the following: presenting a control for providing said music selection indication in a first predetermined style, or A special effect indicating that the first instrument is being played is presented in an area associated with the first instrument.

6. The method according to claim 1, wherein playing the target music comprises: In response to receiving an interaction request issued by the first virtual object to the one or more virtual objects, presenting a request control for sending a joint performance request; In response to a triggering operation on the request control, sending the joint performance request to client devices corresponding to the one or more virtual objects; as well as In response to receiving an authorization operation for the one or more virtual objects, the target music is played.

7. The method according to claim 1, further comprising: In response to receiving an interaction request from the first virtual object to a second virtual object to which no musical instrument is assigned, presenting a request control for sending a joint performance request in a second predetermined style; as well as In response to a triggering operation on the request control presented in the second predetermined style, first prompt information that the joint performance request is not applicable to the second virtual object is presented.

8. The method according to claim 1, further comprising: Before assigning the first musical instrument to the first virtual object, in response to an interaction request issued by the first virtual object to a third virtual object assigned with a musical instrument, presenting a request control for sending a joint performance request in a third predetermined style; as well as In response to a triggering operation on the request control presented in the third predetermined style, second prompt information for selecting a musical instrument for the first virtual object is presented.

9. A device for music synthesis, comprising: an instrument assignment module configured to assign a first instrument to the first virtual object based on a user operation associated with the first virtual object; as well as The music playing module is configured to play target music in response to the first virtual object and one or more virtual objects satisfying a predetermined condition, wherein the one or more virtual objects are assigned with one or more second musical instruments, and the target music includes a first performance audio corresponding to the first musical instrument and one or more performance audio corresponding to the one or more second musical instruments.

10. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 8 when executed by the at least one processing unit.

11. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 8.

Images