A method, device, electronic device and medium for adjusting sound effects in a live broadcast room

Abstract

The embodiment of the present invention provides a method, device, electronic device and medium for adjusting the sound effects of a live broadcast room, which relates to the field of live broadcast technology and can more flexibly adjust the sound effects of a live broadcast room. The technical solution of the embodiment of the present invention includes: a push stream client collects a variety of audio data from different audio sources, and then encodes each type of audio data separately to obtain a plurality of audio encoding packets. Then, the live broadcast data is sent to the pull stream client, where the live broadcast data includes a plurality of audio encoding packets, so that the pull stream client decodes the plurality of audio encoding packets to obtain a plurality of audio data, and when playing a plurality of audio data, in response to the user's adjustment instruction for any of the plurality of audio data, adjusts the playback parameters of the audio data.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, and in particular to a method, device, electronic equipment and medium for adjusting sound effects in a live broadcast room. Background Art

[0002] Most livestream audio consists of multiple sounds. For example, a livestream of a game typically includes the host's voice and the game's sounds, while a livestream of a talent show typically includes the host's voice and background music. For viewers, adjusting the sound effects in the livestream is limited to overall adjustments, such as turning the volume up or down. This type of audio adjustment is relatively coarse-grained and lacks flexibility. Summary of the Invention

[0003] The purpose of the embodiments of the present invention is to provide a method, device, electronic device, and medium for adjusting the sound effects of a live broadcast room, so as to more flexibly adjust the sound effects of the live broadcast room. The specific technical solution is as follows:

[0004] In a first aspect, an embodiment of the present invention provides a method for adjusting the sound effects of a live broadcast room, which is applied to a streaming client, and the method includes:

[0005] Collect various audio data from different audio sources;

[0006] Encode each type of audio data separately to obtain multiple audio encoding packets;

[0007] Live broadcast data is sent to a streaming client, where the live broadcast data includes the multiple audio encoding packets, so that the streaming client decodes the multiple audio encoding packets to obtain multiple audio data, and when playing the multiple audio data, adjusts the playback parameters of the audio data in response to a user's adjustment instruction for any audio data among the multiple audio data.

[0008] Optionally, before sending the live broadcast data to the streaming client, the method further includes:

[0009] A silence packet is added at the audio coding packet position, the multiple audio coding packets are added at the additional information position, and a video coding packet is added at the video coding packet position to construct the live broadcast data.

[0010] In a second aspect, an embodiment of the present invention provides a method for adjusting the sound effects of a live broadcast room, which is applied to a streaming client, and the method includes:

[0011] Receive live broadcast data sent by a streaming client, wherein the live broadcast data includes multiple audio encoding packets;

[0012] Decoding the multiple audio coding packets to obtain multiple audio data;

[0013] When playing the multiple audio data, in response to a user's adjustment instruction for any audio data among the multiple audio data, the playing parameters of the audio data are adjusted.

[0014] Optionally, before decoding the multiple audio coding packets, the method further includes:

[0015] The multiple audio coding packets are obtained from the additional information position of the live broadcast data.

[0016] Optionally, before adjusting the playback parameters of any audio data among the multiple audio data in response to an adjustment instruction from the user, the method further includes:

[0017] In response to a user's instruction to display an audio data adjustment interface, display the audio data adjustment interface, wherein the audio data adjustment interface includes adjustment controls for each type of audio data;

[0018] Receive adjustment instructions triggered by the user on any adjustment control in the adjustment interface.

[0019] In a third aspect, an embodiment of the present invention provides a live broadcast room sound effect adjustment device, which is applied to a streaming client, and the device includes:

[0020] An acquisition module, used to acquire a variety of audio data from different audio sources;

[0021] The encoding module is used to encode each type of audio data to obtain multiple audio encoding packets;

[0022] A sending module is used to send live broadcast data to a streaming client, where the live broadcast data includes the multiple audio encoding packets, so that the streaming client decodes the multiple audio encoding packets to obtain multiple audio data, and when playing the multiple audio data, adjusts the playback parameters of the audio data in response to the user's adjustment instructions for any audio data among the multiple audio data.

[0023] Optionally, the device further includes: a building module; the building module is configured to:

[0024] Before sending the live broadcast data to the streaming client, a mute packet is added to the audio coding packet position, the multiple audio coding packets are added to the additional information position, and a video coding packet is added to the video coding packet position to construct the live broadcast data.

[0025] In a fourth aspect, an embodiment of the present invention provides a live broadcast room sound effect adjustment device, which is applied to a streaming client, and the device includes:

[0026] A receiving module, configured to receive live broadcast data sent by a streaming client, wherein the live broadcast data includes multiple audio encoding packets;

[0027] A decoding module, configured to decode the plurality of audio coding packets to obtain a plurality of audio data;

[0028] The adjustment module is used to adjust the playback parameters of any audio data among the multiple audio data in response to the user's adjustment instruction when playing the multiple audio data.

[0029] Optionally, the device further includes: an acquisition module; the acquisition module is configured to:

[0030] Before decoding the multiple audio coding packets, the multiple audio coding packets are obtained from the additional information position of the live broadcast data.

[0031] Optionally, the device further comprises: a display module;

[0032] The display module is configured to display an audio data adjustment interface in response to a user's instruction to display the audio data adjustment interface before adjusting playback parameters of any audio data among the multiple audio data, the audio data adjustment interface including adjustment controls for each type of audio data;

[0033] The receiving module is further configured to receive an adjustment instruction triggered by a user on any adjustment control in the adjustment interface.

[0034] In a fifth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0035] Memory for storing computer programs;

[0036] The processor is used to implement the steps of any of the above-mentioned live broadcast room sound effect adjustment methods when executing the program stored in the memory.

[0037] In a sixth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of any of the above-mentioned live broadcast room sound effect adjustment methods are implemented.

[0038] In the seventh aspect, an embodiment of the present invention also provides a computer program product containing instructions, which, when running on a computer, enables the computer to execute any of the above-mentioned live broadcast room sound effect adjustment methods.

[0039] The live broadcast room sound effect adjustment method, device, electronic device and medium provided by the embodiment of the present invention, because the live broadcast data packet includes multiple audio encoding packets, each audio encoding packet is obtained by encoding a type of audio data. Therefore, the streaming client can independently play a variety of audio data, and can adjust the playback parameters of the audio data in response to the user's adjustment instructions for any audio data among the multiple audio data. It can be seen that when encoding the audio data, the embodiment of the present invention does not uniformly encode the audio data after mixing, but encodes each type of audio data separately, so that the audio data received by the streaming client is independent, thereby allowing the audience to separately adjust the playback parameters of various audio data in the live broadcast room. Therefore, the embodiment of the present invention has a finer granularity for adjusting the live broadcast room sound effects, and achieves more flexible adjustment of the live broadcast room sound effects.

[0040] Of course, it is not necessary to achieve all of the advantages described above simultaneously in order to implement any product or method of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0042] Figure 1 A flowchart of a method for adjusting the sound effects of a live broadcast room provided by an embodiment of the present invention;

[0043] Figure 2 A flowchart of another method for adjusting the sound effects of a live broadcast room provided by an embodiment of the present invention;

[0044] Figure 3 A flowchart of another method for adjusting the sound effects of a live broadcast room provided by an embodiment of the present invention;

[0045] Figure 4 A schematic structural diagram of a live broadcast room sound effect adjustment device provided by an embodiment of the present invention;

[0046] Figure 5 A schematic structural diagram of another live studio sound effect adjustment device provided by an embodiment of the present invention;

[0047] Figure 6 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0048] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of the present invention.

[0049] The embodiment of the present invention is applied in a live broadcast scenario. In the live broadcast scenario, the client used by the anchor during the live broadcast is called the anchor streaming client, hereinafter referred to as the streaming client, and the client used by the audience when watching the live broadcast is called the audience streaming client, hereinafter referred to as the streaming client.

[0050] The push-streaming client collects various audio data, mixes them, and sends them to the server. The server then sends the mixed audio data to the pull-streaming client. Because the pull-streaming client receives the mixed audio data, viewers can only adjust the playback parameters of the mixed data as a whole, rather than adjusting the playback parameters of individual audio data within the live broadcast room. This results in a coarse-grained adjustment of the live broadcast room's sound effects and limited flexibility.

[0051] In order to more flexibly adjust the sound effects of the live broadcast room, the embodiment of the present invention provides a live broadcast room sound effect adjustment method, which is applied to the streaming client, such as Figure 1 As shown, the method includes the following steps:

[0052] S101, collecting a variety of audio data from different audio sources.

[0053] The streaming client collects various audio data currently being generated. For example, different audio tracks can be used to collect the current game sound, the host's voice, and the computer background music. These three audio channels are input into different audio tracks, and three types of audio data corresponding to the three channels are obtained.

[0054] S102: Encode each type of audio data to obtain multiple audio encoding packets.

[0055] For example, the game sound, host voice and computer background music are currently collected, the game sound is encoded to obtain audio encoding package a1; the host voice is encoded to obtain audio encoding package a2; the computer background music is encoded to obtain audio encoding package a3.

[0056] S103: Sending live broadcast data to a streaming client, so that the streaming client decodes the plurality of audio encoding packets to obtain a plurality of audio data, and when playing the plurality of audio data, adjusting playback parameters of any audio data in response to a user's adjustment instruction for the audio data in the plurality of audio data. The live broadcast data includes the plurality of audio encoding packets.

[0057] In one implementation, the streaming client may send live data to the server, and then the server sends the live data to the streaming client.

[0058] The live broadcast room sound effect adjustment method provided by the embodiment of the present invention includes multiple audio encoding packets in the live broadcast data packet, and each audio encoding packet is obtained by encoding a type of audio data. Therefore, the streaming client can independently play a variety of audio data, and can adjust the playback parameters of the audio data in response to the user's adjustment instructions for any audio data among the multiple audio data. It can be seen that the embodiment of the present invention does not uniformly encode the audio data after mixing, but encodes each type of audio data separately when encoding the audio data, so that the audio data received by the streaming client is independent, thereby allowing the audience to separately adjust the playback parameters of various audio data in the live broadcast room. Therefore, the embodiment of the present invention has a finer granularity for adjusting the live broadcast room sound effects, and achieves more flexible adjustment of the live broadcast room sound effects.

[0059] In an embodiment of the present invention, before sending the live streaming data to the pull stream client in step S103, the push stream client generates the live streaming data by adding a silence packet to the audio coding packet position, adding multiple audio coding packets to the additional information position, and adding a video coding packet to the video coding packet position to construct the live streaming data. The video coding packet is obtained by encoding video data corresponding to the audio data, and the video data includes multiple image frames containing live streaming images.

[0060] It is understood that live broadcast data generally includes a video encoding packet, an audio encoding packet, and additional information, wherein the additional information may include custom information. Since there are multiple audio encoding packets in the embodiment of the present invention, it is not suitable to place them in the original audio encoding packet position. Since it is well known to those skilled in the art that the audio encoding packet has a small data volume, it can be placed in the additional information position. At the same time, in order to maintain the original live broadcast data format, a mute packet is placed in the audio encoding packet position. This embodiment of the present invention does not change the placement of the video encoding packet in the live broadcast data.

[0061] For example, the live broadcast data can be in H264 format, and the location of the Supplemental Enhancement Information (SEI) in the H264 format is the above-mentioned additional information location. The H264 format is a highly compressed digital video codec standard. When constructing the live broadcast data, each audio coding packet is added to the SEI location, a video coding packet is added to the video coding packet location, and a silence packet is added to the audio coding packet location to construct the live broadcast data in H264 format.

[0062] The embodiment of the present invention can add multiple audio coding packages on the basis of the original live broadcast data format, thereby achieving more flexible adjustment of the live broadcast room sound effects without changing the original live broadcast data format, making the implementation method of the embodiment of the present invention simpler and more widely applicable.

[0063] The embodiment of the present invention also provides a method for adjusting the sound effects of a live broadcast room, which is applied to a streaming client, such as Figure 2 As shown, the method includes the following steps:

[0064] S201: Receive live streaming data sent by a streaming client, wherein the live streaming data includes multiple audio encoding packets.

[0065] In one implementation, the streaming client may send live data to the server, and the server may send the live data to the streaming client.

[0066] S202: Decode multiple audio coding packets to obtain multiple audio data.

[0067] Each audio codec packet is decoded to generate a type of audio data. The various audio data are generated by the streaming client during live streaming. For example, the streaming client generates three types of audio data: game sounds, host voices, and computer background music.

[0068] S203 , when playing a plurality of audio data, in response to a user's adjustment instruction for any audio data among the plurality of audio data, adjusting the playing parameters of the audio data.

[0069] In an embodiment of the present invention, the live broadcast data also includes video encoding packets, and decoding the video encoding packets can generate video data. The streaming client plays multiple audio data simultaneously with the corresponding video data. While playing the audio and video data, the streaming client can receive user adjustment instructions at any time and adjust the playback parameters of the audio data. The audio data and playback parameters targeted by each adjustment instruction issued by the user can be different.

[0070] The live broadcast room sound effect adjustment method provided by the embodiment of the present invention includes multiple audio encoding packets in the live broadcast data packet, and each audio encoding packet is obtained by encoding a type of audio data. Therefore, the streaming client can independently play a variety of audio data, and can adjust the playback parameters of the audio data in response to the user's adjustment instructions for any audio data among the multiple audio data. It can be seen that the embodiment of the present invention does not uniformly encode the audio data after mixing, but encodes each type of audio data separately when encoding the audio data, so that the audio data received by the streaming client is independent, thereby allowing the audience to separately adjust the playback parameters of various audio data in the live broadcast room. Therefore, the embodiment of the present invention has a finer granularity for adjusting the live broadcast room sound effects, and achieves more flexible adjustment of the live broadcast room sound effects.

[0071] In the embodiment of the present invention, before decoding the multiple audio coding packets in S202, the streaming client obtains the multiple audio coding packets from the additional information position of the live broadcast data.

[0072] The live broadcast data includes a video encoding packet, a silence packet, and multiple audio encoding packets, wherein the video encoding packet is located in the video encoding packet position, the silence packet is located in the audio encoding packet position, and the multiple audio encoding packets are located in the additional information position. The video encoding packet is obtained by encoding the video data corresponding to the audio data.

[0073] In the embodiment of the present invention, in order not to change the original format of the live data, the streaming client places the silent packet at the audio coding packet position. Therefore, after obtaining the live data, the streaming client can ignore the silent packet at the audio coding packet position.

[0074] The embodiment of the present invention can add multiple audio coding packages on the basis of the original live broadcast data format, thereby achieving more flexible adjustment of the live broadcast room sound effects without changing the original live broadcast data format, making the implementation method of the embodiment of the present invention simpler and more widely applicable.

[0075] Before adjusting playback parameters of any audio data among the multiple audio data in response to a user's adjustment instruction in step S203, the streaming client receives the adjustment instruction in a manner that includes: displaying an audio data adjustment interface in response to a user's instruction to display the audio data adjustment interface. The audio data adjustment interface includes adjustment controls for each type of audio data. Then, the client receives an adjustment instruction triggered by the user on any adjustment control within the adjustment interface.

[0076] In an embodiment of the present invention, the audio data carries an identifier for indicating the type of the audio data. For example, the identifier of each audio data may be: game sound, anchor voice, or computer background music.

[0077] In one implementation, the streaming client displays adjustment controls for each type of audio data on an audio data adjustment interface based on identifiers of the various audio data.

[0078] Optionally, the audio data adjustment interface may further display the identifiers of the adjustment controls, the identifiers of the adjustment controls being used to distinguish the adjustment controls of different audio data. The identifiers of the adjustment controls of the audio data are determined based on the identifier of the audio data, for example, the identifiers of the adjustment controls of the audio data may be the same as the identifier of the audio data.

[0079] Exemplarily, the adjustment controls for audio data include: buttons, slide bars and / or input boxes, etc.

[0080] Each audio data may include one or more adjustment controls for adjusting different playback parameters of the audio data. For example, the playback parameters of the audio data include volume, timbre and / or pitch.

[0081] The embodiments of the present invention can adjust various playback parameters of each audio data based on the user's settings, such as adjusting the volume, timbre and / or pitch of each audio data, thereby meeting the user's personalized needs for the audio playback effect of the live broadcast room, while improving the flexibility of the live broadcast room sound effect adjustment.

[0082] In an embodiment of the present invention, when the streaming client is playing multiple audio data, if no adjustment instruction for any audio data is received from the user, the multiple audio data are played according to the default playback parameters.

[0083] Alternatively, when the streaming client plays multiple audio data, if the user's last adjusted playback parameters for the multiple audio data are obtained, the multiple audio data will be played according to the historical playback parameters. If the user's last adjusted playback parameters for the multiple audio data are not obtained, the multiple audio data will be played according to the default playback parameters.

[0084] Figure 1 and Figure 2 The implementation methods of the same steps in the provided live broadcast room sound effect adjustment method can refer to each other.

[0085] See also Figure 3 The following describes the overall process of the live broadcast room sound effect adjustment method provided by the embodiment of the present invention in combination with the application scenario:

[0086] S301: The streaming client collects a variety of audio data from different audio sources.

[0087] S302: The streaming client encodes each type of audio data to obtain multiple audio encoding packets.

[0088] S303: The streaming client sends live streaming data to the server, wherein the live streaming data includes multiple audio encoding packets.

[0089] S304: After receiving the live broadcast data, the server sends the live broadcast data to the streaming client.

[0090] S305: The pull stream client receives the live broadcast data sent by the push stream client, wherein the live broadcast data includes multiple audio encoding packets.

[0091] S306: The streaming client decodes the multiple audio encoding packets to obtain multiple audio data.

[0092] S307 , when playing a plurality of audio data, the streaming client adjusts the playing parameters of any audio data in response to a user's adjustment instruction for the audio data.

[0093] Figure 3 The specific implementation of each step can be referred to Figure 1 and Figure 2 The relevant description in will not be repeated here.

[0094] Based on the same inventive concept, corresponding to Figure 1 The method embodiment shown in the embodiment of the present invention provides a live broadcast room sound effect adjustment device, which is applied to the streaming client, such as Figure 4 As shown, the device includes: an acquisition module 401, an encoding module 402 and a sending module 403;

[0095] The acquisition module 401 is used to acquire a variety of audio data from different audio sources;

[0096] The encoding module 402 is used to encode each type of audio data to obtain multiple audio encoding packets;

[0097] The sending module 403 is used to send live broadcast data to the streaming client. The live broadcast data includes multiple audio encoding packets, so that the streaming client decodes the multiple audio encoding packets to obtain multiple audio data, and when playing the multiple audio data, adjusts the playback parameters of the audio data in response to the user's adjustment instructions for any audio data among the multiple audio data.

[0098] Optionally, the device may further include: a building module; the building module is used to:

[0099] Before sending live data to the streaming client, add a mute packet to the audio encoding packet position, add multiple audio encoding packets to the additional information position, and add a video encoding packet to the video encoding packet position to construct the live data.

[0100] Based on the same inventive concept, corresponding to Figure 2The method embodiment shown in the embodiment of the present invention provides a live broadcast room sound effect adjustment device, which is applied to the streaming client, such as Figure 5 As shown, the device includes: a receiving module 501, a decoding module 502 and an adjustment module 503;

[0101] The receiving module 501 is used to receive live broadcast data sent by the streaming client, where the live broadcast data includes multiple audio encoding packets;

[0102] A decoding module 502 is used to decode multiple audio encoding packets to obtain multiple audio data;

[0103] The adjustment module 503 is configured to adjust the playback parameters of any audio data in response to a user's adjustment instruction for the audio data when playing the multiple audio data.

[0104] Optionally, the device may further include: an acquisition module; the acquisition module is configured to:

[0105] Before decoding the plurality of audio coding packets, the plurality of audio coding packets are obtained from the additional information position of the live broadcast data.

[0106] Optionally, the device may further include: a display module;

[0107] a display module for displaying an audio data adjustment interface in response to a user's instruction to display the audio data adjustment interface before adjusting playback parameters of any audio data among the plurality of audio data, the audio data adjustment interface including adjustment controls for each type of audio data;

[0108] The receiving module 501 is further configured to receive an adjustment instruction triggered by a user on any adjustment control in the adjustment interface.

[0109] The embodiment of the present invention further provides an electronic device, such as Figure 6 As shown, it includes a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604.

[0110] Memory 603, used for storing computer programs;

[0111] The processor 601 is configured to implement the method steps executed by the streaming push client or the streaming pull client in the above method embodiment when executing the program stored in the memory 603 .

[0112] The communication bus mentioned in the electronic device mentioned above may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0113] The communication interface is used for communication between the above electronic device and other devices.

[0114] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0115] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0116] In another embodiment provided by the present invention, a computer-readable storage medium is also provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned live broadcast room sound effect adjustment methods are implemented.

[0117] In another embodiment provided by the present invention, a computer program product containing instructions is also provided, which, when run on a computer, enables the computer to execute any live broadcast room sound effect adjustment method in the above embodiments.

[0118] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0119] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0120] Each embodiment in this specification is described in a related manner. Similar portions between the embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences from other embodiments. In particular, the device embodiments are generally similar to the method embodiments, so their description is relatively simple. For related portions, refer to the description of the method embodiments.

[0121] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A method for adjusting the sound effects of a live broadcast room, characterized in that: Applied to a streaming client, the method includes: Collect a variety of audio data from different audio sources; Encode each type of audio data separately to obtain multiple audio encoding packets; Sending live broadcast data to a streaming client, the live broadcast data including the multiple audio encoding packets, so that the streaming client decodes the multiple audio encoding packets to obtain multiple audio data, each type of audio data carries an identifier, the identifier being used to indicate the type of the audio data; and when playing the multiple audio data, in response to a user's instruction to display the audio data adjustment interface, displaying an audio data adjustment interface, the audio data adjustment interface including adjustment controls determined according to the identifier of each type of audio data, receiving an adjustment instruction triggered by the user on any adjustment control in the adjustment interface, and adjusting playback parameters of any audio data among the multiple audio data in response to the user's adjustment instruction for the audio data. The playback parameters include: volume, timbre and / or pitch; Before sending the live broadcast data to the streaming client, the method further includes: Add a silence packet at the audio coding packet position, add the multiple audio coding packets at the additional information position, and add a video coding packet at the video coding packet position to construct the live broadcast data. When the live broadcast data is in H264 format, the multiple audio coding packets are located at the supplementary enhancement information SEI position of the H264 format.

2. A method for adjusting the sound effects of a live broadcast room, characterized in that: Applied to a streaming client, the method includes: Receive live broadcast data sent by a streaming client, wherein the live broadcast data includes multiple audio encoding packets; Decoding the multiple audio coding packets to obtain multiple audio data; When playing the plurality of audio data, in response to a user's adjustment instruction for any audio data among the plurality of audio data, adjusting the playback parameters of the audio data, the playback parameters including: volume, timbre and / or pitch; Before decoding the multiple audio coding packets, the method further includes: Acquire the multiple audio coding packets from the additional information position of the live broadcast data, where, when the live broadcast data is in H264 format, the multiple audio coding packets are located at the supplementary enhancement information SEI position of the H264 format, and the audio coding packet position of the live broadcast data includes a silence packet; The audio data carries an identifier, the identifier being used to indicate a type of the audio data; and before adjusting playback parameters of any audio data among the multiple audio data in response to a user's adjustment instruction for the audio data, the method further includes: In response to a user's instruction to display an audio data adjustment interface, display the audio data adjustment interface, wherein the audio data adjustment interface includes adjustment controls determined according to the identifier of each type of audio data; Receive adjustment instructions triggered by the user on any adjustment control in the adjustment interface.

3. A live broadcast room sound effect adjustment device, characterized in that: Applied to a streaming client, the device includes: An acquisition module, used to acquire a variety of audio data from different audio sources; The encoding module is used to encode each type of audio data to obtain multiple audio encoding packets; A sending module, configured to send live broadcast data to a streaming client, the live broadcast data including the multiple audio encoding packets, so that the streaming client decodes the multiple audio encoding packets to obtain multiple audio data, each of which carries an identifier, the identifier being used to indicate the type of the audio data, and, when playing the multiple audio data, in response to a user's instruction to display the audio data adjustment interface, display an audio data adjustment interface, the audio data adjustment interface including adjustment controls determined according to the identifier of each type of audio data, receive an adjustment instruction triggered by the user on any adjustment control in the adjustment interface, and adjust playback parameters of the audio data in response to the user's adjustment instruction for any audio data among the multiple audio data, the playback parameters including volume, timbre and / or pitch; The device further comprises: a building module; the building module is configured to: Before sending live broadcast data to the streaming client, add a silent packet at the audio coding packet position, add the multiple audio coding packets at the additional information position, and add a video coding packet at the video coding packet position to construct the live broadcast data. When the live broadcast data is in H264 format, the multiple audio coding packets are located at the supplementary enhancement information SEI position of the H264 format.

4. A live broadcast room sound effect adjustment device, characterized in that: Applied to a streaming client, the device includes: A receiving module, configured to receive live broadcast data sent by a streaming client, wherein the live broadcast data includes multiple audio encoding packets; A decoding module, configured to decode the plurality of audio coding packets to obtain a plurality of audio data; an adjustment module for adjusting, when playing the plurality of audio data, a playback parameter of any audio data among the plurality of audio data in response to a user's adjustment instruction for the audio data, the playback parameter including volume, timbre and / or pitch; The device further includes an acquisition module; the acquisition module is configured to: Before decoding the multiple audio coding packets, obtain the multiple audio coding packets from the additional information position of the live broadcast data, when the live broadcast data is in H264 format, the multiple audio coding packets are located at the supplementary enhancement information SEI position of the H264 format, and the audio coding packet position of the live broadcast data includes a silence packet; The audio data carries an identifier, and the identifier is used to indicate the type of the audio data; the device further includes: a display module; The display module is configured to display an audio data adjustment interface in response to a user's instruction to display the audio data adjustment interface before adjusting playback parameters of any audio data among the multiple audio data, the audio data adjustment interface including adjustment controls determined according to the identifier of each audio data; The receiving module is further configured to receive an adjustment instruction triggered by a user on any adjustment control in the adjustment interface.

5. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; The processor is configured to implement the method steps described in claim 1 or 2 when executing a program stored in the memory.

6. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps of claim 1 or 2 are implemented.

Images