Audio stream processing method and device and electronic equipment

Abstract

The invention provides an audio stream processing method and device, and electronic equipment, and the method comprises the steps: decoding an input audio stream, and generating N audio tracks, and metadata information and audio signals corresponding to the audio tracks; under the condition that the currently received program list information contains the pictorial sound identifier, preprocessing the audio stream to obtain a pictorial sound audio stream, and generating second audio object metadata information for the pictorial sound audio stream; setting a target audio track corresponding to the out-of-picture sound in the N audio tracks as a mute audio track; and calling an audio rendering module, and based on the metadata information and the second audio object metadata information, carrying out audio rendering on the adjusted audio stream and the picture audio stream to obtain a target audio rendering signal and outputting the target audio rendering signal. According to the audio stream processing scheme provided by the invention, independent control on the out-of-picture sound and the environment sound in the traditional television accompanying sound can be realized.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and in particular to an audio stream processing method and device, and electronic equipment. Background Art

[0002] TV sound is an important component of TV programs. Nowadays, TV programs generally use stereo or surround sound to transmit TV sound. For sports events, documentaries and other programs, TV sound includes two parts: one is the ambient sound (the live sound matched with the picture), and the other is the voice-over such as commentary.

[0003] In order to achieve the transmission of TV sound, the following solutions are currently mainly used: ambient sound and voice-over are combined into a sound track for transmission, and then decoded at the playback terminal and sent to different speakers for broadcast. In this processing method, ambient sound and voice-over are played as a whole, and it is impossible to control the ambient sound and voice-over separately. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide an audio stream processing method and device, and an electronic device, which can solve the problem in the prior art that ambient sound and voice-over cannot be controlled separately.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0006] An embodiment of the present invention provides an audio stream processing method, the method comprising:

[0007] Decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track;

[0008] Determine whether the currently received program list information contains a voice-over identifier;

[0009] In a case where the program list information includes a voice-over identifier, preprocessing the audio stream to obtain a voice-over audio stream, and generating second audio object metadata information for the voice-over audio stream;

[0010] Setting the target audio track corresponding to the voice-over in the N audio tracks as a silent audio track;

[0011] The audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the metadata information of the second audio object, to obtain and output a target audio rendering signal.

[0012] Optionally, after the step of determining whether the currently received program list information contains a voice-over identifier, the method further includes:

[0013] In the case that the program list information does not include a voice-over identifier, an audio rendering module is called to render the audio stream to obtain and output a target audio rendering signal.

[0014] Optionally, the N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel; wherein the target audio track is the center audio track.

[0015] Optionally, when the program list information includes a voice-over identifier, the step of preprocessing the audio stream to obtain a voice-over audio stream, and generating second audio object metadata information for the voice-over audio stream includes:

[0016] In the case where the program list information includes a voice-over identifier, copying the voice-over audio stream in the audio stream;

[0017] Generate second audio object metadata information for the copied voice-over audio stream to make the voice-over audio stream a sound object, wherein the second audio object metadata information includes: an audio object name, an identifier for indicating whether interaction is supported, an initial volume, and an initial position.

[0018] Optionally, the step of calling the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the second audio object metadata information to obtain and output a target audio rendering signal includes:

[0019] Initialize parameters of the audio track for user interaction based on the metadata information and the second audio object metadata information;

[0020] An audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream to obtain a target audio rendering signal that matches a designated speaker, and the target audio rendering signal is output to the designated speaker.

[0021] Optionally, the method further comprises:

[0022] Receiving an adjustment operation on the metadata information and / or the metadata information of the second audio object, wherein the adjustment operation includes at least one of the following: muting, volume adjustment, and sound orientation adjustment;

[0023] In response to the adjustment operation, the corresponding audio object metadata information is modified.

[0024] An embodiment of the present invention further provides an audio stream processing device, wherein the device comprises:

[0025] A decoding module, used to decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track;

[0026] A judging module, used for judging whether the currently received program list information contains a voice-over mark;

[0027] A preprocessing module, configured to preprocess the audio stream to obtain a voice-over audio stream, and generate second audio object metadata information for the voice-over audio stream when the program list information includes a voice-over identifier;

[0028] An audio track adjustment module, used for setting a target audio track corresponding to the voice-over in the N audio tracks as a silent audio track;

[0029] The first calling module is used to call the audio rendering module, and based on the metadata information and the second audio object metadata information, performs audio rendering on the adjusted audio stream and the voice-over audio stream to obtain and output a target audio rendering signal.

[0030] Optionally, the device further comprises:

[0031] The second calling module is used to call the audio rendering module to render the audio stream after the judgment module determines whether the currently received program list information contains a voice-over identifier, if the program list information does not contain a voice-over identifier, to obtain a target audio rendering signal and output it.

[0032] Optionally, the N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel; wherein the target audio track is the center audio track.

[0033] Optionally, the preprocessing module includes:

[0034] The first submodule is used for copying the voice-over audio stream in the audio stream when the program list information includes a voice-over identifier;

[0035] The second submodule is used to generate second audio object metadata information for the copied voice-over audio stream to make the voice-over audio stream a sound object, wherein the second audio object metadata information includes: an audio object name, an identifier indicating whether interaction is supported, an initial volume, and an initial position.

[0036] Optionally, the first calling module includes:

[0037] A third submodule, configured to initialize parameters of the audio track for user interaction based on the metadata information and the second audio object metadata information;

[0038] The fourth submodule is used to call the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream, obtain a target audio rendering signal that matches the designated speaker, and output the target audio rendering signal to the designated speaker.

[0039] Optionally, the device further comprises:

[0040] A receiving module, configured to receive an adjustment operation on the metadata information and / or the metadata information of the second audio object, wherein the adjustment operation includes at least one of the following: muting, volume adjustment, and sound orientation adjustment;

[0041] The response module is used to modify the corresponding audio object metadata information in response to the adjustment operation.

[0042] In another aspect of the implementation of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; the memory is used to store computer programs; and the processor is used to implement any of the above-mentioned audio stream processing methods when executing the program stored in the memory.

[0043] The audio stream processing scheme disclosed in the present invention decodes the input audio stream to generate N audio tracks and the first audio object metadata information corresponding to each audio track; when the program list information contains a voice-over identifier, the audio stream is pre-processed to obtain a voice-over audio stream, and the second audio object metadata information is generated for the voice-over audio stream; the target audio track corresponding to the voice-over in the N audio tracks is set as a silent track; the audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the second audio object metadata information, and the target audio rendering signal is obtained and output. This audio stream processing scheme can achieve separate control of the voice-over and the ambient sound in the traditional TV accompaniment through software adaptation on the playback terminal without changing the TV broadcast system and the TV channel transmission system, such as muting the voice-over, adjusting the volume, changing the spatial position, etc., thereby improving the user experience of the traditional TV accompaniment. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 is a flowchart showing a method for processing an audio stream according to an embodiment of the present application;

[0045] Figure 2 is a schematic diagram showing the audio stream processing flow of an embodiment of the present application;

[0046] Figure 3 It is a structural block diagram of an audio stream processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0048] In order to solve the problem in the prior art that the ambient sound and the voice-over cannot be controlled separately, the ambient sound can be used as a sound bed, and the voice-over can be used as a sound object to be encoded and transmitted separately, and then uniformly rendered at the terminal according to the metadata information to form the required sound signal and transmit it to the speaker for playback. In this case, the voice-over is a sound object, and the interactive metadata information can be used to adjust the voice-over to achieve muting, volume, and location, but the television broadcast and transmission system needs to be modified to adapt to this demand, which requires a large investment and consumes more bandwidth resources. The present invention provides an audio stream processing method by adjusting the audio track in the playback terminal and supplementing the audio metadata. The method can control the playback of the voice-over separately when using the traditional television program broadcast transmission scheme, without the need to modify the television broadcast and transmission system.

[0049] The audio stream processing solution provided in the embodiment of the present application is described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0050] As attached Figure 1 As shown, the audio stream processing method of the embodiment of the present application includes the following steps:

[0051] Step 101: Decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track.

[0052] Exemplarily, the number of N is 6, and the N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel. It should be noted that the number of N is not limited to 6, and can also be any other feasible positive integer, and the number of N can be adaptively adjusted according to the audio stream type and the output source.

[0053] The audio stream processing method provided in the embodiment of the present application can be applied to an electronic device, on which a computer program related to audio stream processing is stored, and a processor of the electronic device executes the computer program to perform audio stream processing. During the TV playback process, when the TV sound includes a voice-over, such as a live sports game, a documentary, etc., the audio stream processing method provided in the embodiment of the present application can be used to achieve a better listening effect by interacting with the voice-over track.

[0054] Step 102: Determine whether the currently received program list information contains a voice-over identifier.

[0055] The voice-over identifier is used to indicate whether the audio stream corresponding to the program information contains a voice-over. If the program information does not contain a voice-over identifier, the audio rendering module is called to render the audio stream, obtain a target audio rendering signal and output it. If the program information contains a voice-over identifier, step 103 is executed.

[0056] Step 103: When the program list information includes a voice-over identifier, pre-process the audio stream to obtain a voice-over audio stream, and generate second audio object metadata information for the voice-over audio stream.

[0057] In an optional embodiment, the audio stream is preprocessed to obtain a voice-over audio stream, and the second audio object metadata information is generated for the voice-over audio stream as follows:

[0058] When the program list information includes a voice-over identifier, the voice-over audio stream in the audio stream is copied; and second audio object metadata information is generated for the copied voice-over audio stream to make the voice-over audio stream a sound object, wherein the second audio object metadata information includes: an audio object name, an identifier for indicating whether interaction is supported, an initial volume, and an initial position.

[0059] The preprocessing of the audio stream can be performed by a preprocessing module set in the playback terminal. Through preprocessing, the voice-over audio stream can be processed into an independent sound object. Later, during the playback process, the user can flexibly adjust the sound object through the interactive functions provided by the playback terminal, such as: mute, increase the volume, decrease the volume, adjust the sound direction, etc.

[0060] Step 104: Set the target audio track corresponding to the voice-over in the N audio tracks as a silent audio track.

[0061] The target audio track may be the center audio track. In the actual implementation process, the specific selection of the target audio track needs to be determined according to the audio track corresponding to the voice-over audio, that is, the target audio track is the audio track corresponding to the voice-over audio.

[0062] The voice-over audio stream in the original audio stream is generally transmitted through the center audio track, so the target audio track can be set as the center audio track.

[0063] Step 105: Call the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the metadata information of the second audio object, obtain the target audio rendering signal and output it.

[0064] A method of optionally calling the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the metadata information of the second audio object to obtain and output the target audio rendering signal may be as follows:

[0065] First, based on the metadata information and the metadata information of the second audio object, the parameters of the audio track for user interaction are initialized; wherein the parameters of the audio track include: volume, direction and other information of the audio track.

[0066] Secondly, the audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream to obtain a target audio rendering signal that matches the designated speaker, and the target audio rendering signal is output to the designated speaker.

[0067] In an optional embodiment, the audio stream of the voice-over may also be adjusted during playback, and the playback terminal receives the user's adjustment operation on the metadata information and / or the second audio object metadata information, and modifies the corresponding audio object metadata information in response to the adjustment operation.

[0068] The adjustment operation includes at least one of the following: muting, volume adjustment, and sound direction adjustment;

[0069] This method of optionally adjusting the relevant parameters of the audio object during the playback process allows users to flexibly adjust the playback audio stream according to their needs, which can improve fun and convenience.

[0070] The audio stream processing method provided in the embodiment of the present application decodes the input audio stream to generate N audio tracks and metadata information corresponding to each audio track; when the program list information contains a voice-over identifier, the audio stream is pre-processed to obtain a voice-over audio stream, and a second audio object metadata information is generated for the voice-over audio stream; the target audio track corresponding to the voice-over in the N audio tracks is set as a silent track; the audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the second audio object metadata information, and the target audio rendering signal is obtained and output. This audio stream processing solution can achieve separate control of the voice-over and the ambient sound in the traditional TV accompaniment through software adaptation on the playback terminal without changing the TV broadcast system and the TV channel transmission system, such as muting the voice-over, adjusting the volume, changing the spatial position, etc., thereby improving the user experience of the traditional TV accompaniment.

[0071] Please refer to the attached Figure 2 The audio stream processing method of the embodiment of the present application is described with another embodiment.

[0072] In order to realize interactive control of a specific audio track in the TV channel playback terminal, this application designs a method that utilizes the rendering capability of the playback terminal by preprocessing the audio track data and metadata. In this embodiment, the original TV audio is 5.1 surround sound, and the center audio track is the voice-over. The specific implementation steps are as follows:

[0073] Step 1: Decode the audio and video streams of the TV channel to form 6 audio tracks and corresponding metadata information, forming 6 PCM audio signals (left and right main channels LR, center channel C, left and right surround channels SR / LR and a subwoofer channel SW);

[0074] Step 2: Receive the program information. If the current program has no special audio description, the audio signal stream is transparently transmitted to the audio rendering output module and broadcast as a normal 5.1 audio signal. If there is a voice-over mark in the program, the audio signal is input into the audio signal preprocessing module;

[0075] Step three: The preprocessing module preprocesses the input audio stream, copies the voice-over audio (generally the center audio track) in the original audio signal to form a new audio signal stream, i.e., an audio stream, and compiles metadata information for this audio signal stream (i.e., the second object metadata information). The metadata information includes the name of the audio object, whether it supports interaction, the initial volume, and the initial position, so that this audio signal becomes a sound object (i.e., AudioObject). Set the audio track (center audio track) in the original audio stream to a silent track. This can form a structure of 6 audio tracks forming a 5.1 sound bed channel plus a voice-over audio object, as well as metadata information describing the audio stream;

[0076] Step 4: Based on the metadata information of the audio stream, initialize the volume, direction and other information of the audio track used for interaction; and the rendering module renders the pre-processed sound bed, sound object and metadata information audio into an audio signal output of the specified speaker layout.

[0077] Step 5: During the video stream playback process, the player provides an interactive function between the user and the playback terminal, and adjusts the corresponding metadata through the metadata processing module to adjust the rendering effect, where the adjustment includes muting, volume adjustment, sound direction adjustment, etc.

[0078] The method of using metadata to control audio rendering to achieve audio track interaction in the embodiment of the present application makes full use of existing production resources and transmission resources without changing the television broadcast system and the television channel transmission system. Through adaptation at the playback terminal, the voice-over in the traditional television audio can be muted, the volume adjusted, the spatial position changed, etc., which can improve the user experience of traditional television audio.

[0079] Figure 3 A structural block diagram of an audio stream processing device for implementing an embodiment of the present application.

[0080] The audio stream processing device provided in the embodiment of the present application includes the following functional modules:

[0081] The decoding module 301 is used to decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track;

[0082] The judging module 302 is used to judge whether the currently received program list information contains a voice-over mark;

[0083] A preprocessing module 303 is used for preprocessing the audio stream to obtain a voice-over audio stream, and generating second audio object metadata information for the voice-over audio stream when the program list information includes a voice-over identifier;

[0084] The audio track adjustment module 304 is used to set the target audio track corresponding to the voice-over in the N audio tracks as a silent audio track;

[0085] The first calling module 305 is used to call the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the second audio object metadata information to obtain and output a target audio rendering signal.

[0086] Optionally, the device further comprises:

[0087] The second calling module is used to call the audio rendering module to render the audio stream after the judgment module determines whether the currently received program list information contains a voice-over identifier, if the program list information does not contain a voice-over identifier, to obtain a target audio rendering signal and output it.

[0088] Optionally, the N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel; wherein the target audio track is the center audio track.

[0089] Optionally, the preprocessing module includes:

[0090] The first submodule is used for copying the voice-over audio stream in the audio stream when the program list information includes a voice-over identifier;

[0091] The second submodule is used to generate second audio object metadata information for the copied voice-over audio stream to make the voice-over audio stream a sound object, wherein the second audio object metadata information includes: an audio object name, an identifier indicating whether interaction is supported, an initial volume, and an initial position.

[0092] Optionally, the first calling module includes:

[0093] A third submodule, configured to initialize parameters of the audio track for user interaction based on the metadata information and the second audio object metadata information;

[0094] The fourth submodule is used to call the audio rendering module to perform audio rendering on the adjusted audio stream and the voice-over audio stream, obtain a target audio rendering signal that matches the designated speaker, and output the target audio rendering signal to the designated speaker.

[0095] Optionally, the device further comprises:

[0096] A receiving module, configured to receive an adjustment operation on the metadata information and / or the metadata information of the second audio object, wherein the adjustment operation includes at least one of the following: muting, volume adjustment, and sound orientation adjustment;

[0097] The response module is used to modify the corresponding audio object metadata information in response to the adjustment operation.

[0098] In another aspect of the implementation of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; the memory is used to store computer programs; and the processor is used to implement any of the above-mentioned audio stream processing methods when executing the program stored in the memory.

[0099] The embodiments of the present application provide Figure 3 The audio stream processing device shown can realize Figure 1 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0100] The audio stream processing device provided in the embodiment of the present application can, without changing the television broadcast system and the television channel transmission system, be adapted on the playback terminal through software to achieve separate control of the voice-over and ambient sound in the traditional television accompaniment, such as muting the voice-over, adjusting the volume, changing the spatial position, etc., thereby improving the user experience of the traditional television accompaniment.

[0101] An embodiment of the present invention further provides an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus.

[0102] Memory, used to store computer programs;

[0103] The processor is used to implement the audio stream processing method shown in the above method embodiment when executing the program stored in the memory.

[0104] The communication bus mentioned in the above terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0105] The communication interface is used for communication between the above terminal and other devices.

[0106] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0107] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0108] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer, the computer implements the audio stream processing method described in any one of the above embodiments.

[0109] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is executed on a computer, the computer implements the audio stream processing method described in any one of the above embodiments.

[0110] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0111] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. An audio stream processing method, characterized in that: The method comprises: Decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track; Determine whether the currently received program list information contains a voice-over identifier; In a case where the program list information includes a voice-over identifier, preprocessing the audio stream to obtain a voice-over audio stream, and generating second audio object metadata information for the voice-over audio stream; Setting the target audio track corresponding to the voice-over in the N audio tracks as a silent audio track; The audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the metadata information of the second audio object, to obtain and output a target audio rendering signal.

2. The method according to claim 1, characterized in that After the step of determining whether the currently received program list information contains a voice-over identifier, the method further includes: In the case that the program list information does not include a voice-over identifier, an audio rendering module is called to render the audio stream to obtain and output a target audio rendering signal.

3. The method according to claim 1, characterized in that The N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel; wherein the target audio track is the center audio track.

4. The method according to claim 1, characterized in that: In the case where the program list information includes a voice-over identifier, the step of preprocessing the audio stream to obtain a voice-over audio stream, and generating second audio object metadata information for the voice-over audio stream includes: In the case where the program list information includes a voice-over identifier, copying the voice-over audio stream in the audio stream; Generate second audio object metadata information for the copied voice-over audio stream to make the voice-over audio stream a sound object, wherein the second audio object metadata information includes: an audio object name, an identifier for indicating whether interaction is supported, an initial volume, and an initial position.

5. The method according to claim 1, characterized in that The step of calling the audio rendering module, performing audio rendering on the adjusted audio stream and the voice-over audio stream based on the metadata information and the metadata information of the second audio object, obtaining a target audio rendering signal and outputting the signal includes: Initialize parameters of the audio track for user interaction based on the metadata information and the second audio object metadata information; An audio rendering module is called to perform audio rendering on the adjusted audio stream and the voice-over audio stream to obtain a target audio rendering signal that matches a designated speaker, and the target audio rendering signal is output to the designated speaker.

6. The method according to claim 1, characterized in that The method further comprises: Receiving an adjustment operation on the metadata information and / or the metadata information of the second audio object, wherein the adjustment operation includes at least one of the following: muting, volume adjustment, and sound orientation adjustment; In response to the adjustment operation, the corresponding audio object metadata information is modified.

7. An audio stream processing device, characterized in that: The device comprises: A decoding module, used to decode the input audio stream to generate N audio tracks and metadata information and audio signals corresponding to each audio track; A judging module, used for judging whether the currently received program list information contains a voice-over mark; A preprocessing module, configured to preprocess the audio stream to obtain a voice-over audio stream, and generate second audio object metadata information for the voice-over audio stream when the program list information includes a voice-over identifier; An audio track adjustment module, used for setting a target audio track corresponding to the voice-over in the N audio tracks as a silent audio track; The first calling module is used to call the audio rendering module, and based on the metadata information and the second audio object metadata information, performs audio rendering on the adjusted audio stream and the voice-over audio stream to obtain and output a target audio rendering signal.

8. The device according to claim 7, characterized in that The device also includes: The second calling module is used to call the audio rendering module to render the audio stream after the judgment module determines whether the currently received program list information contains a voice-over identifier, if the program list information does not contain a voice-over identifier, to obtain a target audio rendering signal and output it.

9. The device according to claim 7, characterized in that The N audio tracks include: an audio track corresponding to the left main channel, an audio track corresponding to the right main channel, a center audio track corresponding to the center channel, an audio track corresponding to the left surround channel, an audio track corresponding to the right surround channel, and an audio track corresponding to the subwoofer channel; wherein the target audio track is the center audio track.

10. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; The processor is used to implement the audio stream processing method as described in any one of claims 1 to 6 when executing the program stored in the memory.

Images