Directing processing method, device, directing processing device and storage medium

Abstract

The embodiments of the present application provide a director processing method, device, director processing device and storage medium, which continuously and stably plays a background stream; wherein the background stream is mixed with at least one substream to form a director stream; monitors the status of each substream, the status includes: interruption and recovery; manages the corresponding substream according to the status of each substream monitored, including: pausing the playback of the interrupted substream; determining the substream to be restored after the interruption; for the substream restored after the interruption, refer to the clock of the time axis of the background stream to synchronize the restored substream; and perform the mixing process on the restored substream to obtain continued broadcast. By providing a permanent and stable background stream, the director stream is maintained to be continuous, stable and uninterrupted, and each substream is dynamically connected to mix the screen with the background stream. The substream is synchronized by using the time axis of the background stream as a reference clock to achieve breakpoint resumption, and flexibly supports the substream to be connected, disconnected, and removed at any time.

Description

Technical Field

[0001] The present application relates to the technical field of director mixing, and in particular to a director processing method, device, director processing device and storage medium. Background Art

[0002] Mixing audio and video is the core technology of director processing, that is, multiple real-time streams are switched, scaled, mixed, and mixed in the cloud, and finally synthesized into one director stream for terminal distribution and playback. The functions of the traditional director console can be realized in the cloud with fewer resources, which can be widely used in game live broadcast, online education, sports live broadcast, video entertainment interaction and other industries.

[0003] When the network transmission is unstable, the existing broadcast processing technology has the following problems:

[0004] 1. Frequent freezes and interruptions occur in each sub-stream, causing the director stream to play unsmoothly and the picture to be interrupted;

[0005] 2. Each sub-stream may be interrupted and restored at any time, making it difficult to achieve synchronization between sub-streams.

[0006] 3. Poor flexibility, sub-flows cannot be added or removed arbitrarily.

[0007] To solve the problem of sub-stream interruption, related technologies include a method of performing frame-filling processing on the disconnection duration of the interrupted sub-stream so that the broadcast can be resumed when it is restored. However, under this solution, even if a large number of sub-streams are interrupted, the calculation of multiple sub-streams must be maintained, which unnecessarily occupies resources.

[0008] Invention News

[0009] In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide a director processing method, device, director processing device and storage medium and medium to solve the above-mentioned problems.

[0010] The first aspect of the present application provides a director processing method, comprising: continuously playing a background stream; wherein the background stream is mixed with at least one sub-stream to form a director stream; monitoring the status of each sub-stream, the status including: interruption and recovery; managing the corresponding sub-stream according to the status of each sub-stream monitored, including: pausing the playback of the interrupted sub-stream; determining the sub-stream to be resumed after the interruption; for the sub-stream to be resumed after the interruption, refer to the clock of the time axis of the background stream to synchronize the resumed sub-stream; and performing the mixing processing on the resumed sub-stream to obtain a resumed broadcast.

[0011] In some embodiments of the first aspect, the mixing process includes: audio mixing and screen mixing process.

[0012] In some embodiments of the first aspect, the background stream is played silently.

[0013] In some embodiments of the first aspect, the background stream includes: a background image and a silent frame outputted at a preset frame rate and sampling rate.

[0014] In some embodiments of the first aspect, the background image includes one of the following: a black screen, a gray screen, a color screen, and a preset signal interruption image.

[0015] In some embodiments of the first aspect, the managing the corresponding substream according to the state of each monitored substream further includes: inserting a newly accessed substream; and releasing a removed substream.

[0016] The second aspect of the present application provides a director processing device, including: a background stream generation module, which is used to continuously play a background stream; wherein the background stream is mixed with at least one sub-stream to form a director stream; a sub-stream management module, which is used to monitor the status of each sub-stream, and the status includes: interruption and recovery; and manage the corresponding sub-stream according to the status of each sub-stream monitored, including: pausing the playback of the interrupted sub-stream; determining the sub-stream to be restored after interruption; a synchronization module, which is used to synchronize the restored sub-stream with reference to the clock of the time axis of the background stream for the restored sub-stream after interruption; a mixing processing module, which is used to perform the mixing processing on the restored sub-stream to obtain a resumed broadcast.

[0017] In some embodiments of the second aspect, the mixing process includes: audio and screen mixing processing.

[0018] The third aspect of the present application provides a director processing device, including: a communicator, a memory and a processor; the communicator is used to communicate with the outside; the memory is used to store program instructions; the processor is used to run the program instructions to execute the director processing method as described in any one of the first aspects.

[0019] A fourth aspect of the present application provides a computer-readable storage medium storing program instructions, wherein the program instructions are executed to execute the director processing method as described in any one of the first aspects.

[0020] As described above, the embodiments of the present application provide a director processing method, device, director processing device and storage medium, which continuously and stably plays a background stream; wherein the background stream is mixed with at least one substream to form a director stream; monitors the status of each substream, the status includes: interruption and recovery; manages the corresponding substream according to the status of each substream monitored, including: pausing the playback of the interrupted substream; determining the substream to be restored after the interruption; for the substream to be restored after the interruption, refer to the clock of the time axis of the background stream to synchronize the restored substream; and perform the mixing process on the restored substream to obtain continued broadcast. By providing a resident and stable background stream, the director stream is maintained to be continuous, stable and uninterrupted, and each substream is dynamically connected to mix the screen with the background stream. The substream is synchronized by using the time axis of the background stream as a reference clock to achieve breakpoint resumption, and flexibly supports the substream to be connected, disconnected, and removed at any time. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram showing the principle of adding frames to sub-stream interruptions in the director processing in the related art.

[0022] Figure 2 A flowchart showing a director processing method in one embodiment of the present application is shown.

[0023] Figure 3 A schematic diagram showing the principle of a director processing method in one embodiment of the present application.

[0024] Figure 4 A schematic diagram of the functional modules of a director processing device in one embodiment of the present application is shown.

[0025] Figure 5 A schematic diagram of the circuit structure of a director processing device in one embodiment of the present application is shown.

[0026] Figure 6 A schematic diagram showing the actual application flow of the director processing device in one embodiment of the present application. DETAILED DESCRIPTION

[0027] The following is an explanation of the implementation of the present application by specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the information disclosed in the present application. The present application can also be implemented or applied through other different specific implementations, and the details in the present application can also be modified or changed in various ways according to different viewpoints and application systems without departing from the spirit of the present application. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0028] The following is a detailed description of the embodiments of the present application with reference to the accompanying drawings so that those skilled in the art can easily implement the present application. The present application can be embodied in a variety of different forms and is not limited to the embodiments described herein.

[0029] In the representations of the present application, the representations with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean that the specific features, structures, materials or characteristics represented in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the represented specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples represented in the present application and the features of the different embodiments or examples, unless they contradict each other.

[0030] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the representation of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0031] In order to clearly describe the present application, components irrelevant to the description are omitted, and the same reference symbols are given to the same or similar components throughout the specification.

[0032] Throughout the specification, when a device is said to be "connected" to another device, this includes not only the case of "direct connection" but also the case of "indirect connection" by placing other elements therebetween. In addition, when a device is said to "include" a certain component, unless otherwise stated, it does not exclude other components, but means that other components may be included.

[0033] Although the terms first, second, etc. are used to represent various elements in this article in some examples, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first interface and the second interface, etc. are represented. Moreover, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, modules, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, modules, projects, kinds, and / or groups. The terms "or" and "and / or" used herein are interpreted as inclusive, or mean any one or any combination. Therefore, "A, B or C" or "A, B and / or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C". Only when the combination of elements, functions, steps or operations is inherently mutually exclusive in some way, will there be an exception to this definition.

[0034] The technical terms used herein are only used to refer to specific embodiments and are not intended to limit the present application. The singular form used herein also includes the plural form unless the sentence clearly indicates the contrary meaning. The meaning of "including" used in the specification is to specify specific characteristics, regions, integers, steps, operations, elements and / or components, and does not exclude the existence or addition of other characteristics, regions, integers, steps, operations, elements and / or components.

[0035] Although not defined differently, all terms, including technical and scientific terms used herein, have the same meaning as those generally understood by those skilled in the art to which this application belongs. Terms defined in commonly used dictionaries are additionally interpreted as having meanings consistent with relevant technical literature and the message of the present disclosure, and as long as they are not defined, they should not be overly interpreted as ideal or very formal meanings.

[0036] In the related technologies, audio and video mixing is the core technology in the director processing. Specifically, audio and video mixing is a technology that processes multiple sub-streams through audio and video mixing to form a director stream for playback. However, this technology still has various problems, such as: each sub-stream frequently freezes and interrupts, resulting in unsmooth playback of the director stream and interrupted images; after the interruption, it is difficult to synchronize the sub-streams. The flexibility is poor, and the sub-streams cannot be arbitrarily connected or removed.

[0037] In order to solve the problem of recovering from a substream breakpoint, there is a method in the related art of performing frame-adding processing on the disconnection time of the interrupted substream.

[0038] like Figure 1As shown, a schematic diagram showing the principle of supplementing frames for sub-stream interruptions in director processing in an example is shown.

[0039] Figure 1 The upper middle part shows the application of mixing substreams 1 to N for the director stream. For example, the screen mixing means that substreams 1 to N occupy a window in the playback screen of the director stream respectively, and the audio mixing means that their audios are played together.

[0040] exist Figure 1 The lower middle part shows the timing diagram of the interruption frame filling of sub-streams 1 to N. The solid line part in the figure represents the normal playback time, and the dotted line part in the figure represents the time when the playback is interrupted and the frame filling is required. The breakpoint frame during the interruption is delayed by filling the frame until the sub-stream is restored and the playback is resumed from this breakpoint frame.

[0041] However, in this case, even if a substream is interrupted, it still needs to be frame-filled and then mixed with other substreams to form a director stream. In other words, if there are N substreams, they all need to be mixed. Even if a large number of substreams are interrupted or even all of them are interrupted, the frame-filling, mixing and screen-mixing calculations of multiple substreams must be maintained, which unnecessarily occupies resources.

[0042] In view of this, a director processing method is provided in an embodiment of the present application to solve the above-mentioned problem.

[0043] like Figure 2 As shown, a flow chart of the director processing method in one embodiment of the present application is shown.

[0044] The process of the broadcast director processing method includes:

[0045] Step S201: Continuously play a background stream.

[0046] The background stream is mixed with at least one sub-stream to form a director stream. In some embodiments, the mixing process includes: audio and screen mixing; or, in other embodiments, only screen mixing or only audio mixing can be performed depending on the situation.

[0047] In some embodiments, the background stream is played in silence, that is, it does not affect the mixed playback of the substream. In a possible example, the background stream includes: a background image and a silent frame output at a preset frame rate and sampling rate. The background image includes one of the following: a black screen, a gray screen, a color screen, and a preset signal interruption image.

[0048] Step S202: monitoring the status of each sub-flow, the status including: interruption and recovery;

[0049] Step S203: managing the corresponding substream according to the state of each monitored substream, including: pausing the playback of the interrupted substream; determining the substream to be resumed;

[0050] Therefore, the interrupted sub-stream does not need to be mixed or screen mixed.

[0051] Step S204: For the sub-stream that is restored after interruption, refer to the clock of the time axis of the background stream to synchronize the restored sub-stream.

[0052] Specifically, the synchronization is performed on all normal sub-streams (non-interrupted, ie, not interrupted or restored from interruption).

[0053] Step S205: performing the mixing process on the restored sub-streams to obtain a continuous broadcast.

[0054] Therefore, a reliable clock is obtained by using the time axis of the resident stable background stream to synchronize the substreams, so as to achieve breakpoint resumption of the substream after interruption. Only the audio and screen mixing calculations need to be performed on the normal substreams.

[0055] Through the resident and stable background stream, continuous playback is performed, and the pause or mixing screen processing is dynamically selected according to the interruption or recovery status of the sub-stream, and the background stream that is continuously and stably played can provide a reliable timeline. The timeline provides a reliable clock for synchronizing the sub-stream, so that the interrupted and restored sub-stream can be resumed at the recovery time point without the need for frame filling processing. It can be seen that through this method, on the one hand, continuous and stable output is maintained through the background stream, which improves the related technology that only relies on sub-stream mixing and screen mixing, and the playback is stuck and interrupted when the sub-stream is interrupted; on the other hand, the function of breakpoint resumption is also realized to improve the user experience; on the other hand, there is no need to maintain frame filling and mixing and screen mixing processing for the interrupted sub-stream, and the amount of calculation is positively correlated with the sub-stream played normally, saving computing resources.

[0056] In addition, the management of step S203 may also include the insertion of newly added substreams and the release of removed substreams. It is understandable that due to the supporting role of the background stream, the addition and removal of other substreams will not affect the playback of the background stream, nor will it affect the normal playback of the corresponding director stream, thus achieving flexible management of substream addition and removal.

[0057] To illustrate the above advantages more intuitively, Figure 3 As shown, a schematic diagram showing the principle of the director processing method in one embodiment of the present application is shown.

[0058] like Figure 3As shown in the upper middle part, after adding the background stream, a "virtual switch" between the sub-stream and the background stream is implemented in the embodiment of the present application, which can choose to "connect" or "disconnect" with the background stream according to the status of sub-stream 1 to sub-stream N. "Connection" means that the normal sub-stream, the newly connected sub-stream and the background stream are mixed and processed into the director stream, and "disconnection" means that the interrupted sub-stream and the removed sub-stream are disconnected from the background stream, and there is no longer any mixing and screen processing relationship. Therefore, it supports arbitrary access and removal of sub-streams, interruption and synchronization at any time, which is more flexible and in line with actual scenarios.

[0059] Figure 3 The lower middle part is used to illustrate the principle of breakpoint resume. Substream 1 is interrupted at t0 and resumed at t5; substream 2 is interrupted at t2 and resumed at t4; substream 3 is interrupted at t1 and resumed at t3; substream N is interrupted at t0 and resumed at t6. Therefore, the interrupted substream 1 and substream N are paused at t0, the interrupted substream 3 is paused at t1, and the interrupted substream 2 is paused at t2; then, at t3, the restored substream 3 is aligned with the clock synchronization of the background stream; at t4, the restored substream 2 is aligned with the clock synchronization of the background stream; at t5, the restored substream 1 is aligned with the clock synchronization of the background stream; at t6, the restored substream N is aligned with the clock synchronization of the background stream. Synchronous breakpoint resume of each substream is achieved.

[0060] like Figure 4 As shown, a functional module diagram of the broadcast director processing device in the embodiment of the present application is shown. The implementation of the broadcast director processing device can refer to the previous broadcast director processing method embodiment, so the same technical content will not be repeated in this example.

[0061] Please refer to Figure 4 , the broadcast director processing device includes:

[0062] A background stream generation module 401 is used to continuously play a background stream; wherein the background stream is mixed with at least one sub-stream to form a direct broadcast stream;

[0063] The substream management module 402 is used to monitor the status of each substream, including: interruption and resumption; and manage the corresponding substream according to the status of each substream monitored, including: pausing the playback of the interrupted substream; determining the substream to be resumed;

[0064] A synchronization module 403, configured to synchronize the restored substream with reference to the clock of the time axis of the background stream;

[0065] The mixing processing module 404 is used to perform the mixing processing on the restored sub-streams to obtain the continued broadcast.

[0066] In some embodiments, the mixing process includes: audio mixing and screen mixing.

[0067] It should be noted that in Figure 4 Each functional module in the embodiment can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a program instruction product. The program instruction product includes one or more program instructions. When loading and executing program instructions on a computer, the process or function according to the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable devices. The program instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0068] and, Figure 4 The device disclosed in the embodiment can be implemented by other module division methods. The device embodiments shown above are only schematic. For example, the module division is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or modules can be combined or dynamically transferred to another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical or other forms.

[0069] in addition, Figure 4 Each functional module and submodule in the embodiment can be dynamically in a processing component, or each module can exist physically separately, or two or more modules can be dynamically in one component. The above-mentioned dynamic components can be implemented in the form of hardware or in the form of software functional modules. If the above-mentioned dynamic components are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a disk or an optical disk, etc.

[0070] like Figure 5 As shown, a circuit structure diagram of the director processing device in an embodiment of the present application is shown.

[0071] In some embodiments, the director processing device 500 can be deployed on a server or edge computing device in the cloud, for example, to realize the director function, and can be widely used in industries such as game live broadcast, online education, sports live broadcast, video entertainment interaction, etc. In particular, being deployed on an edge computing device can effectively lower the entry threshold of cloud director technology. Possibly, the edge computing device can be, for example, an edge computing node in a wireless 5G network.

[0072] The broadcast processing device 500 includes a bus 501, a processor 502, a memory 503, and a communicator 504. The processor 502 and the memory 503 can communicate with each other through the bus 501. The memory 503 may store program instructions (such as system or application software). The processor 502 implements the previous embodiment (such as Figure 2 ) in the method.

[0073] The bus 501 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, although Figure 5 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0074] In some embodiments, the processor 502 may be implemented as a central processing unit (CPU), a microprocessing unit (MCU), a system on chip (System On Chip), or a field programmable logic array (FPGA). The memory 503 may include a volatile memory (Volatile Memory) for temporary storage of data when running a program, such as a random access memory (Random Access Memory, RAM).

[0075] The memory 503 may also include a non-volatile memory (non-volatile memory) for data storage, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid-state disk (SSD).

[0076] The communicator 504 is used to communicate with the outside. In a specific example, the communicator 504 may include one or more wired and / or wireless communication circuit modules. For example, the communicator 504 may include one or more of a wired network card, a USB module, a serial interface module, etc. The wireless communication protocol followed by the wireless communication module includes: for example, near field communication (NFC) technology, infrared (IR) technology, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth (BT), global navigation satellite system (GNSS), etc. One or more.

[0077] like Figure 6 As shown, a schematic diagram of the actual application process of the director processing device in one embodiment of the present application is shown.

[0078] Figure 6 The process includes:

[0079] Step S601: Start the input threads of multiple sub-streams;

[0080] Step S602: Start the background stream generation module to output the background image and the silent frame at a fixed frame rate and sampling rate. The background image can be a black screen, a gray screen, a color screen or a specific signal interruption image;

[0081] Step S603: Monitor the substream status through the substream management module. If the substream is interrupted or restored, disconnect or open the substream through the "virtual switch"; if a new substream is connected, insert the substream; if the substream is removed, release the substream;

[0082] Step S604: Receive the background stream and all the normal streams that are input through the synchronization module, and use the time axis of the background stream as a reference clock to align the sub-streams for synchronization.

[0083] For example Figure 3 In the example, at t0, t1, and t2, the substream is interrupted and the processing of the substream is suspended; at t3, t4, and t5, the substream returns to normal and the processing of the substream is resumed and aligned with the t3, t4, and t5 of the background stream to achieve the continued broadcast and synchronization of the substream.

[0084] Step S605: performing audio and screen mixing processing on the synchronized background stream and sub-stream;

[0085] Step S606: outputting the mixed broadcast stream;

[0086] Steps S602-S606 are repeated until the task stops.

[0087] It should be noted that the process or method represented by the flowchart of the above embodiment of the present application can be understood as a module, fragment or part of a code that represents one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiment of the present application includes other implementations, in which the functions may not be performed in the order shown or discussed, including performing the functions in a substantially simultaneous manner or in a reverse order according to the functions involved.

[0088] For example, Figure 2 The order of the steps in the embodiments may be changed in specific scenarios and is not limited to the above.

[0089] In an embodiment of the present application, a computer-readable storage medium may be provided, which stores program instructions, and the program instructions are executed to execute the aforementioned method flow embodiment (for example, Figure 2 ) to perform the process steps.

[0090] That is, the method steps in the above embodiments are implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or are implemented as computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded via a network and to be stored in a local recording medium, so that the method represented herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA).

[0091] In summary, the embodiments of the present application provide a director processing method, device, director processing device and storage medium, which continuously and stably plays a background stream; wherein the background stream is mixed with at least one substream to form a director stream; monitors the status of each substream, the status includes: interruption and recovery; manages the corresponding substream according to the status of each substream monitored, including: pausing the playback of the interrupted substream; determining the substream to be restored after the interruption; for the substream to be restored after the interruption, refer to the clock of the time axis of the background stream to synchronize the restored substream; and perform the mixing process on the restored substream to obtain continued broadcast. By providing a permanent and stable background stream, the director stream is maintained to be continuous, stable and uninterrupted, and each substream is dynamically connected to mix the screen with the background stream. The substream is synchronized by using the time axis of the background stream as a reference clock to achieve breakpoint resumption, and flexibly supports the substream to be connected, disconnected, and removed at any time.

[0092] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A broadcast processing method, characterized in that: include: Continuously play multiple sub-streams of mixed audio and mixed screen and a background stream, wherein the background stream includes a background image and a silent frame output at a preset frame rate and sampling rate; wherein the background stream is mixed with at least one sub-stream to form a director stream, wherein the mixing process includes at least one of mixing audio and mixing screen; Monitor the status of each sub-flow, including: interruption and recovery; The corresponding substream is managed according to the state of each monitored substream, including: pausing the playback of the interrupted substream, and no longer performing audio and video mixing processing on the interrupted substream; and determining the substream to be resumed after the interruption; For the substream that is restored after interruption, refer to the clock of the time axis of the background stream to synchronize the restored substream; The restored substreams are mixed to obtain continued broadcasting.

2. The broadcast processing method according to claim 1, characterized in that: The background stream plays silently.

3. The broadcast processing method according to claim 1, characterized in that: The background image includes one of the following: a black screen, a gray screen, a color screen, and a preset signal interruption image.

4. The broadcast processing method according to claim 1, characterized in that: The managing of the corresponding substream according to the state of each monitored substream also includes: inserting a newly accessed substream; and releasing a removed substream.

5. A broadcast processing device, characterized in that: include: A background stream generation module is used to continuously play multiple sub-streams of mixed audio and mixed screen and a background stream, wherein the background stream includes a background image and a silent frame output at a preset frame rate and sampling rate; wherein the background stream is mixed with at least one sub-stream to form a director stream, wherein the mixing process includes at least one of mixing audio and mixing screen; The substream management module is used to monitor the status of each substream, including: interruption and recovery; and manage the corresponding substream according to the status of each substream monitored, including: pausing the playback of the interrupted substream, stopping the mixing and screen mixing processing of the interrupted substream; and determining the interrupted and recovered substream; A synchronization module, used for synchronizing the substream restored after interruption with reference to the clock of the time axis of the background stream to synchronize the restored substream; The mixing processing module is used to perform the mixing processing on the restored sub-streams to obtain the continued broadcast.

6. A broadcast processing device, characterized in that: include: Communicator, memory and processor; The communicator is used for communicating with the outside; The memory is used to store program instructions; the processor is used to run the program instructions to execute the broadcast directing processing method as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that: Program instructions are stored, and the program instructions are executed to perform the broadcast directing processing method as described in any one of claims 1 to 4.

Images