Multi-scene live broadcast system
The multi-scenario live broadcast system addresses acquisition, encoding, and transmission inefficiencies by employing advanced technologies, enhancing data processing and interaction to provide high-quality, stable, and interactive live streaming services.
Patent Information
- Application Number
- CN202411285209.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2024-12-31
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing live broadcast systems face challenges in multi-scenario applications due to insufficient distributed deployment of audio and video acquisition, low data compression efficiency, unstable transmission, and inadequate processing and optimization of audio and video data, leading to issues with quality and fluency.
A multi-scenario live broadcast system comprising modules for acquisition, encoding, transmission, processing, storage, and interaction, utilizing advanced encoding technologies like AAC and H.264, synchronized audio and video acquisition, and real-time data transmission methods to enhance data processing and interaction.
The system improves data compression efficiency, transmission stability, and interactive experience, ensuring high-quality live streaming with reduced freezes and distortions, and supports diverse live streaming scenarios.
Smart Images

Figure CN119232963A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of live broadcast systems, and in particular to a multi-scenario live broadcast system. Background Art
[0002] With the rapid development of the live broadcast industry, the demand for multi-scenario live broadcast is growing. Existing live broadcast systems usually include basic modules such as acquisition, encoding, transmission, processing, storage, and playback. However, there are still some shortcomings in the application of multi-scenario live broadcast. For example, the existing live broadcast system may not meet the needs of distributed deployment in terms of audio and video acquisition, resulting in insufficient and comprehensive collected materials; in the encoding and transmission process, there may be problems such as low data compression efficiency and unstable transmission, which affect the quality and fluency of live broadcast; in terms of processing and interaction, there may be a lack of effective processing and optimization of audio and video data, as well as enhanced interactive experience between users.
[0003] The shortcomings of the existing live broadcast system in multi-scenario live broadcast are specifically manifested in the imperfect distributed deployment of the acquisition module, which affects the acquisition of materials. The efficiency and effect of data encoding processing need to be improved, resulting in problems in data compression and transmission. The processing and optimization capabilities of audio and video data are insufficient, and cannot meet the needs of multi-scenario live broadcast. Summary of the invention
[0004] The purpose of the present invention is to provide a multi-scene live broadcast system, which solves the shortcomings of multi-scene live broadcast in the background technology. The efficiency and effect of data encoding and processing need to be improved, resulting in problems in data compression and transmission, and insufficient processing and optimization capabilities for audio and video data, which cannot meet the needs of multi-scene live broadcast. The present invention ensures efficient and stable data transmission and enhances the processing and correction capabilities of audio and video data by optimizing data encoding and processing.
[0005] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0006] A multi-scenario live broadcast system comprises an acquisition module, an encoding module, a transmission module, a processing module, a storage module, a playback module and an interactive module, wherein the acquisition module is used to obtain original video and audio data to provide basic materials for subsequent processing and live broadcast, the encoding module is used to compress and encode the acquired audio and video data, the transmission module is used to ensure efficient transmission of audio and video data between a client and a server, the processing module is used to process and correct the audio and video data, the storage module is used to save data during the live broadcast process for subsequent playback and analysis, the playback module is used to provide users with ways and methods for watching live broadcasts, and the interactive module is used to enhance the interactive experience between users.
[0007] Preferably, an audio acquisition unit and a video acquisition unit are provided in the acquisition module, the audio acquisition unit and the video acquisition unit are synchronized, the audio acquisition unit performs audio acquisition through a microphone, and the video acquisition unit performs video acquisition through a camera, and the microphone and the camera are both deployed in a distributed manner.
[0008] Preferably, an audio encoding unit and a video encoding unit are provided in the encoding module, and the audio encoding unit and the video encoding unit are used to encode the audio and the video respectively.
[0009] Preferably, the audio encoding unit uses an AAC encoder to compress the audio, and the AAC encoder uses MDCT to convert the audio data in the time domain to the frequency domain. The specific calculation formula is as follows:
[0010]
[0011] Where: X(k) is the transformed coefficient, x(n) is the original audio sample, and N is the block size.
[0012] Preferably, the video encoding unit adopts an H.264 encoder to convert the image block from the pixel domain to the frequency domain through discrete cosine transform, and the calculation formula is as follows:
[0013]
[0014] Where: C(u, v) is the transformed coefficient, f(x, y) is the original pixel value, N is the size of the block, and u and v are frequency coordinates.
[0015] Preferably, the video encoding unit needs to perform quantization processing after converting the video data through the H.264 encoder, as follows:
[0016]
[0017] Where: Q(i, j) is the quantization step size, C(i, j) is the transformed coefficient, and Q(i, j) is the quantized coefficient.
[0018] Preferably, the transmission module is provided with a sending unit and a receiving unit, the sending unit is used to send the encoded audio and video data from the client to the server, the receiving unit is used to receive the audio and video data from the server at the client, and the sending unit and the receiving unit use RTSP and RTP methods for real-time data transmission.
[0019] Preferably, the processing module is provided with a data processing unit, an audio and video mixing unit and a special effect processing unit, the data processing unit is used to optimize and distribute data from the client, the audio and video mixing unit is used to fuse multiple audio and video data, and the special effect processing unit is used to add special effects.
[0020] Preferably, the data processing unit is capable of performing data optimization and data distribution, and the audio and video mixing unit realizes the fusion of multiple audio and video through audio mixing, video superposition and color matching.
[0021] Preferably, the processing module processes and corrects the audio and video data including the following steps:
[0022] S1, input data reception: receiving audio and video data from the scene acquisition module;
[0023] S2, preprocessing: perform preliminary data optimization, such as denoising and gain adjustment;
[0024] S3, format conversion: convert the data into a unified format for subsequent processing;
[0025] S4, Special effects application: add various audio and video effects according to needs;
[0026] S5, audio and video mixing: combining the processed audio and video data;
[0027] S6. Output data optimization: optimize the final output data to ensure transmission quality;
[0028] S7. Output data distribution: Send the processed data to the live broadcast platform or other distribution channels.
[0029] Compared with the prior art, the beneficial effects achieved by the present invention are:
[0030] 1. The present invention can meet the needs of various scenarios such as live streaming with goods, online education, and entertainment live streaming by setting up an acquisition module, an encoding module, a transmission module, a processing module, a storage module, a playback module, and an interactive module, and provides a more flexible and diversified live streaming service. It adopts advanced encoding technologies, such as the AAC encoder and the H.264 encoder, and performs quantization processing to improve the compression efficiency and transmission stability of audio and video data, thereby improving the quality of live streaming images and sounds, and reducing problems such as freezes and distortions.
[0031] 2. The present invention can enhance the interactive experience. The setting of the interactive module enhances the interactive experience between users. Users can participate in the live broadcast through various interactive methods, which improves the user's sense of participation and satisfaction.
[0032] 3. The present invention can achieve data processing optimization. The data processing unit, audio and video mixing unit and special effect processing unit in the processing module can optimize and process the audio and video data with special effects, thereby improving the richness and attractiveness of the live broadcast content. The transmission is stable. The sending unit and the receiving unit in the transmission module use the RTSP method and the RTP method to transmit real-time data, thereby ensuring efficient and stable transmission of audio and video data between the client and the server. The storage module can save the data during the live broadcast process, which is convenient for subsequent playback and analysis, and provides more convenience and value for users. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 It is a system block diagram of the multi-scenario live broadcast system in the present invention;
[0034] Figure 2 It is a structural block diagram of the module in the present invention;
[0035] Figure 3 It is a flowchart of the processing module in the present invention. DETAILED DESCRIPTION
[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0037] See also Figure 1-3 A multi-scenario live broadcast system includes an acquisition module, an encoding module, a transmission module, a processing module, a storage module, a playback module and an interactive module. The acquisition module consists of a video acquisition unit and an audio acquisition unit, and is used to obtain original video and audio data to provide basic materials for subsequent processing and live broadcast. The encoding module consists of a video encoding unit and an audio encoding unit, and is used to compress and encode the collected audio and video data. The transmission module consists of a sending unit and a receiving unit, and is used to ensure efficient transmission of audio and video data between a client and a server. The processing module consists of a data processing unit, an audio and video mixing unit and a special effect processing unit, and is used to process and correct the audio and video data. The storage module consists of a real-time storage unit and an archiving unit, and is used to save data during the live broadcast process for subsequent playback and analysis. The playback module consists of a computer playback unit, a mobile phone playback unit and a TV playback unit, and is used to provide users with ways and methods to watch live broadcasts. The interactive module consists of a bullet screen processing unit, a gift management unit and a microphone control unit, and is used to enhance the interactive experience between users.
[0038] In this embodiment, the present invention can meet the needs of various scenarios such as live streaming with goods, online education, and entertainment live streaming by setting up an acquisition module, an encoding module, a transmission module, a processing module, a storage module, a playback module, and an interactive module, and provides more flexible and diversified live streaming services. It adopts advanced encoding technologies, such as the AAC encoder and the H.264 encoder, and performs quantization processing to improve the compression efficiency and transmission stability of audio and video data, thereby improving the quality of live broadcast images and sounds, and reducing problems such as freezes and distortions. In the acquisition module, a video acquisition unit such as a camera accurately captures the visual information of the live broadcast scene, including color, brightness, and dynamic images, through its optical elements and image sensors. An audio acquisition unit such as a microphone uses its sensitive acoustic elements to receive sound data, covering characteristics such as sound frequency, intensity, and timbre. These units together provide original audio and video materials for live broadcasts.
[0039] Specifically, the audio and video collection method is as follows:
[0040] Camera and Microphone Deployment:
[0041] Distributed deployment: High-definition cameras and high-quality microphones are deployed in different scenes to ensure that the image and sound of each scene can be clearly captured;
[0042] Multi-angle coverage: In each scene, multiple cameras are used to shoot from different angles to provide a full range of perspectives.
[0043] Audio and video synchronous acquisition:
[0044] Timestamp synchronization: By adding accurate timestamps to audio and video data, the synchronization of audio and video data during collection and transmission is ensured;
[0045] Hardware synchronization: Use hardware devices that support audio and video synchronous acquisition, such as synchronous acquisition cards, to ensure the synchronization of audio and video data.
[0046] Specifically, in the acquisition module, the video acquisition unit, such as the camera, uses its optical elements and image sensors to accurately capture the visual information of the live broadcast scene, including color, brightness and dynamic images. The audio acquisition unit, such as the microphone, uses its sensitive acoustic elements to receive sound data, covering the frequency, intensity and timbre of the sound. These units together provide the original audio and video materials for the live broadcast.
[0047] The video encoding unit of the encoding module, such as the H.264 encoder, uses a specific algorithm to compress video data, reducing the amount of data while maintaining a certain image quality. The audio encoding unit, such as the AAC encoder, efficiently compresses the audio to improve transmission and storage efficiency without significantly reducing the sound quality.
[0048] The sending unit of the transmission module is responsible for sending the encoded audio and video data in a suitable format and protocol to ensure that the data can reach the server accurately. The receiving unit receives the audio and video stream from the server on the client side, decodes and plays it;
[0049] The data processing unit of the processing module optimizes the received audio and video data, such as adjusting parameters such as brightness, contrast, and volume to improve data quality. The audio and video mixing unit merges multiple audio and video sources to achieve effects such as multi-person microphone connection or adding background music. The special effects processing unit adds special effects such as beauty, filters, and virtual backgrounds to the live broadcast to increase the viewing experience of the live broadcast.
[0050] The real-time storage unit of the storage module is used to quickly cache the current live broadcast data to cope with emergencies or temporary needs, and the archiving unit stores the historical live broadcast data for a long time and safely, which is convenient for subsequent review, analysis and retrieval;
[0051] The computer playback unit of the playback module uses the computer's hardware resources and software environment to provide a high-resolution, large-screen viewing experience, which is suitable for use at work or in fixed places. The mobile phone playback unit uses the portability of mobile phones to allow users to watch live broadcasts anytime and anywhere. The TV playback unit presents more immersive pictures and sound effects on large-screen TVs, which is suitable for family sharing.
[0052] The barrage processing unit of the interactive module receives and displays barrages sent by viewers, and conducts content review and management to create a good interactive atmosphere. The gift management unit handles the gift giving, display and settlement process to stimulate the audience's enthusiasm for participation. The microphone connection control unit manages the acceptance of microphone connection requests, audio and video switching, and permission control to achieve real-time interaction between the anchor and the audience.
[0053] Specifically, the encoding module is provided with an audio encoding unit and a video encoding unit, and the audio encoding unit and the video encoding unit are used to encode the audio and the video respectively;
[0054] The video encoding unit uses the H.264 encoder to convert the image block from the pixel domain to the frequency domain through discrete cosine transform. The calculation formula is as follows:
[0055]
[0056] Where: C(u, v) is the transformed coefficient, f(x, y) is the original pixel value, N is the size of the block, u and v are frequency coordinates;
[0057] The video encoding unit needs to perform quantization processing after converting the video data through the H.264 encoder, as follows:
[0058]
[0059] Where: Q(i, j) is the quantization step size, C(i, j) is the transformed coefficient, and Q(i, j) is the quantized coefficient;
[0060] The video encoding unit also uses entropy coding, as follows:
[0061] CAVLC: Select the appropriate code table for encoding based on the statistical characteristics of adjacent coefficients.
[0062] CABAC (Context-based Binary Arithmetic Coding): uses arithmetic coding to compress data more efficiently;
[0063] Since there will be movement in the video, there is also motion estimation and compensation. The motion vector is estimated by comparing the current image block with the block in the reference image, and then these vectors are used to predict the current block, and only the prediction error is encoded; intra-frame prediction and loop filtering are performed at the same time. For intra-frame coded blocks, the information of adjacent coded blocks is used to predict the content of the current block to reduce redundant information; loop filtering removes block effects and other compression artifacts during the encoding and decoding process to improve video quality; through the combined effect of these algorithms and technologies, the H.264 encoder can compress video data at a very high compression ratio while maintaining high video quality.
[0064] The audio encoding unit uses the AAC encoder to compress the audio. The AAC encoder uses MDCT to convert the time domain audio data to the frequency domain. The specific calculation formula is as follows:
[0065]
[0066] Where: is the transformed coefficient, is the original audio sample, and is the size of the block;
[0067] When performing audio quantization, the quantization process maps the coefficients after MDCT transformation to a limited range of values to reduce the number of bits required. The quantization formula is usually linear or nonlinear, depending on the quantization strategy. AAC uses Huffman coding to encode the quantized coefficients. The probability-based coding method can effectively compress data. Adaptive pulse code modulation is used to encode prediction errors. AAC uses linear prediction to estimate the current value of the audio data and then only encodes the prediction error. AAC divides the audio data into multiple frequency bands and encodes each frequency band separately to optimize the compression effect. It also uses the MDCT filter group to convert time domain data into frequency domain data and further divide it into multiple frequency bands.
[0068] Specifically, the processing module is provided with a data processing unit, an audio and video mixing unit and a special effect processing unit. The data processing unit is used to optimize and distribute data from the client, the audio and video mixing unit is used to fuse multiple audio and video data, and the special effect processing unit is used to add special effects. The data processing unit can optimize and distribute data, and the audio and video mixing unit realizes the fusion of multiple audio and video through audio mixing, video overlay and color matching.
[0069] In this embodiment: data optimization is performed by processing data in the following manner:
[0070] Digital data processing: Use digital filters (such as low-pass, high-pass, band-pass and band-stop filters) to remove unwanted frequency components and reduce noise and interference;
[0071] Dynamic range compression: adjusts the dynamic range of audio data to avoid excessive volume fluctuations and maintain volume consistency;
[0072] Gain control: Automatically or manually adjust the gain of audio and video data to optimize data strength;
[0073] Synchronization processing: ensuring the synchronization of audio and video data, which may involve timestamp alignment or frame rate conversion;
[0074] Data distribution is handled in the following ways:
[0075] Multiplexing: combining multiple audio and video data into a composite data stream for easy transmission and distribution;
[0076] Network adaptation: Dynamically adjust the data packet size and transmission rate according to network conditions to adapt to different network environments.
[0077] The audio and video mixing unit processes data in the following ways:
[0078] Mixing: Mixing multiple audio data together, which may involve volume balance, stereo image adjustment, and sound effect superposition;
[0079] Video overlay: Use video synthesis technology to combine multiple video data into one picture, which may include picture-in-picture, split-screen display or multi-layer overlay;
[0080] Color matching: adjust the color and brightness of different video sources to achieve visual harmony;
[0081] The special effects processing unit adds special effects to process data in the following ways:
[0082] Video effects: Apply graphics processing unit (GPU) accelerated algorithms such as color correction, image filtering, sharpening, blurring, and edge detection;
[0083] Audio effects: using digital data processing technology to add echo, reverb, equalizer effects, sound deformation;
[0084] Dynamic graphics: real-time rendering of 2D or 3D graphics, such as animations, charts, and text overlays;
[0085] Transition Effects: Add smooth transition effects such as fade, slide, wipe when switching scenes.
[0086] The processing module processes and corrects the audio and video data including the following steps:
[0087] S1, input data reception: receiving audio and video data from the scene acquisition module;
[0088] S2, preprocessing: perform preliminary data optimization, such as denoising and gain adjustment;
[0089] S3, format conversion: convert the data into a unified format for subsequent processing;
[0090] S4, Special effects application: add various audio and video effects according to needs;
[0091] S5, audio and video mixing: combining the processed audio and video data;
[0092] S6. Output data optimization: optimize the final output data to ensure transmission quality;
[0093] S7. Output data distribution: Send the processed data to the live broadcast platform or other distribution channels.
[0094] Specifically, the audio acquisition unit and the video acquisition unit in the acquisition module work synchronously. The audio acquisition unit collects sound through a microphone, and the video acquisition unit collects images through a camera. The two work synchronously to ensure the synchronization of audio and video, providing viewers with a real and coherent live broadcast experience. By using distributed deployment, the distributed deployment of microphones and cameras can more comprehensively cover the live broadcast scene, capture information from different angles and positions, enrich the collected materials, and meet the needs for diversified materials in multi-scene live broadcasts.
[0095] The audio encoding unit in the encoding module uses the AAC encoder to use MDCT to convert the audio data in the time domain to the frequency domain for compression. This compression method can reduce the amount of data while maintaining the audio quality as much as possible, making the sound in the live broadcast clear and smooth. The video encoding unit uses the H.264 encoder to convert the image block from the pixel domain to the frequency domain through discrete cosine transform, thereby achieving effective compression of the video data, reducing the storage space and transmission bandwidth requirements of the video data, and improving the transmission efficiency of the video. At the same time, it can also perform quantization processing. During the quantization processing, the video encoding unit performs quantization processing after converting the video data using the H.264 encoder, further compressing the data, making the video data easier to store and transmit, while ensuring that the quality of the video is not lost to a certain extent;
[0096] In the transmission module, the sending unit and the receiving unit collaborate. The sending unit sends the encoded audio and video data from the client to the server accurately and timely, and the receiving unit is responsible for receiving the audio and video data from the server on the client. The two work together to ensure smooth two-way data transmission. By taking advantage of the RTSP and RTP methods, the RTSP and RTP methods are used for real-time data transmission, which can ensure the real-time and stability of data transmission, reduce delays and freezes, and provide viewers with a smooth live viewing experience.
[0097] The data processing unit in the processing module has the functions of optimization and distribution. The data processing unit optimizes the data from the client, including denoising and gain adjustment operations, to improve data quality; at the same time, it distributes data and accurately sends the processed data to the corresponding location to ensure that the data can be effectively used. The audio and video mixing unit has a fusion function. The audio and video mixing unit combines multiple audio and video data through audio mixing, video superposition and color matching to create rich and diverse live broadcast content to meet the live broadcast needs in different scenarios. The special effect processing unit can add creative ideas. According to the needs of live broadcast, the special effect processing unit adds various special effects to the audio and video data, such as beauty, filters, virtual backgrounds, etc., to increase the fun and attractiveness of live broadcast and enhance the audience's viewing interest.
[0098] The storage module is an indispensable part of the importance of data preservation. The storage module saves the data during the live broadcast process, providing a basis for subsequent playback and analysis. The audience can review the wonderful live content through the playback function, and the live broadcast platform can analyze the stored data to understand the audience's behavior and preferences, providing a basis for optimizing live content and services;
[0099] The playback module can provide a variety of viewing methods. The playback module provides users with a variety of ways and means to watch live broadcasts. Whether through computers, mobile phones or other devices, users can watch live broadcasts conveniently, meeting users' viewing needs in different scenarios;
[0100] The interactive module can enhance the user's interactive experience. Through various interactive methods, such as bullet screens, gifts, and microphone connections, the interactive module enables users to interact and communicate more closely. Viewers can express their thoughts and feelings by sending bullet screens, support the anchor by giving gifts, and have real-time conversations with the anchor or other viewers through microphone connections. These interactive methods greatly enhance the user's sense of participation and interactive experience.
[0101] The present invention can meet the needs of various scenarios such as live streaming with goods, online education, and entertainment live streaming, provide flexible and diverse live streaming services, improve the efficiency of audio and video data compression and transmission, improve the quality of live streaming, and enhance the interactive experience. It has beneficial effects such as optimized data processing, stable transmission, and convenient storage.
[0102] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit thereof, and the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A multi-scenario live broadcast system, characterized by: It includes an acquisition module, an encoding module, a transmission module, a processing module, a storage module, a playback module and an interactive module. The acquisition module is used to obtain original video and audio data to provide basic materials for subsequent processing and live broadcasting. The encoding module is used to compress and encode the acquired audio and video data. The transmission module is used to ensure efficient transmission of audio and video data between the client and the server. The processing module is used to process and correct the audio and video data. The storage module is used to save data during the live broadcast process for subsequent playback and analysis. The playback module is used to provide users with ways and methods to watch the live broadcast. The interactive module is used to enhance the interactive experience between users.
2. A multi-scenario live broadcast system according to claim 1, characterized in that: The acquisition module is provided with an audio acquisition unit and a video acquisition unit, the audio acquisition unit and the video acquisition unit are synchronized, the audio acquisition unit performs audio acquisition through a microphone, and the video acquisition unit performs video acquisition through a camera, and the microphone and the camera are both deployed in a distributed manner.
3. A multi-scenario live broadcast system according to claim 1, characterized in that: The encoding module is provided with an audio encoding unit and a video encoding unit, and the audio encoding unit and the video encoding unit are used to encode the audio and the video respectively.
4. A multi-scenario live broadcast system according to claim 3, characterized in that: The audio encoding unit uses an AAC encoder to compress the audio. The AAC encoder uses MDCT to convert the audio data in the time domain to the frequency domain. The specific calculation formula is as follows: Where: X(k) is the transformed coefficient, x(n) is the original audio sample, and N is the block size.
5. A multi-scenario live broadcast system according to claim 4, characterized in that: The video encoding unit uses an H.264 encoder to convert the image block from the pixel domain to the frequency domain through discrete cosine transform, and the calculation formula is as follows: Where: C(u, v) is the transformed coefficient, f(x, y) is the original pixel value, N is the size of the block, and u and v are frequency coordinates.
6. A multi-scenario live broadcast system according to claim 1, characterized in that: The video encoding unit needs to perform quantization processing after converting the video data through the H.264 encoder, as follows: Where: Q(i, j) is the quantization step size, C(i, j) is the transformed coefficient, and Q(i, j) is the quantized coefficient.
7. A multi-scenario live broadcast system according to claim 1, characterized in that: The transmission module is provided with a sending unit and a receiving unit. The sending unit is used to send the encoded audio and video data from the client to the server, and the receiving unit is used to receive the audio and video data from the server at the client. The sending unit and the receiving unit use RTSP and RTP to perform real-time data transmission.
8. A multi-scenario live broadcast system according to claim 1, characterized in that: The processing module is provided with a data processing unit, an audio and video mixing unit and a special effect processing unit. The data processing unit is used to optimize and distribute data from the client, the audio and video mixing unit is used to fuse multiple audio and video data, and the special effect processing unit is used to add special effects.
9. A multi-scenario live broadcast system according to claim 8, characterized in that: The data processing unit can optimize and distribute the data, and the audio and video mixing unit can achieve the fusion of multiple audio and video through audio mixing, video superposition and color matching.
10. A multi-scenario live broadcast system according to claim 9, characterized in that: The processing module processes and corrects the audio and video data, including the following steps: S1, input data reception: receiving audio and video data from the scene acquisition module; S2, preprocessing: perform preliminary data optimization, such as denoising and gain adjustment; S3, format conversion: convert the data into a unified format for subsequent processing; S4, Special effects application: add various audio and video effects according to needs; S5, audio and video mixing: fusing the processed audio and video data together; S6. Output data optimization: optimize the final output data to ensure transmission quality; S7. Output data distribution: Send the processed data to the live broadcast platform or other distribution channels.
Citation Information
Patent Citations
Remote teaching live broadcast system
CN105430337A
Audio and video integrated processing system and method
CN107295355A
Low-delay interactive teaching live broadcast method and system
CN110365997A
Data transmission method based on display picture as carrier
CN112422916A
Method for adaptively quantizing dead zone in video coding
CN113395518A
Cited By
Multi-channel live video processing method and system based on dynamic resource allocation
CN120640029A
Audio and video transmission system based on 4G network
CN121864769A
