A scalable multimedia broadcast control system based on Chromium kernel
By designing a multimedia broadcast control system based on the chromium kernel, using components such as multimedia rendering process, multimedia data source management process and signal source plug-in process, the problem that existing systems cannot support multiple signal source types is solved, and the system is realized Scalability and stability.
Patent Information
- Application Number
- CN202310084766.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-02
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2043-02-02
AI Technical Summary
The existing multimedia broadcast control system based on the chromium kernel cannot effectively support multiple signal source types, such as RTSP, RTMP, SIP and customized streaming protocols.
A scalable multimedia broadcast control system is designed, using components such as Browser process, multimedia rendering process, multimedia data source management process and signal source plug-in process to realize the management and data transmission of signal source plug-in through IPC connection.
It realizes support for different signal source types, ensures the performance and maintainability of the system, supports the scalability of the system, and does not affect other plug-ins when one signal source plug-in crashes, ensuring the stability of the system.
Smart Images

Figure CN116193211B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of broadcast control technology, and more specifically, to an extensible multimedia broadcast control system based on the Chromium kernel. Background Art
[0002] The implementation of multimedia rendering system generally adopts C / S model, which is more efficient, but as the human-computer interaction becomes more and more complex, the cost of software expansion and maintenance is getting higher and higher. B / S model can solve these pain points, but currently, the browser based on Chromium can only support limited signal source types: such as local audio and video, WEBRTC, PDF and other traditional signal sources, however, such as RTSP, RTMP, SIP, custom streaming media protocols and other signal sources are not implemented at the Chromium kernel level, and the signal sources even include word, ppt, excel, screen projection, etc.
[0003] WEBRTC is the abbreviation of Web Real-Time Communication, which is an API that supports web browsers to conduct real-time voice or video conversations. RTSP (Real Time Streaming Protocol), RFC2326, is an application layer protocol in the TCP / IP protocol system. It is an IETF RFC standard submitted by Columbia University, Netscape and RealNetworks. RTMP is the abbreviation of Real Time Messaging Protocol. RTMP is a network protocol designed for real-time data communication. It is mainly used for audio, video and data communication between Flash / AIR platform and streaming media / interactive servers that support RTMP protocol. Summary of the invention
[0004] The technical problem to be solved by the present invention is to address the above-mentioned deficiencies in the prior art. The purpose of the present invention is to provide an extensible multimedia broadcast control system based on the Chromium kernel that can support different signal source types.
[0005] The technical solution of the present invention is: an extensible multimedia broadcast control system based on the Chromium kernel, comprising:
[0006] The Browser process is customized using the content layer provided by Chromium and is used to authorize the multimedia data source management process user;
[0007] A multimedia rendering process, which is implemented based on the PPAPI framework of Chromium and is used to decode and render multimedia signals;
[0008] A multimedia data source management process, which is implemented based on the chromium PPAPI framework and is used to manage the signal source plug-in process;
[0009] A signal source plug-in process, the signal source plug-in process is used to collect signal source data and send it to the multimedia rendering process; different signal source types correspond to different signal source plug-in processes;
[0010] The multimedia rendering process establishes an IPC connection with the multimedia data source management process and the signal source plug-in process.
[0011] Furthermore, the multimedia rendering process includes:
[0012] An inter-process communication module, responsible for establishing an IPC connection with the multimedia data source management process and an IPC connection with the signal source plug-in process;
[0013] An event receiving and forwarding module is responsible for receiving messages from the mouse, keyboard, touch, and JS script, and forwarding the messages to the multimedia data source management process or a specific signal source plug-in process according to the type of the messages;
[0014] An audio and video decoding module, used for decoding audio and video data;
[0015] The scheduling module is responsible for scheduling the rendering module;
[0016] The rendering module is used to draw the decoded audio and video data frames onto the texture.
[0017] Furthermore, the multimedia data source management process includes:
[0018] An inter-process communication establishment module, responsible for establishing an IPC connection with the multimedia rendering process;
[0019] A plug-in process starting module, used to start a corresponding signal source plug-in process according to the signal source type passed into the multimedia rendering process;
[0020] The event receiving and sending module is used to receive messages from the multimedia rendering process.
[0021] Furthermore, the signal source plug-in process includes:
[0022] An inter-process communication establishment module, responsible for establishing an IPC connection with the multimedia data source management process and an IPC connection with the multimedia rendering process;
[0023] An event receiving and sending module, used for receiving messages from the multimedia data source management process and the multimedia rendering process;
[0024] The signal source data frame sending module is used to receive complex signal source data of human-computer interaction, and when a frame of data is prepared, it is sent to the multimedia rendering process.
[0025] Beneficial Effects
[0026] Compared with the prior art, the present invention has the following advantages:
[0027] 1. The decoding and rendering of the signal source are completed based on the Chromium kernel, which ensures the performance of the system. Human-computer interaction is complex and often changes. JavaScript is used to implement this part of the function to ensure the maintainability of the system.
[0028] 2. If you need to support a new signal source, you only need to write the corresponding plug-in, which ensures the scalability of the system.
[0029] 3. If a signal source plug-in crashes, it will not affect other plug-ins, ensuring the stability of the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] Figure 1 It is the overall architecture diagram of the present invention;
[0031] Figure 2 This is an architecture diagram of the multimedia rendering process in the present invention;
[0032] Figure 3 It is an architectural diagram of the multimedia data source management process in the present invention;
[0033] Figure 4 An architectural diagram of the signal source plug-in process of the present invention. DETAILED DESCRIPTION
[0034] The present invention will be further described below with reference to the specific embodiments in the accompanying drawings.
[0035] See also Figure 1-4 , a scalable multimedia broadcast control system based on the Chromium kernel, including:
[0036] Browser process: The Browser process is customized using the content layer provided by Chromium. In addition to some essential functions of the browser, it is also used to authorize the multimedia data source management process users. The authorized multimedia data source management process can start running. Chromium is a web browser developed by Google.
[0037] Multimedia rendering process: The multimedia rendering process is implemented based on the PPAPI framework of Chromium. It is essentially a PpapiPlugin process used to decode and render multimedia signals.
[0038] Multimedia data source management process: The multimedia data source management process is implemented based on the chromium-based PPAPI framework. It is essentially a PpapiPlugin process used to manage signal source plug-in processes.
[0039] The signal source plug-in process is used to collect audio and video data of the signal source and send it to the multimedia rendering process. Different signal source types correspond to different signal source plug-in processes, such as streaming media plug-in, Word plug-in, PPT plug-in, EXCEL plug-in, etc.
[0040] The multimedia rendering process establishes an IPC connection with the multimedia data source management process and the signal source plug-in process. IPC stands for Inter-Process Communication.
[0041] The system also includes HTML text, Render process, and GPU process. The Browser process and Render process read HTML text, the Browser process establishes IPC connections with the multimedia data source management process and the multimedia rendering process through the Render process, and the GPU process establishes IPC connections with the Browser process and the Render process respectively.
[0042] The architecture of the multimedia rendering process is as follows Figure 2 As shown, including:
[0043] The inter-process communication module is responsible for establishing an IPC connection with the multimedia data source management process and the signal source plug-in process;
[0044] The event receiving and forwarding module is responsible for receiving messages from the mouse, keyboard, touch, and JS script, and forwarding the messages to the multimedia data source management process or the specific signal source plug-in process according to the message type;
[0045] An audio and video decoding module, used for decoding audio and video data;
[0046] The scheduling module is responsible for scheduling the rendering module;
[0047] A rendering module, used to draw the decoded audio and video data frames onto a texture;
[0048] The decoding and rendering of the signal source are all based on the Chromium kernel, ensuring the performance of the system.
[0049] The architecture of multimedia data source management process is as follows Figure 3 As shown, including:
[0050] The inter-process communication establishment module is responsible for establishing an IPC connection with the multimedia rendering process;
[0051] The plug-in process startup module is used to start the corresponding signal source plug-in process according to the signal source type passed in by the multimedia rendering process;
[0052] The event receiving and sending module is used to receive messages from the multimedia rendering process.
[0053] The architecture of the signal source plug-in process is as follows Figure 4 As shown, including:
[0054] The inter-process communication establishment module is responsible for establishing an IPC connection with the multimedia data source management process and the IPC connection with the multimedia rendering process;
[0055] An event receiving and sending module is used to receive messages from a multimedia data source management process and a multimedia rendering process;
[0056] The signal source data frame sending module is used to receive complex signal source data for human-computer interaction. When a frame of data is ready, it is sent to the multimedia rendering process.
[0057] Human-computer interaction is complex and changes frequently. Using JavaScript to implement this part of the function ensures the maintainability of the system. If you need to support a new signal source, you only need to write the corresponding plug-in, which ensures the scalability of the system. If a signal source plug-in crashes, it will not affect other plug-ins, ensuring the stability of the system.
[0058] The above are only preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, several modifications and improvements can be made without departing from the structure of the present invention, which will not affect the effect of the implementation of the present invention and the practicality of the patent.
Claims
1. A scalable multimedia broadcast control system based on the Chromium kernel, characterized in that: include: The Browser process is customized using the content layer provided by Chromium and is used to authorize the multimedia data source management process user; A multimedia rendering process, which is implemented based on the PPAPI framework of Chromium and is used to decode and render multimedia signals; A multimedia data source management process, which is implemented based on the chromium PPAPI framework and is used to manage the signal source plug-in process; A signal source plug-in process, which is implemented based on the Chromium kernel framework and is used to receive the signal source audio and video data and send it to the multimedia rendering process; Different signal source types correspond to different signal source plug-in processes; The multimedia rendering process establishes an IPC connection with the multimedia data source management process and the signal source plug-in process; The multimedia rendering process includes: An inter-process communication module, responsible for establishing an IPC connection with the multimedia data source management process and an IPC connection with the signal source plug-in process; An event receiving and forwarding module is responsible for receiving messages from the mouse, keyboard, touch, and JS script, and forwarding the messages to the multimedia data source management process or a specific signal source plug-in process according to the type of the messages; An audio and video decoding module, used for decoding audio and video data; The scheduling module is responsible for scheduling the rendering module; A rendering module, used to draw the decoded audio and video data frames onto a texture; The signal source plug-in process includes: An inter-process communication establishment module, responsible for establishing an IPC connection with the multimedia data source management process and an IPC connection with the multimedia rendering process; An event receiving and sending module, used for receiving messages from the multimedia data source management process and the multimedia rendering process; The signal source data frame acquisition and sending module is used to acquire the signal source audio and video data, and when a frame of data is ready, it is sent to the multimedia rendering process; The signal source plug-in process includes streaming media plug-in, Word plug-in, PPT plug-in, and EXCEL plug-in.
2. According to claim 1, a scalable multimedia broadcast control system based on the Chromium kernel is characterized in that: The multimedia data source management process includes: An inter-process communication establishment module, responsible for establishing an IPC connection with the multimedia rendering process; A plug-in process starting module, used to start a corresponding signal source plug-in process according to the signal source type passed into the multimedia rendering process; The event receiving and sending module is used to receive messages from the multimedia rendering process.
Citation Information
Patent Citations
Method, system and equipment for playing streaming media in browser and readable medium
CN114491343A
