Menu data transmission method and system of switching table

Abstract

The invention relates to a menu data transmission method and system for a switching station, and the method comprises the following steps: obtaining original pixel data forming a menu interface, and enabling the original pixel data to generate a data package according to a set data transmission protocol; transmitting a data packet through a data interface matched with a set data transmission protocol; receiving a transmitted data packet, analyzing the data packet by using a Bayer algorithm, and converting the analyzed data into RGB data; performing color space conversion on the RGB data to generate RGB information, and converting the RGB information into a YCbCr signal; encoding the YCbCr signal into a format suitable for display interface transmission; by applying the method provided by the invention, the data of the menu can be quickly and efficiently converted into the video stream, a large amount of data can be transmitted, and the transmission rate of the video stream is higher, so that the problem of lagging mentioned in the current industry can be solved.

Description

Technical Field

[0001] The present invention relates to the field of video switcher processing technology, and more specifically to a menu data transmission method and system for a switcher. Background Art

[0002] Driven by the live broadcast environment, more and more people are joining the ranks of live broadcast. With the booming live broadcast market, the market of video switcher industry is also booming. The explosive growth of user demand has also greatly enriched the application scenarios of video switchers. With the diversification of video live broadcast scenarios, the functions of switchers are increasing, and the parameters that need to be displayed in the menu are also increasing. The menu experience of switchers is also improving with the development of the industry.

[0003] The basic functions of a switcher are: (1) select a suitable video material from several video inputs; (2) select basic transitions between two video materials; (3) create or insert special effects. Some switchers can automatically convert the audio of a program according to the video of the program, which is called the AFV (Audio follow Vedio) function; the menu display methods of most current switchers are divided into two types:

[0004] 1. Use SPI communication to transmit menu data, and send the device menu to the back-end chip through SPI for display. Due to the limited transmission capacity of SPI, the disadvantage of this method is that SPI cannot send complex data. When the menu is complex, it will be more stuck and the operation experience will be greatly reduced;

[0005] 2. Use shared memory to transmit menu data. The device has an external flash, which can be accessed by both the back-end display chip and the main control chip. After the main control chip draws the menu, it is written into the shared flash, and the back-end display chip reads and displays it. The disadvantage of this method is that it requires frequent read and write operations on the flash, which has certain risks. Reading and writing cannot be done at the same time, which may cause the system to freeze.

[0006] A menu data transmission method and system for a switcher that can transmit a large amount of menu data and has a faster video stream transmission rate is needed. Summary of the invention

[0007] The technical problem to be solved by the present invention is to provide a menu data transmission method for a switcher and a menu data transmission system for a switcher in view of the above-mentioned defects of the prior art.

[0008] The technical solution adopted by the present invention to solve its technical problem is:

[0009] A menu data transmission method for a switcher is constructed, wherein the method comprises the following steps:

[0010] Acquire the original pixel data constituting the menu interface, and generate a data packet from the original pixel data according to a set data transmission protocol;

[0011] Data packets are transmitted via a data interface matching a set data transmission protocol;

[0012] Receive the transmitted data packets, parse the data packets using the Bayer algorithm, and convert the parsed data into RGB data;

[0013] Convert RGB data into a color space to generate RGB information, and convert the RGB information into a YCbCr signal;

[0014] Encode the YCbCr signal into a format suitable for display interface transmission.

[0015] In the menu data transmission method of the switcher of the present invention, the method of generating a data packet from the raw pixel data according to the set data transmission protocol adopts:

[0016] Format the raw data into a data format that complies with the MIPI protocol: According to the MIPI protocol, the data will be formatted according to a specific bit width;

[0017] Divide the formatted data into multiple data segments;

[0018] Add a header to each data segment, which contains information about the data payload;

[0019] Calculate and add check digits to each data segment;

[0020] The data is packaged and converted into MIPI messages.

[0021] The menu data transmission method of the switch station of the present invention, wherein the data packet transmission is performed through a data interface matching the set data transmission protocol using the method:

[0022] MIPI messages are transmitted through the MIPI-DSI interface.

[0023] The menu data transmission method of the switch station of the present invention, wherein the received transmitted data packet is parsed using the Bayer algorithm, and the parsed data is converted into RGB data using the method:

[0024] Capture MIPI messages: Receive MIPI messages using the MIPI-DSI interface;

[0025] Data analysis: parse MIPI messages and extract image data stream;

[0026] Debayering: Debayering the extracted image data stream;

[0027] Color space conversion: convert the de-Bayered image data from the original color space to the standard RGB color space;

[0028] Output RGB data: Output the processed RGB color data.

[0029] The menu data transmission method of the switcher of the present invention, wherein the data parsing adopts the method:

[0030] Verify data: Perform CRC check on the received data segment to ensure that the data is not damaged during transmission;

[0031] Parsing data header: Parsing the data header from the data segment to obtain information about the data payload;

[0032] Reassemble data: Reassemble the data payload into the original format according to the information in the data header;

[0033] Data processing: pass the reorganized data to the next step.

[0034] The menu data transmission method of the switcher of the present invention, wherein the debayering method is:

[0035] Initialize RGB image: Create an RGB image of the same size as the Bayer pattern image;

[0036] Processing green pixels: interpolate using the average of the upper, lower, left and right neighbors;

[0037] Process red pixels: interpolate using diagonal and upper, lower, left and right neighbors;

[0038] Process blue pixels: interpolate using diagonal and upper, lower, left and right neighbors;

[0039] Processing edges: Edge pixels do not have enough neighbors, so they are filled directly with the values ​​of adjacent pixels.

[0040] The menu data transmission method of the switch station of the present invention, wherein the color space conversion of RGB data to generate RGB information and the conversion of RGB information to YCbCr signal adopts the method:

[0041] Receive RGB data: Receive RGB data, which contains independent red, green and blue channels as well as horizontal and vertical synchronization signals;

[0042] Color space conversion: convert RGB values ​​to brightness and chrominance components;

[0043] The RGB color space is represented by red R, green G, and blue B components, each of which ranges from 0 to 255; the YCbCr color space includes brightness Y, blue difference Cb, and red difference Cr components. The conversion formula is as follows:

[0044] Y=0.299*R+0.587*G+0.114*B;

[0045] Cb=128-0.168736*R-0.331264*G+0.5*B;

[0046] Cr=128+0.5*R-0.418688*G-0.081312*B.

[0047] The menu data transmission method of the switcher of the present invention, wherein the method of encoding the YCbCr signal into a format suitable for display interface transmission adopts:

[0048] 8b / 10b coding: Line coding that maps 8-bit data to 10-bit symbols;

[0049] Packaging: Pack the encoded data into HDMI packets.

[0050] The menu data transmission method of the switch station of the present invention further comprises the steps of:

[0051] Use the interface to draw the artifacts and draw the required menu interface.

[0052] A menu data transmission system for a switcher is applied to the menu data transmission method for the switcher as described above, wherein the system comprises: a menu processing module, a data conversion module, a data processing module and a data display unit;

[0053] The menu processing module is used to obtain the original pixel data constituting the menu interface, generate a data packet from the original pixel data according to a set data transmission protocol; and transmit the data packet to the data conversion module through a data interface matching the set data transmission protocol;

[0054] The data conversion module is used to receive the transmitted data packet, parse the data packet using the Bayer algorithm, convert the parsed data into RGB data and send it to the data processing module;

[0055] The data processing module is used to perform color space conversion on the RGB data to generate RGB information, convert the RGB information into a YCbCr signal; encode the YCbCr signal into a format suitable for transmission by a display interface and send it to the data display unit for display.

[0056] The beneficial effect of the present invention is that by applying the method of the present application, the menu data can be quickly and efficiently converted into a video stream, a large amount of data can be transmitted, and the video stream transmission rate is faster, thereby solving the problem of lag mentioned in the current industry. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the present invention will be further described below in conjunction with the accompanying drawings and embodiments. The drawings described below are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work:

[0058] Figure 1 is a flow chart of a menu data transmission method of a switcher in a preferred embodiment of the present invention;

[0059] Figure 2 It is a schematic diagram of the data segment structure of the menu data transmission method of the switch station in a preferred embodiment of the present invention;

[0060] Figure 3 It is a schematic diagram of the transmission mode of the menu data transmission method packet of the switch station in a preferred embodiment of the present invention;

[0061] Figure 4 1. It is a schematic diagram of the Bayer pattern arrangement of the menu data transmission method of the switch station in the preferred embodiment of the present invention;

[0062] Figure 5 It is a principle block diagram of a menu data transmission system of a switcher in a preferred embodiment of the present invention;

[0063] Figure 6 It is a schematic diagram of a main control chip of a menu data transmission system of a switch station in a preferred embodiment of the present invention;

[0064] Figure 7 Schematic diagram of a data parsing unit of a menu data transmission method of a switcher in a preferred embodiment of the present invention

[0065] Figure 8 Schematic diagram of a data processing module of a menu data transmission method of a switch station in a preferred embodiment of the present invention

[0066] Fig. 9 It is a schematic diagram of a data display module of a menu data transmission system of a switch station in a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the following will be described clearly and completely in combination with the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are partial embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the protection scope of the present invention.

[0068] The menu data transmission method of the switch station of the preferred embodiment of the present invention is as follows Figure 1 See also Figure 2-Figure 4 , including the following steps:

[0069] S01: Acquire original pixel data constituting the menu interface, and generate a data packet from the original pixel data according to a set data transmission protocol;

[0070] S02: Transmitting data packets through a data interface matching a set data transmission protocol;

[0071] S03: receiving the transmitted data packet, parsing the data packet using the Bayer algorithm, and converting the parsed data into RGB data;

[0072] S04: performing color space conversion on the RGB data to generate RGB information, and converting the RGB information into a YCbCr signal;

[0073] S05: Encode the YCbCr signal into a format suitable for display interface transmission;

[0074] By applying the method of the present application, the menu data can be quickly and efficiently converted into a video stream, which can transmit a large amount of data, and the video stream transmission rate is faster, thereby solving the problem of lag mentioned in the current industry.

[0075] Among them, the menu interface processing can adopt the system master control, can adopt the chip RK1126, etc., can use QT or LVGL and other UI design technologies to draw the menu interface required by the user (of course, it can also be an existing or externally input menu interface, which is not limited), and then convert the drawn menu data into MIPI signal; the conversion process is as follows:

[0076] Data collection: Use interface drawing tools (QT or LVGL, etc.) to draw the required menu interface and generate raw data.

[0077] Data formatting: Formatting raw data into a data format that complies with the MIPI protocol. According to the MIPI protocol, data is usually formatted according to a specific bit width (e.g., 8 bits, 10 bits, 12 bits, etc.).

[0078] Data segmentation: Divide the formatted data into multiple data segments (Packets). Each data segment usually contains a data header (Header), data load (Payload), and check bit (CRC).

[0079] Data header addition: Add a data header to each data segment. The data header contains information about the data payload, such as data type, data length, etc.

[0080] Data verification: Calculate and add a check bit (CRC) to each data segment to ensure the integrity of data transmission. After the data is packaged, it is converted into a MIPI message, such as Figure 2 shown.

[0081] Data transmission: The packaged MIPI message is transmitted to the video conversion module through the MIPI-DSI interface. The packet transmission method is as follows Figure 3 shown.

[0082] The video conversion can be done by using a chip such as IT9211. After receiving the MIPI signal transmitted by the menu processing module, it will automatically convert the received MIPI signal into an RGB signal. The conversion process is as follows:

[0083] Capturing MIPI data: The data conversion module receives MIPI signals from the screen drawing module using the MIPI-DSI interface. MIPI-DSI is a common high-speed serial interface designed for mobile and embedded applications.

[0084] Data parsing: After receiving the MIPI data, the data conversion module will start parsing the original MIPI data to extract the image data stream. MIPI data is usually transmitted in the form of data packets, so it is necessary to unpack these data packets and reassemble the original pixel data. The processing process is as follows:

[0085] Verify data: Perform CRC check on the received data segment to ensure that the data is not damaged during transmission.

[0086] Parse the header: Parse the header from the data segment to obtain information about the data payload.

[0087] Reassemble data: Reassemble the data payload into the original format based on the information in the data header.

[0088] Data processing: The reorganized data is passed to the subsequent processing module for further processing.

[0089] De-Bayer: The raw image data received by MIPI-DSI is usually in Bayer pattern, which is a color filter array in which the number of green pixels is twice the number of red and blue pixels. It is usually arranged as follows Figure 4 As shown:

[0090] That is, each pixel only records one of the three colors of red, green, and blue, and the other color values ​​need to be estimated based on the information of the surrounding pixels. DeBayer processing is to convert these monochrome pixels into complete RGB pixels. Various deBayer algorithms can be used to achieve this, such as bilinear interpolation or more complex adaptive algorithms. The steps of bilinear interpolation are as follows:

[0091] 1. Initialize the RGB image: Create an RGB image of the same size as the Bayer pattern image.

[0092] 2. Processing green pixels: interpolate using the average of the upper, lower, left and right neighbors.

[0093] 3. Process red pixels: interpolate using diagonal and upper, lower, left and right neighbors.

[0094] 4. Process blue pixels: interpolate using diagonal and upper, lower, left and right neighbors.

[0095] 5. Processing edges: Edge pixels do not have enough neighbors, so they are directly filled with the values ​​of adjacent pixels.

[0096] Color space conversion: Convert the debayered image data from the original color space to the standard RGB color space. The color output by the sensor may need to be color matrix corrected to match the standard RGB color.

[0097] Output RGB data: Output the processed RGB image data for further processing.

[0098] Data processing can use FPGA, which is used to analyze the received RGB data and convert it into HDMI signal for sending out. The conversion process is as follows:

[0099] Receiving RGB signal: First, receive an RGB signal, which usually contains three independent red, green, and blue channels as well as horizontal and vertical synchronization signals (HSYNC and VSYNC).

[0100] Color space conversion: Convert the RGB signal to the YCbCr color space, which is a common color space used in digital video transmission. This step involves converting the RGB values ​​into brightness (Y) and chrominance (Cb and Cr) components. The RGB color space is represented as red (R), green (G), and blue (B) components, each of which usually ranges from 0 to 255. The YCbCr color space includes brightness (Y), blue difference (Cb), and red difference (Cr) components. The conversion formula is as follows:

[0101] Y=0.299*R+0.587*G+0.114*B;

[0102] Cb=128-0.168736*R-0.331264*G+0.5*B;

[0103] Cr=128+0.5*R-0.418688*G-0.081312*B;

[0104] These formulas convert RGB values ​​to YCbCr values, where Y represents brightness and Cb and Cr represent chrominance.

[0105] HDMI encoding: Encoding the YCbCr signal into a format suitable for HDMI transmission. This involves several steps, including:

[0106] 8b / 10b encoding: This is a line encoding that maps 8-bit data to 10-bit symbols to ensure enough transitions for clock recovery and to control the DC balance of the signal.

[0107] Packaging: Pack the encoded data into HDMI packets.

[0108] TMDS (Transition Minimized Differential Signaling): A signaling protocol used by HDMI that minimizes electromagnetic interference and ensures reliable data transmission over HDMI cables.

[0109] HDMI transmission: The encoded and packaged signals are transmitted to the data display module (such as a monitor, TV or projector) via an HDMI cable.

[0110] This method uses a simple hardware design, comprehensively considers the needs of menu operation smoothness and function menu complexity when used by users, and solves the problem of complex and diverse menus through clever video interface design and using a video conversion chip. Other menu operation methods will have some stuck problems, thereby achieving a better user experience. This method only uses one video conversion chip, thus saving R&D costs. This method has the advantages of simple structure and strong applicability.

[0111] It should be noted that:

[0112] The main control chip RK1126 mentioned in this method may also be replaced by another main control chip.

[0113] The video conversion chip IT9211 mentioned in this method may also be replaced by other types of video conversion chips.

[0114] The MIPI and RGB signals mentioned in this method may also be replaced by other video signals (LVDS, TTL, etc.).

[0115] The HDMI output port mentioned in this method may also be replaced by other video output ports (SDI, DVI, etc.).

[0116] A menu data transmission system for a switcher is applied to the menu data transmission method for the switcher as described above. Figure 5 See also Figure 6-Figure 9 , the system includes: a menu processing module 100, a data conversion module 101, a data processing module 102 and a data display unit 103;

[0117] The menu processing module 100 is used to obtain the original pixel data constituting the menu interface, generate a data packet from the original pixel data according to a set data transmission protocol, and transmit the data packet to the data conversion module through a data interface matching the set data transmission protocol;

[0118] The data conversion module 101 is used to receive the transmitted data packet, parse the data packet using the Bayer algorithm, convert the parsed data into RGB data and send it to the data processing module;

[0119] The data processing module 102 is used to convert the RGB data into a color space to generate RGB information, convert the RGB information into a YCbCr signal; encode the YCbCr signal into a format suitable for display interface transmission and send it to the data display unit 103 for display;

[0120] This method uses a simple hardware design, comprehensively considers the needs of menu operation smoothness and function menu complexity when used by users, and solves the problem of complex and diverse menus through clever video interface design and using a video conversion chip. Other menu operation methods will have some lag problems, thereby achieving a better user experience. This method only uses one video conversion chip, thus saving R&D costs. This method has the advantages of simple structure and strong applicability;

[0121] Specifically: the menu processing module 100, the video conversion module 101, the data processing module 102 and the data display module 103 are properly connected and installed, and the menu processing module 100 develops or integrates a graphical user interface (GUI) design software so that it can draw a live menu interface. For example, it allows users to customize menu options, including text, icons, color schemes and other visual elements, and at the same time, ensures that the GUI design software is compatible with other parts of the system and can receive and respond to update instructions from the data processing module 102.

[0122] The MIPI signal generated by the menu processing module 100 is input to the video conversion module 101. For example, the hardware acceleration technology is used to convert the MIPI signal into an RGB signal to support high-resolution video output, ensuring that the video conversion module 101 can process the signal conversion in real time to avoid delays or freezes. The data processing module 102 is designed to parse the RGB signal output by the video conversion module 101 and convert the parsed signal into an HDMI compatible format to ensure that the live broadcast signal can be accepted by most display devices. The HDMI interface outputs the HDMI signal converted by the data processing module 102 to the live broadcast display device, and the display module 103 can adapt to different display resolutions and working modes to meet the needs of different live broadcast scenarios.

[0123] The user is allowed to operate the menu through an external controller (such as a keyboard, mouse or touch screen). The menu interface is optimized based on user feedback to improve the intuitiveness and ease of use of the interface.

[0124] By converting MIPI signals into RGB signals, the display quality of the menu interface is improved. The data processing module 102 parses and converts the RGB signals into HDMI signals, making full use of the high transmission capacity of HDMI to make complex data transmission smoother and avoid the problem of reduced operating feel due to data transmission jams.

[0125] In some embodiments, the menu processing module 100 includes a menu data acquisition unit and a menu data processing unit, which are connected; wherein the menu data acquisition unit is used to draw a menu interface and generate original menu data based on the menu interface; the menu data processing unit processes the original menu data into a MIPI signal and transmits it to the video conversion module 101.

[0126] Specifically, the menu data acquisition unit and the menu data processing unit are connected by a circuit. The menu data acquisition unit can use a graphics rendering engine to draw a menu interface. During the drawing process, the menu data acquisition unit generates original menu data based on the menu interface drawn. For example, the original menu data may include attribute information such as text, icon, position, color, font, etc. of the menu item. The menu data processing unit can use a signal processing chip to be responsible for processing the original menu data into a MIPI signal. After receiving the original menu data, the menu data processing unit parses it and extracts key information. According to the extracted key information, the menu data processing unit generates a corresponding MIPI signal. For example, the text information of the menu item is encoded into the text information of the MIPI signal, the icon information of the menu item is encoded into the icon information of the MIPI signal, etc., and the generated MIPI signal is transmitted to the video conversion module 101 so that the video conversion module 101 generates a corresponding video signal according to the MIPI signal.

[0127] It should be noted that the menu processing module 100 is the main control of the system. Its function is to use UI design technologies such as QT or LVGL to draw the menu interface required by the user, and then convert the drawn menu data into MIPI signals. The conversion process is as follows:

[0128] (1) Data collection: Use interface drawing tools (QT or LVGL, etc.) to draw the required menu interface and generate raw data.

[0129] (2) Data formatting: Formatting the original data into a data format that complies with the MIPI protocol. According to the MIPI protocol, data is usually formatted according to a specific bit width (e.g., 8 bits, 10 bits, 12 bits, etc.).

[0130] (3) Data segmentation: Divide the formatted data into multiple data segments (Packets). Each data segment usually contains a data header (Header), data load (Payload), and checksum (CRC).

[0131] (4) Data header addition: Add a data header to each data segment. The data header contains information about the data payload, such as data type, data length, etc.

[0132] (5) Data verification: Calculate and add a check bit (CRC) to each data segment to ensure the integrity of data transmission. The data is packaged and converted into a MIPI message.

[0133] (6) Data transmission: The packaged MIPI message is transmitted to the video conversion module through the MIPI-DSI interface.

[0134] The menu data acquisition unit can quickly draw the menu interface and automatically generate the original menu data. The menu data processing unit converts the original menu data into MIPI signals, reducing the complexity of data conversion and making data transmission more efficient and standardized. Since MIPI signals are specially designed for mobile device display interfaces, the display quality and accuracy of videos on mobile devices can be improved by converting them into MIPI signals.

[0135] In some embodiments, the video conversion module 101 includes a data capture unit and a data parsing unit, which are connected to each other. The data capture unit is used to capture the MIPI signal of the menu data processing unit 100, and the data parsing unit is used to reorganize the original menu data, de-Bayerize and perform RGB color correction.

[0136] Specifically, the video conversion module 101 uses IT9211, which is used to receive the MIPI signal transmitted by the menu processing module 100, and automatically converts the received MIPI signal into an RGB signal. For example, the capture data unit uses a high-performance MIPI CSI-2 receiver to receive the MIPI signal from the menu data processing unit 100. The MIPI signal is a high-speed, low-power serial interface suitable for high-performance video transmission. The capture data unit also has functions such as signal amplification and filtering to ensure the quality of the received signal.

[0137] The data parsing unit includes a reassembler and an RGB color corrector. The reassembler is used to reassemble the original menu data. The original menu data may have problems in data order and integrity due to signal attenuation and interference during transmission. The reassembler will sort and merge these data to restore the integrity and correctness of the original menu data. The RGB color corrector is used to perform RGB color correction on the reassembled menu data. Due to various reasons, such as sensor performance, signal attenuation during transmission, etc., the received menu data may have color distortion. The RGB color corrector compensates for color distortion by performing linear or nonlinear transformation on the color channel to make the displayed image more realistic and clear.

[0138] By integrating the capture data unit, the MIPI signal generated by the menu data processing unit can be accurately captured to ensure the integrity of the video data during transmission. The data parsing unit is responsible for reorganizing the original menu data and performing de-Bayering and RGB color correction to improve data parsing efficiency and video quality, making the display effect clearer and more realistic.

[0139] In some embodiments, the data processing module 102 includes a receiving RGB unit and a color space conversion unit. The receiving RGB unit and the color space conversion unit are connected. The receiving RGB unit is used to receive the RGB signal after RGB color correction. The color space conversion unit is used to convert the RGB signal into a YCbCr signal and encode it.

[0140] Specifically, the receiving RGB unit and the color space conversion unit are connected through a circuit to ensure smooth transmission and processing of data. The receiving RGB unit adopts a high-performance RGB signal receiver for receiving the RGB signal after RGB color correction. The color space conversion unit includes an RGB to YCbCr converter and an encoder. The RGB to YCbCr converter is used to convert the RGB signal into a YCbCr signal. YCbCr is a color space widely used in video compression and transmission. The YCbCr signal includes a brightness signal (Y) and a chrominance signal (Cb, Cr). The converter processes the RGB signal according to a predetermined conversion formula and parameters to obtain a corresponding YCbCr signal. The encoder is used to encode the converted YCbCr signal. The encoder can compress and convert the YCbCr signal into a digital format for easy storage and transmission. Common coding standards include H.264, HEVC, etc. The encoder encodes the YCbCr signal according to these standards to obtain compressed video data.

[0141] By integrating the RGB receiving unit, the RGB signal after RGB color correction can be accurately received to ensure the accuracy of the video data during color processing. The color space conversion unit is responsible for converting the RGB signal into a YCbCr signal and encoding it to improve the compression efficiency and encoding quality of the video data.

[0142] In some embodiments, the data display module 103 includes at least one of a display, a television, or a projector.

[0143] Specifically, the data display module 103 includes at least one display, television or projector, which are used to display the image data processed by the data processing module 102. The display can be a liquid crystal display (LCD) or a light emitting diode display (LED), which has the characteristics of high resolution, high color accuracy and low power consumption, and is suitable for various occasions, such as computers, mobile phones and other devices. The display receives the image data from the data processing module 102 and displays it on the screen. The television can be a liquid crystal television (LCD TV) or a plasma television (Plasma TV). The projector can project the image data onto a curtain or wall, which is suitable for places such as homes, cinemas, and conference rooms. The projector receives the image data from the data processing module 102 and projects the image onto the screen through an optical system. Through devices such as displays, televisions or projectors, flexible and diverse display configurations can be achieved to meet different environments and application requirements.

[0144] Figure 6 A schematic diagram of a main control chip provided in an embodiment of the present application, Figure 7 A schematic diagram of a data parsing unit provided in an embodiment of the present application. Figure 6 and Figure 7 As shown, in some embodiments, the menu data processing unit includes a main control chip, the data parsing unit includes an IT9211 chip 221 and a first capacitive reactance circuit 222, the IT9211 chip 221 is respectively connected to the main control chip 121 and the first capacitive reactance circuit 222, and one end of the first capacitive reactance circuit 222 is grounded.

[0145] Specifically, the menu data processing unit mainly includes a main control chip 121, which is used to process and control various operations of menu data. The main control chip 121 can be a microprocessor or a dedicated integrated circuit, which has functions such as data processing, command execution and interface communication. The data parsing unit includes an IT9211 chip 221 and a first capacitive reactance circuit 222. The IT9211 chip 221 is a dedicated integrated circuit for parsing and processing menu data. It has efficient data processing capabilities and stable performance to ensure the correct parsing of menu data. The first capacitive reactance circuit 222 is used to ensure the normal operation of the IT9211 chip 221, and one end is grounded to form a stable reference potential for use by the IT9211 chip 221.

[0146] The main control chip 121, as the core of the menu data processing unit, can efficiently process and analyze data, improve the overall data processing speed and efficiency, and use the dedicated IT9211 chip 221 and the first capacitive reactance circuit 222 to achieve rapid analysis and processing of data and optimize the data analysis process.

[0147] In some embodiments, the data parsing unit further includes a crystal oscillator circuit 223 , one end of the crystal oscillator circuit 223 is connected to the IT9211 chip 221 , and one end of the crystal oscillator circuit 223 is grounded.

[0148] Specifically, the data parsing unit is an integrated module designed to receive, parse and process information from different data sources. The data parsing unit includes a crystal oscillator circuit 223, which is responsible for providing a stable clock signal to ensure the synchronization and accuracy of data processing operations. The crystal oscillator circuit 223 consists of a quartz crystal oscillator (crystal oscillator) and related circuit components. The quartz crystal oscillator generates an accurate clock signal, and the frequency of the signal is usually determined by the application scenario of the data parsing unit. One end of the crystal oscillator circuit 223 is connected to the IT9211 chip 221 through a pin to ensure the synchronization of data processing operations. The other end of the crystal oscillator circuit 223 is grounded. In order to ensure that the reference point of the entire clock signal is stable, the grounding also provides a low impedance path, which helps to eliminate noise and ensure the integrity and reliability of the signal.

[0149] By integrating the crystal oscillator circuit 223, a stable clock signal can be provided for the IT9211 chip 221 to ensure the accuracy and synchronization of data analysis. The addition of the crystal oscillator circuit 223 can optimize the data analysis process and improve the speed and efficiency of data analysis.

[0150] Figure 8 A schematic diagram of a data processing module provided in an embodiment of the present application, Fig. 9 This is a schematic diagram of a data display module provided in an embodiment of the present application. Figure 8 and Fig. 9 As shown, in some embodiments, the data display module 103 includes an HDMI transmitter 410 and an HDMI port 420 , and the HDMI transmitter 410 is connected to the HDMI port 420 and the data processing module 102 , respectively.

[0151] Specifically, the HDMI transmitter 410 is connected to the HDMI port 420, and the HDMI transmitter 410 is connected to the data processing module 102, and the data processing module 102 sends and receives HDMI signals through the HDMI transmitter 410 and the HDMI port 420. The HDMI transmitter 410 can receive signals of video, audio, and other data through the data processing module 102, and then transmit these signals to the HDMI port 420. Through the HDMI port 420, the HDMI transmitter 410 can transmit the signals of video, audio, and other data to an external display device or other device.

[0152] By using the HDMI transmitter 410 and the HDMI port 420, the system can be seamlessly connected with other devices supporting the HDMI interface, thereby expanding the application range of the system. The HDMI transmitter 410 has high signal transmission performance, can ensure the quality of high-definition video and audio signals during transmission, and provide users with a better viewing experience.

[0153] In some embodiments, the HDMI transmitter 410 includes an HDMI transmitting chip 411 and a second capacitive circuit 412, and the HDMI transmitting chip 411 is respectively connected to the second capacitive circuit 412, the HDMI port 420 and the data processing module 102; one end of the second capacitive circuit 412 is connected to the HDMI transmitting chip 411, and the other end of the second capacitive circuit 412 is grounded.

[0154] Specifically, the HDMI transmitter chip 411 is connected to the second capacitive reactance circuit 412, the HDMI transmitter chip 411 is connected to the HDMI port 420, the HDMI transmitter chip 411 is connected to the data processing module 102, and the other end of the second capacitive reactance circuit 412 is connected to the ground. The HDMI transmitter chip 411, the second capacitive reactance circuit 412, the HDMI port 420 and the data processing module 102 constitute the HDMI transmitter 410. The data processing module 102 can send and receive HDMI signals through the HDMI transmitter chip 411 and the second capacitive reactance circuit 412. The HDMI transmitter chip 411 can receive signals of video, audio and other data through the data processing module 102, and then transmit these signals to the second capacitive reactance circuit 412.

[0155] By adopting the combination of the HDMI transmitter chip 411 and the second capacitive reactance circuit 412, interference during signal transmission is reduced and signal stability is ensured. The HDMI transmitter chip 411 has high signal processing performance, can effectively improve the transmission quality of video and audio signals, and provide users with a better viewing experience.

[0156] In order to better understand the channel switching display system for live broadcasting in the embodiment of the present application, Figure 7 A system flow chart of a channel switching display system for live network broadcasting provided in an embodiment of the present application is shown below in conjunction with Figure 7 The specific operation process of the channel switching display system is described.

[0157] The menu processing module 100 is the main control of the system. Its function is to use UI design technologies such as QT or LVGL to draw the menu interface required by the user, and then convert the drawn menu data into MIPI signals.

[0158] The video conversion module 101 uses the IT9211 chip 221. The function of this module is to receive the MIPI signal transmitted by the menu processing module 100, and automatically convert the received MIPI signal into an RGB signal. For example, the video conversion module 101 is a data conversion module. The data conversion module receives the MIPI signal from the screen drawing module (menu processing module 100) using the MIPI-DSI interface. MIPI-DSI is a common high-speed serial interface designed for mobile and embedded applications. After receiving the MIPI data, the data conversion module will start to parse the original MIPI data to extract the image data stream. MIPI data is usually transmitted in the form of data packets, so it is necessary to unpack these data packets and reorganize the original pixel data. The specific processing process includes: performing CRC check on the received data segment to ensure that the data is not damaged during transmission; parsing the data header from the data segment to obtain information about the data load; recombining the data load into the original format data according to the information of the data header; passing the recombined data to the subsequent processing module for further processing; Since the raw image data received by MIPI-DSI is usually Bayer pattern, the Bayer pattern is a color filter array in which the number of green pixels is twice the number of red and blue pixels. That is, the Bayer pattern only records one of the three colors of red, green, and blue, and the other color values ​​need to be estimated based on the information of the surrounding pixels.

[0159] DeBayering is to convert these monochrome pixels into complete RGB pixels. Various deBayering algorithms can be used to achieve this, for example, bilinear interpolation or more complex adaptive algorithms. In order to avoid repetition, the following description is only based on bilinear interpolation as an example, which should not be construed as a limitation on the present application. The steps of bilinear interpolation are as follows: Create an RGB image of the same size as the Bayer pattern image; Use the average value of the upper, lower, left and right neighbors for interpolation; Use the diagonal and upper, lower, left and right neighbors for interpolation; Use the diagonal and upper, lower, left and right neighbors for interpolation; If edge pixels do not have enough neighbors, directly use the values ​​of adjacent pixels for filling; Convert the deBayered image data from the original color space to the standard RGB color space. The color output by the sensor may need to be color matrix corrected to match the standard RGB color; Output the processed RGB image data for further processing.

[0160] The data processing module 102 receives the signal from the video conversion module 101. The data processing module 102 uses an FPGA. Its main function is to parse the received RGB data and convert it into an HDMI signal for transmission. The conversion process includes: first receiving an RGB signal, which usually contains three independent red, green and blue channels and horizontal and vertical synchronization signals (HSYNC and VSYNC); converting the RGB signal into a YCbCr color space, which is a color space commonly used in digital video transmission. This step includes converting the RGB value into brightness (Y) and chroma (Cb and Cr) components. The RGB color space is represented by red (R), green (G) and blue (B) components, and each component usually ranges from 0 to 255. The YCbCr color space includes brightness (Y), blue difference (Cb) and red difference (Cr) components. Convert the RGB value into a YCbCr value, where Y represents brightness and Cb and Cr represent chroma. Encode the YCbCr signal into a format suitable for HDMI transmission. This process specifically includes the following steps: specifically, mapping 8-bit data to 10-bit symbol line coding to ensure sufficient transition for clock recovery and control the DC balance of the signal; packaging the encoded data into HDMI data packets; TMDS (transition-minimized differential signaling) processing, due to the signal protocol used by HDMI, minimizes electromagnetic interference and ensures reliable data transmission through the HDMI cable. Finally, HDMI transmission is performed to transmit the encoded and packaged signal to the data display module (such as a monitor, TV or projector) through the HDMI cable.

[0161] It should be understood that those skilled in the art can make improvements or changes based on the above description, and all these improvements and changes should fall within the scope of protection of the appended claims of the present invention.

Claims

1. A menu data transmission method for a switcher, characterized in that: The method comprises the following steps: Acquire the original pixel data constituting the menu interface, and generate a data packet from the original pixel data according to a set data transmission protocol; Data packets are transmitted via a data interface matching a set data transmission protocol; Receive the transmitted data packets, parse the data packets using the Bayer algorithm, and convert the parsed data into RGB data; Convert RGB data into a color space to generate RGB information, and convert the RGB information into a YCbCr signal; Encode the YCbCr signal into a format suitable for display interface transmission.

2. The menu data transmission method of the switcher according to claim 1, characterized in that: The method of generating a data packet from the original pixel data according to the set data transmission protocol is as follows: Format the raw data into a data format that complies with the MIPI protocol: According to the MIPI protocol, the data will be formatted according to a specific bit width; Divide the formatted data into multiple data segments; Add a header to each data segment, which contains information about the data payload; Calculate and add check digits to each data segment; The data is packaged and converted into MIPI messages.

3. The menu data transmission method of the switcher according to claim 2, characterized in that: The method for transmitting data packets through a data interface matching a set data transmission protocol is as follows: MIPI messages are transmitted through the MIPI-DSI interface.

4. The menu data transmission method of the switcher according to claim 2, characterized in that: The received transmitted data packet is parsed using the Bayer algorithm, and the parsed data is converted into RGB data using the following method: Capture MIPI messages: Receive MIPI messages using the MIPI-DSI interface; Data analysis: parse MIPI messages and extract image data stream; Debayering: Debayering the extracted image data stream; Color space conversion: convert the de-Bayered image data from the original color space to the standard RGB color space; Output RGB data: Output the processed RGB color data.

5. The menu data transmission method of the switcher according to claim 4, characterized in that: The data analysis adopts the following method: Verify data: Perform CRC check on the received data segment to ensure that the data is not damaged during transmission; Parsing data header: Parsing the data header from the data segment to obtain information about the data payload; Reassemble data: Reassemble the data payload into the original format according to the information in the data header; Data processing: pass the reorganized data to the next step.

6. The menu data transmission method of the switcher according to claim 4, characterized in that: The Bayer removal method is as follows: Initialize RGB image: Create an RGB image of the same size as the Bayer pattern image; Processing green pixels: interpolate using the average of the upper, lower, left and right neighbors; Process red pixels: interpolate using diagonal and upper, lower, left and right neighbors; Process blue pixels: interpolate using diagonal and upper, lower, left and right neighbors; Processing edges: If edge pixels do not have enough neighbors, they are directly filled with the values ​​of adjacent pixels.

7. The menu data transmission method of a switcher according to any one of claims 4 to 6, characterized in that: The method of converting the RGB data into a color space to generate RGB information and converting the RGB information into a YCbCr signal is as follows: Receive RGB data: Receive RGB data, which contains independent red, green and blue channels as well as horizontal and vertical synchronization signals; Color space conversion: convert RGB values ​​to brightness and chrominance components; The RGB color space is represented by red R, green G, and blue B components, each of which ranges from 0 to 255; the YCbCr color space includes brightness Y, blue difference Cb, and red difference Cr components. The conversion formula is as follows: Y=0.299*R+0.587*G+0.114*B; Cb=128-0.168736*R-0.331264*G+0.5*B; Cr=128+0.5*R-0.418688*G-0.081312*B.

8. The menu data transmission method of a switcher according to claim 1, characterized in that: The method for encoding the YCbCr signal into a format suitable for display interface transmission is as follows: 8b / 10b coding: Line coding that maps 8-bit data to 10-bit symbols; Packaging: Pack the encoded data into HDMI packets.

9. The menu data transmission method of a switcher according to claim 1, characterized in that: The method further comprises the steps of: Use the interface to draw the artifacts and draw the required menu interface.

10. A menu data transmission system for a switcher, applied to the menu data transmission method for a switcher as claimed in any one of claims 1 to 9, characterized in that: The system comprises: a menu processing module, a data conversion module, a data processing module and a data display unit; The menu processing module is used to obtain the original pixel data constituting the menu interface, generate a data packet from the original pixel data according to a set data transmission protocol; and transmit the data packet to the data conversion module through a data interface matching the set data transmission protocol; The data conversion module is used to receive the transmitted data packet, parse the data packet using the Bayer algorithm, convert the parsed data into RGB data and send it to the data processing module; The data processing module is used to perform color space conversion on the RGB data to generate RGB information, convert the RGB information into a YCbCr signal; encode the YCbCr signal into a format suitable for transmission by a display interface and send it to the data display unit for display.

Images