Non-IP type optical fiber agent cooperation system and method

Abstract

The invention is suitable for the technical field of seat cooperation, and provides a non-IP type optical fiber seat cooperation system, which comprises an audio and video input acquisition node, an audio and video output display node, a seat operation node and an audio and video dedicated switch, the audio and video input acquisition node and the seat operation node are both used for converting an acquired signal into an optical fiber signal, performing data marking on the optical fiber signal according to a private protocol, and transmitting the optical fiber signal to the audio and video special switch; the audio and video dedicated switch is used for receiving optical fiber signals of the audio and video input acquisition node and the seat operation node, and distributing the optical fiber signals to the audio and video output display node or the seat operation node according to the USB control signal; and the audio and video output display node and the seat operation node are both used for converting the optical fiber signal into a cooperative signal and displaying an image digital signal of the cooperative signal on the display equipment. The non-IP type optical fiber agent cooperation system has the advantages of being high in transmission efficiency, low in delay, stable and reliable.

Description

Technical Field

[0001] The present application belongs to the field of agent collaboration technology, and in particular, relates to a non-IP optical fiber agent collaboration system and method. Background Art

[0002] In computer room management systems, command center systems, and power dispatching systems, the agent management system (KVM, which stands for Keyboard, Video, and Mouse) is the most commonly used device. Through this device, a set of keyboards, mice, and display devices can manage multiple computers and server clusters. The agent collaboration system enables real-time sharing of signals built in different areas, allowing users to easily achieve the goal of multi-area collaborative office, resource sharing, integrated operation and control. It is a new integrated solution with high reliability and excellent operating experience. It provides an overall solution for mission-critical environments and realizes functions such as centralized management, efficient coordination, real-time control, information communication, and security management.

[0003] The agent management system in the prior art is usually an IP-based agent collaboration system. By adopting a distributed network architecture, the agent terminal can be connected to the central control unit through the IP network to achieve seamless collaboration and information sharing between agents.

[0004] The above-mentioned IP agent management system adopts network distributed transmission. When the delay is high, the image signal bandwidth is limited, and the high resolution is high, the image will become blurred, which will easily affect the real-time remote control of the operator, increase the instability of the system, and easily cause errors such as accidental mouse touches. Summary of the invention

[0005] The embodiments of the present application provide a non-IP fiber-optic agent collaboration system and method, which can solve the problem that the image becomes blurred under high latency, limited image signal bandwidth, and high resolution.

[0006] In a first aspect, an embodiment of the present application provides a non-IP optical fiber seat collaboration system, including: an audio and video input acquisition node, an audio and video output display node, an agent operation node, and an audio and video dedicated switch;

[0007] The audio and video input acquisition node, the audio and video output display node and the seat operation node are all connected to the audio and video dedicated switch;

[0008] The audio and video input acquisition node and the seat operation node are both used to obtain acquisition signals and convert the acquisition signals into optical fiber signals, perform data marking on the optical fiber signals according to a private protocol, and transmit the optical fiber signals to the audio and video dedicated switch, wherein the acquisition signals include a first image signal, an audio signal or a USB control signal;

[0009] The audio and video dedicated switch is used to receive the optical fiber signals of the audio and video input acquisition node and the seat operation node, and distribute the optical fiber signals to the audio and video output display node or the seat operation node according to the USB control signal of the seat operation node;

[0010] The audio and video output display node and the seat operation node are both used to receive the optical fiber signal of the audio and video dedicated switch, and convert the optical fiber signal into a collaborative signal, and display the image digital signal of the collaborative signal on a display device.

[0011] Furthermore, the private protocol obtains a communication data packet by modifying the UDP protocol through preset rules, wherein the preset rules include reducing protocol header information, and the communication data packet includes a sending ID, a receiving ID and frame information.

[0012] Furthermore, the number of the audio and video input acquisition nodes, the audio and video output display nodes, and the seat operation nodes are all multiple;

[0013] The plurality of audio and video input acquisition nodes, the plurality of audio and video output display nodes, and the plurality of seat operation nodes are all configured with a device ID;

[0014] The dedicated audio and video switch performs optical fiber signal exchange for the audio and video input acquisition node, the audio and video output display node, and the seat operation node through the device ID and the USB control signal;

[0015] The dedicated audio and video switch is also used to allocate the audio and video input acquisition node to the seat operation node according to the account authority.

[0016] Further, the audio and video input acquisition node includes a first core board, an HDMI input board and an optical fiber communication board;

[0017] The audio and video output display node includes a second core board, an HDMI output board and an optical fiber communication board;

[0018] The seat operation node includes a third core board, an HDMI input board, an HDMI output board, an optical fiber communication board, and a USB and audio board;

[0019] The HDMI input board and the HDMI output board are both connected to the first core board or the second core board or the third core board through a PCIE interface;

[0020] The optical fiber communication board is connected to the first core board or the second core board or the third core board through a board-to-board connector, and the optical fiber communication board is used for exchanging optical fiber signals;

[0021] The HDMI input board is connected to the image acquisition device, and the HDMI input board is used to receive a first image signal and convert the first image signal into an image digital signal;

[0022] The HDMI output board is connected to the display device, and the HDMI output board is used to receive the second image signal and convert the second image signal into an image digital signal;

[0023] The USB and audio board is connected to the USB control device and the audio device, and the USB and audio board is used to receive USB control signals and audio signals.

[0024] Furthermore, the first core board includes an image encoding module, a data packet module and a SerDes transceiver module;

[0025] The second core board includes an image decoding module, a data unpacking module and a SerDes transceiver module;

[0026] The third core board includes a USB and audio module, an image encoding module, an image decoding module, a data packaging module, a data unpacking module and a SerDes transceiver module.

[0027] Furthermore, the USB and audio module is used for data conversion of USB control signals and data conversion of audio signals, wherein the data conversion of USB control signals is data conversion between USB control signals and UART data, and the data conversion of audio signals is data conversion between audio signals and IIS data;

[0028] The image encoding module is used to convert the image digital signal into a second image signal, and compress the second image signal using an image compression algorithm to obtain image compression data;

[0029] The image decoding module is used to decompress the image compression data using an image compression algorithm to obtain a second image signal;

[0030] The data packaging module is used to perform data packaging operations on the image compression data, the UART data and the IIS data using a private protocol to obtain parallel digital signals, wherein the parallel digital signals are the image compression data, the UART data and the IIS data transmitted in parallel;

[0031] The data unpacking module is used to perform data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data;

[0032] The SerDes transceiver module is used to convert the parallel digital signal into serial SerDes data, or convert the SerDes data into parallel digital signals.

[0033] Furthermore, the image compression algorithm is a JPEG2000 compression algorithm;

[0034] The JPEG2000 compression algorithm uses a multi-level wavelet transform to decompose the image data of the second image signal into compression modules of multiple levels;

[0035] For compression modules of different levels, a data congestion control mechanism is used to compare the compressed data volumes of the multiple compression modules and determine the compression order of the multiple compression modules;

[0036] During the encoding process, the image encoding module uses a timestamp to mark each compression module;

[0037] During the decoding process, the image decoding module stores the image of the same frame into the continuous address area of ​​the DDR memory according to the timestamp marked by each compression module.

[0038] In a second aspect, an embodiment of the present application provides a non-IP optical fiber seat collaboration method, which is applicable to the above-mentioned non-IP optical fiber seat collaboration system, and the method includes:

[0039] Acquiring a collection signal through the audio and video input collection node or the seat operation node;

[0040] Converting the collected signal into an optical fiber signal, inputting the optical fiber signal into the audio and video dedicated switch, and marking the optical fiber signal with data according to a private protocol;

[0041] Distributing the optical fiber signal to the seat operation node or the audio and video output display node according to the USB control signal of the seat operation node;

[0042] The optical fiber signal is converted into a collaborative signal through the seat operation node or the audio and video output display node, and the image digital signal of the collaborative signal is displayed on a display device.

[0043] Furthermore, the step of converting the collected signal into an optical fiber signal and inputting the optical fiber signal into the audio and video dedicated switch includes:

[0044] Converting the first image signal into an image digital signal;

[0045] Converting the image digital signal into a second image signal, and compressing the second image signal using an image compression algorithm to obtain image compression data;

[0046] Convert the USB control signal into UART data, and convert the audio signal into IIS data;

[0047] Using a private protocol to perform data packetization operation on the image compression data, the UART data and the IIS data to obtain a parallel digital signal, wherein the parallel digital signal is the image compression data, the UART data and the IIS data transmitted in parallel;

[0048] Convert the parallel digital signal into serial SerDes data;

[0049] The SerDes data is converted into an optical fiber signal, and the optical fiber signal is sent to an audio and video dedicated switch via an optical fiber.

[0050] Further, the cooperation signal includes a second image signal, a USB control signal and an audio signal;

[0051] The step of converting the optical fiber signal into a cooperative signal and displaying the image digital signal of the cooperative signal on a display device comprises:

[0052] Convert the optical fiber signal into serial SerDes data;

[0053] Converting the SerDes data into parallel digital signals;

[0054] Performing data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data;

[0055] Decompressing the image compression data using an image compression algorithm to obtain a second image signal;

[0056] Convert the second image signal into an image digital signal through an HDMI output board, and output the image digital signal to a display device;

[0057] The UART data and the IIS data are converted into USB control signals and audio signals respectively through the USB and audio modules.

[0058] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0059] The present application discloses a non-IP type fiber optic seat collaboration system, which converts the acquisition signal into a fiber optic signal and transmits data through the fiber optic signal, thereby ensuring the high quality and low latency of the acquisition signal during the transmission process and further improving the data transmission efficiency. At the same time, when the acquisition signal is converted into a fiber optic signal, a data packet operation is performed on the acquisition signal, thereby effectively reducing the size of the transmitted data, thereby reducing the pressure on the transmission bandwidth, reducing the latency of data transmission, and ensuring the clarity of the final output image. In addition, a private protocol is introduced in the process of converting the acquisition signal into a fiber optic signal. Through the private protocol, the converted fiber optic signal can be data marked, thereby enabling the audio and video dedicated switch to obtain the node information of the audio and video input acquisition node or the seat operation node encapsulated in the fiber optic signal, thereby facilitating the audio and video dedicated switch to identify the source device of the data and realizing efficient identification and accurate node switching between different devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0061] Figure 1 It is a structural schematic diagram of a non-IP optical fiber seat collaboration system provided by an embodiment of the present invention;

[0062] Figure 2 is a structural diagram of an agent operation node provided by an embodiment of the present invention;

[0063] Figure 3 It is a flowchart of a non-IP optical fiber agent collaboration method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0064] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and systems are omitted to prevent unnecessary details from obstructing the description of the present application.

[0065] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0066] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0067] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0068] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0069] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0070] See also Figure 1-2 As shown, the present invention is a non-IP optical fiber seat collaboration system, the system comprising: an audio and video input acquisition node, an audio and video output display node, an agent operation node and an audio and video dedicated switch;

[0071] The audio and video input acquisition node, the audio and video output display node and the seat operation node are all connected to the audio and video dedicated switch;

[0072] The audio and video input acquisition node and the seat operation node are both used to obtain acquisition signals and convert the acquisition signals into optical fiber signals, mark the optical fiber signals with data according to a private protocol, and transmit the optical fiber signals to the audio and video dedicated switch through optical fibers, wherein the acquisition signals include a first image signal, an audio signal or a USB control signal;

[0073] The audio and video dedicated switch is used to receive the optical fiber signals of the audio and video input acquisition node and the seat operation node, and distribute the optical fiber signals to the audio and video output display node or the seat operation node according to the USB control signal of the seat operation node;

[0074] The audio and video output display node and the seat operation node are both used to receive the optical fiber signal of the audio and video dedicated switch, and convert the optical fiber signal into a collaborative signal, and display the image digital signal of the collaborative signal on a display device.

[0075] In the present application, both the audio and video input acquisition node and the seat operation node can obtain the acquisition signal, and in the transmission process, the acquisition signal is converted into an optical fiber signal by data processing. Preferably, the optical fiber signal has the characteristics of high bandwidth and low attenuation, which ensures the high quality and low delay of the acquisition signal during the transmission process, effectively reduces the size of the transmitted data, and thereby reduces the transmission bandwidth pressure and improves the stability of the operation under the same transmission resolution.

[0076] In this embodiment, the audio and video dedicated switch receives the optical fiber signals of the audio and video input acquisition node and the seat operation node, and transmits the optical fiber signals to the audio and video output display node or the seat operation node through the USB control signal of the seat operation node. It can be understood that the audio and video output display node and the seat operation node are both connected to the display device.

[0077] In this embodiment, the seat operation node and the audio and video output display node can convert the received optical fiber signal into a collaborative signal, so as to facilitate the identification of data between the seats and realize seamless collaboration and information sharing between the seats.

[0078] In this embodiment, a private protocol is introduced in the process of converting the collected signal into an optical fiber signal. Through the private protocol, the converted optical fiber signal can be data-marked, so that the audio and video dedicated switch can obtain the node information of the audio and video input collection node or the seat operation node encapsulated in the optical fiber signal, which is convenient for the audio and video dedicated switch to identify the source device of the data. In addition, before transmitting data, it is also necessary to detect the node status of the audio and video output display node or the seat operation node to ensure that the audio and video output display node and the seat operation node are available and ready to receive data, thereby improving the reliability of data transmission.

[0079] In summary, the non-IP fiber optic collaboration system disclosed in the present application converts the collected signals into fiber optic signals, and transmits data through fiber optic signals, thereby ensuring the high quality and low latency of the collected signals during transmission, further improving the data transmission efficiency, and at the same time marking the fiber optic signals through private protocols, which can replace IP addresses for data transmission, thereby achieving efficient identification between different nodes and accurate node switching.

[0080] In some of the embodiments, the private protocol obtains a communication data packet by modifying the UDP protocol through preset rules, wherein the preset rules include reducing protocol header information, and the communication data packet includes a sending ID, a receiving ID, and frame information.

[0081] In this embodiment, the node information of the audio and video input acquisition node, the seat operation node, and the audio and video output display node is encapsulated into a communication data packet that can be used for data transmission through a private protocol. The node information of each node is used instead of the IP address for data transmission, thereby achieving efficient identification and accurate node switching between different nodes, and further improving the data transmission efficiency.

[0082] Specifically, the UDP protocol is modified through preset rules, such as reducing the header information of the UDP protocol, and only retaining the necessary information required for identifying the audio and video input acquisition nodes, audio and video output display nodes, and agent operation nodes. In a preferred embodiment, the device ID is used to replace the IP address for data transmission, such as replacing the source port, destination port, length and other information related to the IP address with the resolution information, refresh rate, line number and other frame information related to the image information transmission, and other header information in the UDP protocol is deleted.

[0083] In a preferred embodiment, the data structure of the communication data packet is shown in the following table:

[0084]

[0085] In some embodiments, the number of the audio and video input acquisition nodes, the audio and video output display nodes, and the seat operation nodes are all multiple;

[0086] The plurality of audio and video input acquisition nodes, the plurality of audio and video output display nodes, and the plurality of seat operation nodes are all configured with a device ID;

[0087] The dedicated audio and video switch performs optical fiber signal exchange for the audio and video input acquisition node, the audio and video output display node, and the seat operation node through the device ID and the USB control signal;

[0088] The dedicated audio and video switch is also used to allocate the audio and video input acquisition node to the seat operation node according to the account authority.

[0089] In this embodiment, by configuring a unique device ID for the audio and video input acquisition node, the audio and video output display node, and the seat operation node, while converting the acquisition signal into an optical fiber signal, the device ID is encapsulated as a communication data packet for data transmission, which is used to mark the optical fiber signal, so that the audio and video dedicated intersection can identify the identification and data transmission between each node. It can be understood that the use of a unique device ID to mark the audio and video input acquisition node, the audio and video output display node, and the seat operation node reduces the time for IP address resolution and routing lookup, improves the efficiency of data transmission, and at the same time ensures the transmission of data between designated devices, avoids transmission failures caused by IP address errors, and thereby achieves efficient identification and precise switching of nodes.

[0090] It is worth noting that there are multiple audio and video input acquisition nodes, audio and video output display nodes, and agent operation nodes, and the number of nodes can be increased according to demand to improve the scalability of the non-IP fiber-optic agent collaboration system, and the above-mentioned multiple nodes are connected to the audio and video dedicated switch for fiber-optic signal exchange. During the data transmission process, different audio and video input acquisition nodes and agent operation nodes return different fiber-optic signals, which correspond to different audio and video output display nodes and agent operation nodes, thereby realizing multi-node switching and improving the flexibility of the non-IP fiber-optic agent collaboration system.

[0091] In this embodiment, the dedicated audio and video switch can also switch the audio and video output display nodes and the seat operation nodes. Specifically, after receiving the corresponding optical fiber signal, the dedicated audio and video switch can transmit the received optical fiber signal to the required audio and video output display node or seat operation node according to the device status of the audio and video output display node and the device status of the seat operation node. At the same time, according to the USB control signal of the seat operation node, based on the device ID of the audio and video output display node and the device ID of the seat operation node, the optical fiber signal is switched to the transmission data of the specified node, thereby realizing node switching during data transmission.

[0092] In this embodiment, the dedicated audio and video switch can also allocate audio and video input acquisition nodes to the seat operation nodes. Specifically, part of the optical fiber signal received in the seat operation node comes from the seat operation node, and the other part comes from the audio and video input acquisition node. For the part coming from the audio and video input acquisition node, it is necessary to allocate the audio and video input acquisition node to the seat operation node according to the account authority through the dedicated audio and video switch before data transmission, so that users of different levels can only access the transmission data within their authority range, which effectively improves the security of the system and the confidentiality of the data, and also facilitates the management and maintenance of the system. In a preferred embodiment, the account authority can be modified or added by connecting a tablet or PC (i.e., PC_controler) to the dedicated audio and video switch through a network.

[0093] In some of the embodiments, the audio and video input acquisition node includes a first core board, an HDMI input board, and an optical fiber communication board;

[0094] The audio and video output display node includes a second core board, an HDMI output board and an optical fiber communication board;

[0095] The seat operation node includes a third core board, an HDMI input board, an HDMI output board, an optical fiber communication board, and a USB and audio board;

[0096] The HDMI input board and the HDMI output board are both connected to the first core board or the second core board or the third core board through a PCIE interface;

[0097] The optical fiber communication board is connected to the first core board or the second core board or the third core board through a board-to-board connector, and the optical fiber communication board is used for exchanging optical fiber signals;

[0098] The HDMI input board is connected to the image acquisition device, and the HDMI input board is used to receive a first image signal and convert the first image signal into an image digital signal;

[0099] The HDMI output board is connected to the display device, and the HDMI output board is used to receive the second image signal and convert the second image signal into an image digital signal;

[0100] The USB and audio board is connected to the USB control device and the audio device, and the USB and audio board is used to receive USB control signals and audio signals.

[0101] In this embodiment, the first core board, the second core board and the third core board can receive various acquisition signals, such as a first image signal, an audio signal or a USB control signal, and convert the above-mentioned acquisition signals into serial SerDes data. The SerDes data can be converted into an optical fiber signal through the optical fiber communication board, and long-distance, high-speed data transmission is performed through the optical fiber line, and it is sent to the audio and video dedicated switch to realize signal transmission between the audio and video dedicated switch and each node. Therefore, the first core board, the second core board and the third core board and the optical fiber communication board, as the receiving end and the transmitting end of the audio and video exchange center, can efficiently utilize the high speed and long-distance transmission capability of optical fiber communication for data transmission, while maintaining compatibility with digital processing devices such as FPGA.

[0102] In this embodiment, the HDMI output board is connected to the image acquisition device, and the HDMI output board can convert the first image signal acquired by the image acquisition device into an image digital signal with a unified data format, which is beneficial to compress the image data of the first image signal and facilitate its subsequent conversion into an optical fiber signal. Specifically, preferably, the image acquisition device is a PC terminal, and the image acquisition device is usually located in a computer room.

[0103] In this embodiment, the display device is connected via an HDMI output board. Through the HDMI output board, the audio and video output display node and the seat operation node can display the image digital signal on the display device. Preferably, the display device is usually a terminal device such as a large display screen that can display the image digital signal.

[0104] Specifically, the first core board, the second core board, the HDMI input board and the HDMI output board all include HDMI ports, and the PICE interface is used between the two HDMI ports to realize data transmission. The PCIE interface is a high-speed serial computer expansion bus standard with the advantage of high bandwidth characteristics. Its data transmission rate is much higher than the traditional parallel bus standard, which can meet the high requirements of high-definition audio and image signals for data transmission rate and can support high-speed data transmission.

[0105] Specifically, the fiber optic communication board is connected to the first core board or the second core board or the third core board through a board-to-board connector, thereby realizing the exchange of fiber optic signals between the audio and video input acquisition node, the audio and video output display node, and the seat operation node and the audio and video dedicated switch. Specifically, the fiber optic communication board is used to convert SerDes data into fiber optic signals, or to convert fiber optic signals into serial SerDes data.

[0106] In this embodiment, the seat operation node also includes a USB and audio board, through which USB control signals and audio signals can be received. Through the USB control signal, the audio and video dedicated switch can return the optical fiber signals of different nodes to achieve multi-node switching. Specifically, the USB and audio board is connected to the USB control device and the audio device, wherein the USB control device includes a USB mouse and a USB keyboard.

[0107] In some embodiments, the first core board includes an image encoding module, a data packet module and a SerDes transceiver module;

[0108] The second core board includes an image decoding module, a data unpacking module and a SerDes transceiver module;

[0109] The third core board includes a USB and audio module, an image encoding module, an image decoding module, a data packaging module, a data unpacking module and a SerDes transceiver module.

[0110] In this embodiment, the first core board can convert the acquisition signal into a fiber optic signal, the second core board can convert the fiber optic signal into a collaboration signal, and the third core board can convert the acquisition signal into a fiber optic signal and convert the fiber optic signal into a collaboration signal. Thus, the acquisition signal can be converted into a fiber optic signal through the audio and video input acquisition node and the seat operation node, and the fiber optic signal is transmitted to the audio and video dedicated switch. The audio and video dedicated switch distributes the fiber optic signal to the audio and video output display node or the seat operation node through the USB control signal, device ID and device status. The audio and video output display node and the seat operation node can convert the fiber optic signal into a collaboration signal that can be recognized between each seat.

[0111] Specifically, image signals usually contain a large amount of redundant information and unnecessary parts. Direct transmission will take up a lot of bandwidth and storage space. In addition, the acquisition signals collected by different image acquisition devices usually use different communication protocols and data formats. The data content is large, which is not conducive to data transmission. Therefore, before performing data packet operations, it is necessary to encode the image digital signal to ensure the consistency between data and improve the stability of the system. Similarly, for the agent operation node, the USB control signal and audio signal received by it through the USB and audio board must be converted into a data mode with a standard format through the USB and audio module, so that the non-IP fiber-optic agent collaboration system has the advantages of high transmission efficiency, low latency, and stable and reliable, and can achieve high-speed and reliable data transmission.

[0112] In some embodiments, the USB and audio module is used for data conversion of USB control signals and data conversion of audio signals, wherein the data conversion of USB control signals is data conversion between USB control signals and UART data, and the data conversion of audio signals is data conversion between audio signals and IIS data;

[0113] The image encoding module is used to convert the image digital signal into a second image signal, and compress the second image signal using an image compression algorithm to obtain image compression data;

[0114] The image decoding module is used to decompress the image compression data using an image compression algorithm to obtain a second image signal;

[0115] The data packaging module is used to perform data packaging operations on the image compression data, the UART data and the IIS data using a private protocol to obtain parallel digital signals, wherein the parallel digital signals are the image compression data, the UART data and the IIS data transmitted in parallel;

[0116] The data unpacking module is used to perform data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data;

[0117] The SerDes transceiver module is used to convert the parallel digital signal into serial SerDes data, or convert the SerDes data into parallel digital signals.

[0118] In this embodiment, before performing the data packet operation, the USB control signal, the image digital signal and the audio signal need to be converted into UART data, image compression data and IIS data in sequence to ensure the consistency between the data and improve the stability of the system.

[0119] In addition, the above-mentioned UART data, image compression data and IIS data are packaged into UART data, image compression data and IIS data for parallel transmission through the data packaging module, which is conducive to the SerDes transceiver module to convert them into serial high-speed SerDes data. The SerDes transceiver module uses SerDes technology, which has efficient serialization and deserialization capabilities, and can significantly reduce the number of signal lines required for data transmission, thereby reducing system complexity and cost. At the same time, SerDes technology also has the characteristics of high bandwidth, low latency and high reliability, which makes the non-IP fiber-optic agent collaboration system have the advantages of high transmission efficiency, low latency and stable and reliable, and can achieve high-speed and reliable data transmission.

[0120] In addition, UART data is a widely used serial communication protocol that transmits data through timing. Each data frame includes a start bit, a data bit, a stop bit, etc. It is suitable for low-speed, short-distance communication scenarios. Before data packaging, converting the signal into UART data can ensure the stability and reliability of the data during transmission. IIS data is a serial interface protocol for transmitting audio data. It can achieve audio data transmission through three lines (clock line, data line, and ground line). It is simple and efficient. After converting the audio signal into IIS data, it can be easily transmitted through the serial interface. It is suitable for the connection and data exchange of audio equipment.

[0121] For image signals, image digital signals are converted into image compressed data through image compression methods, which can remove redundant information and correlation of image signals, thereby significantly reducing the data volume, and then reducing the size of transmitted data, while ensuring image clarity and low latency. After the image signal is converted into compressed data, data packaging is performed, which can greatly improve transmission efficiency and storage density.

[0122] The USB control signal and the audio signal are converted through the USB and audio module. Specifically, the USB and audio module includes a CH9350 chip and an audio digital-to-analog conversion chip. The CH9350 chip is used to convert the USB control signal into UART data, or to convert the UART data into a USB control signal. The audio digital-to-analog conversion chip is used to convert the audio signal into IIS data, or to convert the IIS data into an audio signal.

[0123] In this embodiment, the first image signal sent by the image acquisition device is converted into an image digital signal in the YCbCr444 format through the HDMI input board, and input into the first core board or the third core board. The first core board or the third core board receives the above-mentioned image digital signal in the YCbCr444 format, converts it into a second image signal in the YCbCr422 format through the image encoding module, and then compresses the data through the image compression method to obtain image compression data, and performs data packetization operation on the image signal based on the image compression data. It can be understood that before outputting the image signal to the display device, it is also necessary to decompress the above-mentioned image compression data through the image decoding module to convert it into a second image signal in the YCbCr422 format, and then convert the above-mentioned second image signal into an image digital signal in the YCbCr444 format through the HDMI output board, so that the corresponding image information can be displayed on the display device.

[0124] In some embodiments, the image compression algorithm is a JPEG2000 compression algorithm;

[0125] The JPEG2000 compression algorithm uses a multi-level wavelet transform to decompose the image data of the second image signal into compression modules of multiple levels;

[0126] For compression modules of different levels, a data congestion control mechanism is used to compare the compressed data volumes of the multiple compression modules and determine the compression order of the multiple compression modules;

[0127] During the encoding process, the image encoding module uses a timestamp to mark each compression module;

[0128] During the decoding process, the image decoding module stores the image of the same frame into the continuous address area of ​​the DDR memory according to the timestamp marked by each compression module.

[0129] In this embodiment, the JPEG2000 compression algorithm is an advanced image compression algorithm, which reduces the block effect by directly processing the overall image data of the second image signal, thereby improving the image quality of the compressed image. Specifically, the JPEG2000 compression algorithm decomposes the image data of the second image signal into compression modules of different levels by adopting multi-level wavelet transform, and then compresses each compression module. The compression process adopts the lossless compression algorithm in JPEG2000, and only needs to perform bit plane coding and mq arithmetic coding, which can reduce the complexity of algorithm implementation and increase image clarity. For bit plane coding, a method of simultaneously processing multiple bit planes is adopted, and different bit plane coding is performed independently. In the coding process, each bit plane will be encoded according to its own characteristics. For example, for bit planes containing more important information (such as high bit planes), a more sophisticated coding strategy will be adopted to retain more detail information, and for bit planes containing less important information (such as low bit planes), a simpler coding strategy will be adopted to reduce the amount of calculation and storage requirements.

[0130] In this embodiment, in the multi-level wavelet transform, the image data of the second image signal will be decomposed into sub-images of different frequencies and resolutions step by step, and then divided into compression modules of different levels. Specifically, each level of transformation will divide the image into multiple levels. As the transformation level increases, the resolution of the compression module with a higher level will be higher, and the corresponding number of pixels will also increase accordingly. Specifically, when performing a two-level wavelet transform, the number of pixels of the second-level compression module is usually one-fourth of that of the previous level (i.e., the first-level compression module).

[0131] Since there are similar calculation steps and data processing flows in the transformation processes at different levels, the amount of calculation and storage requirements can be reduced by reusing the compression modules at the lower level. For example, in the above-mentioned embodiment of the secondary wavelet transformation, some calculation modules or data processing flows in the primary transformation can be reused to reduce the corresponding amount of calculation.

[0132] In this embodiment, the compression order of multiple compression modules is determined through a data congestion control mechanism. Specifically, the priority of each compression module is determined by comparing the compressed data volumes of the multiple compression modules. In the process of bit plane encoding, the high-bit plane usually contains more detail information, which is beneficial to improving the image compression quality. Therefore, in the process of priority determination, the sending priority of the high-bit plane will be increased accordingly. In addition, a multi-level FIFO method is adopted to store the compression module corresponding to the compressed data with the highest priority and the compressed data volume that meets the transmission requirements into the FIFO queue to be sent, thereby reducing memory pressure and preventing memory overflow from causing image loss or shifting.

[0133] In addition, the image compression algorithm of the image decoding module is the inverse process of the image compression algorithm of the image encoding module. During the encoding process, each compression module is marked with a timestamp. During the decoding process, each compression module will have an associated timestamp, which is used to identify the decoding order of each compression module. The image decoding module will store the image data of the same frame into the continuous address area of ​​the DDR memory based on this timestamp to ensure the integrity and continuity of the image data, and facilitate subsequent image display and processing.

[0134] In some embodiments, the JPEG2000 compression algorithm also adds an image error correction function. Specifically, the checksum is checked first and the high-order plane image is decoded, so that the erroneous data packets can be found and discarded in time, ensuring that the decoded high-order image is not affected, and improving the image error resistance. At the same time, even if only part of the data is received, JPEG2000 can also obtain a lower-quality image to ensure the system's working ability. For example, when packet loss or delay occurs during network transmission, available image information can still be obtained.

[0135] See also Figure 3 As shown, the present application also provides a non-IP type fiber optic seat collaboration method, including the above-mentioned non-IP type fiber optic seat collaboration system, the method comprising:

[0136] Acquiring a collection signal through the audio and video input collection node or the seat operation node;

[0137] Converting the collected signal into an optical fiber signal, inputting the optical fiber signal into the audio and video dedicated switch, and marking the optical fiber signal with data according to a private protocol;

[0138] Distributing the optical fiber signal to the seat operation node or the audio and video output display node according to the USB control signal of the seat operation node;

[0139] The optical fiber signal is converted into a collaborative signal through the seat operation node or the audio and video output display node, and the image digital signal of the collaborative signal is displayed on a display device.

[0140] In the present application, both the audio and video input acquisition node and the seat operation node can be connected to the image acquisition device through the HDMI input board. Therefore, in the non-IP fiber-optic seat collaboration method, the acquisition signal can be obtained through the audio and video input acquisition node or the seat operation node. At the same time, for the acquisition signal of the audio and video input acquisition node, the acquisition signal can be converted into an optical fiber signal through the first core board and transmitted to the audio and video dedicated switch. The audio and video dedicated switch distributes the optical fiber signal to the audio and video output display node or the seat operation node according to the USB control signal, and converts the optical fiber signal into a collaboration signal through the audio and video output display node or the seat operation node; similarly, for the acquisition signal of the seat operation node, the acquisition signal can be converted into an optical fiber signal through the second core board and transmitted to the audio and video dedicated switch. The audio and video dedicated switch distributes the optical fiber signal to the audio and video output display node or the seat operation node according to the USB control signal.

[0141] In this embodiment, after the optical fiber signal is transmitted to the audio and video dedicated switch, the audio and video dedicated switch configures the corresponding audio and video output display node or seat operation node for it, and then can convert the optical fiber signal into a collaborative signal, so that the collaborative signal can be displayed through the audio and video output display node and applied to the display device, thereby realizing seamless collaboration and information sharing between seats.

[0142] For the optical fiber signals allocated to the seat operation nodes, before allocation, the audio and video dedicated switch needs to allocate the audio and video input acquisition nodes to the seat operation nodes according to the account permissions, so that users of different levels can only access the transmission data within their authority.

[0143] In some embodiments, converting the collected signal into an optical fiber signal and inputting the optical fiber signal into the audio and video dedicated switch includes:

[0144] Converting the first image signal into an image digital signal;

[0145] Converting the image digital signal into a second image signal, and compressing the second image signal using an image compression algorithm to obtain image compression data;

[0146] Convert the USB control signal into UART data, and convert the audio signal into IIS data;

[0147] Using a private protocol to perform data packetization operation on the image compression data, the UART data and the IIS data to obtain a parallel digital signal, wherein the parallel digital signal is the image compression data, the UART data and the IIS data transmitted in parallel;

[0148] Convert the parallel digital signal into serial SerDes data;

[0149] The SerDes data is converted into an optical fiber signal, and the optical fiber signal is sent to an audio and video dedicated switch via an optical fiber.

[0150] In this embodiment, when the acquisition signal is converted into an optical fiber signal, a data packet operation is performed on the acquisition signal, which effectively reduces the size of the transmitted data, thereby reducing the transmission bandwidth pressure, reducing the delay of data transmission, and ensuring the clarity of the final output image.

[0151] In this embodiment, before the image encoding module performs compression encoding, the HDMI input board converts the first image signal into an image digital signal with a unified data format, which is beneficial to compressing the image data of the first image signal.

[0152] In some of these embodiments, the cooperation signal includes a second image signal, a USB control signal, and an audio signal;

[0153] The step of converting the optical fiber signal into a cooperative signal and displaying the image digital signal of the cooperative signal on a display device comprises:

[0154] Convert the optical fiber signal into serial SerDes data;

[0155] Converting the SerDes data into parallel digital signals;

[0156] Performing data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data;

[0157] Decompressing the image compression data using an image compression algorithm to obtain a second image signal;

[0158] Convert the second image signal into an image digital signal through an HDMI output board, and output the image digital signal to a display device;

[0159] The UART data and the IIS data are converted into USB control signals and audio signals respectively through the USB and audio modules.

[0160] In this embodiment, before the optical fiber signal is output to the display device, it is necessary to convert the optical fiber signal into a USB control signal, an audio signal and an image digital signal that can be recognized by the display device. Therefore, the audio and video output display node and the seat operation node are required to be equipped with an optical fiber communication board. The optical fiber signal is converted into SerDes data through the optical fiber communication board, and the SerDes data is converted into image compression data, UART data and IIS data for parallel transmission through the SerDes transceiver module of the second core board or the third core board. The above-mentioned image compression data, UART data and IIS data are then converted through the image decoding module and the USB and audio modules to obtain the second image signal, USB control signal and audio signal. For the second image signal, it is necessary to convert it into an image digital signal through the HDMI output board so that the image information corresponding to the image digital signal can be displayed on the display device, and the USB control signal can realize remote control of the display device.

[0161] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A non-IP optical fiber seat collaboration system, characterized in that: include: Audio and video input acquisition nodes, audio and video output display nodes, seat operation nodes and audio and video dedicated switches; The audio and video input acquisition node, the audio and video output display node and the seat operation node are all connected to the audio and video dedicated switch; The audio and video input acquisition node and the seat operation node are both used to obtain acquisition signals and convert the acquisition signals into optical fiber signals, perform data marking on the optical fiber signals according to a private protocol, and transmit the optical fiber signals to the audio and video dedicated switch, wherein the acquisition signals include a first image signal, an audio signal or a USB control signal; The audio and video dedicated switch is used to receive the optical fiber signals of the audio and video input acquisition node and the seat operation node, and distribute the optical fiber signals to the audio and video output display node or the seat operation node according to the USB control signal of the seat operation node; The audio and video output display node and the seat operation node are both used to receive the optical fiber signal of the audio and video dedicated switch, and convert the optical fiber signal into a collaborative signal, and display the image digital signal of the collaborative signal on a display device.

2. The system according to claim 1, characterized in that The private protocol is to obtain a communication data packet by modifying the UDP protocol through preset rules, wherein the preset rules include reducing the protocol header information, and the communication data packet includes a sending ID, a receiving ID and frame information.

3. The system according to claim 1, characterized in that The number of the audio and video input acquisition nodes, the audio and video output display nodes and the seat operation nodes are all multiple; The plurality of audio and video input acquisition nodes, the plurality of audio and video output display nodes, and the plurality of seat operation nodes are all configured with a device ID; The dedicated audio and video switch performs optical fiber signal exchange for the audio and video input acquisition node, the audio and video output display node, and the seat operation node through the device ID and the USB control signal; The dedicated audio and video switch is also used to allocate the audio and video input acquisition node to the seat operation node according to the account authority.

4. The system according to claim 1, characterized in that The audio and video input acquisition node includes a first core board, an HDMI input board and an optical fiber communication board; The audio and video output display node includes a second core board, an HDMI output board and an optical fiber communication board; The seat operation node includes a third core board, an HDMI input board, an HDMI output board, an optical fiber communication board, and a USB and audio board; The HDMI input board and the HDMI output board are both connected to the first core board or the second core board or the third core board through a PCIE interface; The optical fiber communication board is connected to the first core board or the second core board or the third core board through a board-to-board connector, and the optical fiber communication board is used for exchanging optical fiber signals; The HDMI input board is connected to the image acquisition device, and the HDMI input board is used to receive a first image signal and convert the first image signal into an image digital signal; The HDMI output board is connected to the display device, and the HDMI output board is used to receive the second image signal and convert the second image signal into an image digital signal; The USB and audio board is connected to the USB control device and the audio device, and the USB and audio board is used to receive USB control signals and audio signals.

5. The system according to claim 4, characterized in that The first core board includes an image encoding module, a data packet module and a SerDes transceiver module; The second core board includes an image decoding module, a data unpacking module and a SerDes transceiver module; The third core board includes a USB and audio module, an image encoding module, an image decoding module, a data packaging module, a data unpacking module and a SerDes transceiver module.

6. The system according to claim 5, characterized in that The USB and audio module is used for data conversion of USB control signals and data conversion of audio signals. The data conversion of USB control signals is used for data conversion between USB control signals and UART data, and the data conversion of audio signals is used for data conversion between audio signals and IIS data. The image encoding module is used to convert the image digital signal into a second image signal, and compress the second image signal using an image compression algorithm to obtain image compression data; The image decoding module is used to decompress the image compression data using an image compression algorithm to obtain a second image signal; The data packaging module is used to perform data packaging operations on the image compression data, the UART data and the IIS data using a private protocol to obtain parallel digital signals, wherein the parallel digital signals are the image compression data, the UART data and the IIS data transmitted in parallel; The data unpacking module is used to perform data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data; The SerDes transceiver module is used to convert the parallel digital signal into serial SerDes data, or convert the SerDes data into parallel digital signals.

7. The system according to claim 6, characterized in that The image compression algorithm is the JPEG2000 compression algorithm; The JPEG2000 compression algorithm uses a multi-level wavelet transform to decompose the image data of the second image signal into compression modules of multiple levels; For compression modules of different levels, a data congestion control mechanism is used to compare the compressed data volumes of the multiple compression modules and determine the compression order of the multiple compression modules; During the encoding process, the image encoding module uses a timestamp to mark each compression module; During the decoding process, the image decoding module stores the image of the same frame into the continuous address area of ​​the DDR memory according to the timestamp marked by each compression module.

8. A non-IP optical fiber seat collaboration method, characterized in that: Applicable to the non-IP optical fiber seat collaboration system according to any one of claims 1 to 7, the method comprising: Acquiring a collection signal through the audio and video input collection node or the seat operation node; Converting the collected signal into an optical fiber signal, inputting the optical fiber signal into the audio and video dedicated switch, and marking the optical fiber signal with data according to a private protocol; Distributing the optical fiber signal to the seat operation node or the audio and video output display node according to the USB control signal of the seat operation node; The optical fiber signal is converted into a collaborative signal through the seat operation node or the audio and video output display node, and the image digital signal of the collaborative signal is displayed on a display device.

9. The method according to claim 8, characterized in that The step of converting the collected signal into an optical fiber signal and inputting the optical fiber signal into the audio and video dedicated switch comprises: Converting the first image signal into an image digital signal; Converting the image digital signal into a second image signal, and compressing the second image signal using an image compression algorithm to obtain image compression data; Convert the USB control signal into UART data, and convert the audio signal into IIS data; Performing data packet operation on the image compression data, the UART data and the IIS data using a private protocol to obtain a parallel digital signal, wherein the parallel digital signal is the image compression data, the UART data and the IIS data transmitted in parallel; Convert the parallel digital signal into serial SerDes data; The SerDes data is converted into an optical fiber signal, and the optical fiber signal is sent to an audio and video dedicated switch via an optical fiber.

10. The method according to claim 8, characterized in that The cooperation signal includes a second image signal, a USB control signal and an audio signal; The step of converting the optical fiber signal into a cooperative signal and displaying the image digital signal of the cooperative signal on a display device comprises: Convert the optical fiber signal into serial SerDes data; Converting the SerDes data into parallel digital signals; Performing data unpacking operation on the parallel digital signal using a private protocol to obtain image compression data, UART data and IIS data; Decompressing the image compression data using an image compression algorithm to obtain a second image signal; Convert the second image signal into an image digital signal through an HDMI output board, and output the image digital signal to a display device; The UART data and the IIS data are converted into USB control signals and audio signals respectively through the USB and audio modules.

Images