Onboard KVM hardware coding and decoding method and device and storage medium

Abstract

The invention relates to an onboard KVM hardware coding and decoding method and device and a storage medium. The method comprises the steps that a calculation unit at a calculation blade end outputs at least one path of audio and video signals to an audio and video interface conversion module of a coding unit; an audio and video interface conversion module of the coding unit respectively processes audio and video signals, and then converts the audio and video signals into a network transmission format through a compression module; the media stream coded by the coding unit is transmitted to a user terminal through the Ethernet or the local area network; and a decoding unit of the user terminal performs high-definition low-delay algorithm decoding, and decoded audio and video signals are output to the display equipment through an interface conversion unit. The user terminal is connected with the computing blade end, multi-path high-quality audio and video transmission is achieved, meanwhile, keyboard and mouse operation of a user is obtained through the input and output device, and high-fidelity, low-delay, safe and reliable excellent access experience is ensured.

Description

Technical Field

[0001] The present invention relates to the field of KVM hardware, and in particular to an onboard KVM hardware encoding and decoding method, device and storage medium. Background Art

[0002] Traditional KVM switches display interfaces (HDMI, VGA, etc.) and mouse and keyboard interfaces (PS2 or USB). This type of KVM is limited by the length of the transmission cable between the display interface and the mouse and keyboard interface, and cannot be transmitted remotely on the Internet. Shallow compression coded KVM is transmitted through optical fiber or network cable, but generally only supports point-to-point transmission, does not support arbitrary selection of computer control by any client, and does not support Internet transmission. Distributed KVM systems generally use deep compression codecs, and the image clarity is lossy. And it does not support a user terminal and a set of mouse and keyboard to control two computers at the same time. The remote management of the server BMC is implemented using a dedicated BMC chip (such as ASPEED's AST2700, etc.), which is relatively expensive. Summary of the invention

[0003] The present invention provides an onboard KVM hardware encoding and decoding method, device and storage medium, aiming to solve at least one of the technical problems existing in the prior art.

[0004] The technical solution of the present invention is an onboard KVM hardware encoding and decoding method, which is applied to an onboard KVM hardware encoding and decoding device, wherein the onboard KVM hardware encoding and decoding device comprises: a computing blade end, a user terminal and an input and output device connected in sequence, wherein the computing blade end and the user terminal are electrically connected through a network, wherein the computing blade end comprises a computing unit, an encoding unit and an interface unit, and the user terminal comprises a decoding unit connected in sequence and an interface conversion unit for connecting to the input and output unit, and the onboard KVM hardware encoding and decoding method comprises the following steps: S100: The computing unit of the computing blade outputs at least one audio and video signal to the audio and video interface conversion module of the encoding unit; S200, the audio and video interface conversion module of the encoding unit processes the audio and video signals respectively, and then converts them into high-definition low-latency algorithm decoding through the compression module; S300, the media stream encoded by the encoding unit is transmitted to the user terminal via Ethernet or a local area network; S400: The decoding unit of the user terminal performs high-definition low-latency algorithm decoding, and the decoded audio and video signals are output to the display device through the interface conversion unit.

[0005] Furthermore, the onboard KVM hardware encoding and decoding method further includes the following steps: S500, the decoding unit of the user terminal collects action information of the USB device connected to the USB interface; S600: The decoding unit of the user terminal sends the action information to the encoding unit of the computing blade end through the network; S700: The encoding unit on the computing blade decodes the action information and sends the decoded action information to the computing unit on the computing blade.

[0006] Furthermore, in step S100, the audio and video signals are two-channel.

[0007] Further, the step S200 includes: S210, the audio and video interface conversion module of the encoding unit splits at least one audio and video signal into an audio part and a video part respectively; S220, the audio part is processed by the HDA to linear interface chip and the I2S interface chip in sequence, and then sent to the compression module of the encoding unit for encoding and compression processing; S230, after the video part is processed by the HDMI to RGB interface chip and the RGB to MIPI interface chip or the RGB to HDMI interface chip in sequence, it is sent to the FPGA module of the encoding unit for video frame signal segmentation, pixel reorganization, video data caching and video synthesis; S240, after the video part is processed by the FPGA module, it is sent to the compression module of the encoding unit for encoding and compression processing; S250, the compression module of the encoding unit collects the processed audio part and video part, encodes and compresses them using a high-definition low-latency encoding algorithm, and recombines them into at least one audio and video signal; S260: The compression module of the encoding unit sends at least one compressed audio and video signal to the interface unit of the encoding unit.

[0008] Further, in step S500, The action information at least includes keyboard key information and mouse coordinate information.

[0009] Further, in step S600, The USB port of the SoC chip of the encoding unit at the computing blade end is connected to the computing unit at the computing blade end as a device. The SoC chip is reported as a USB keyboard device and a USB mouse device through the driver software, and the acquired action information containing keyboard key or mouse coordinate information is transmitted to the computing unit at the computing blade end.

[0010] Furthermore, the present invention also provides an onboard KVM hardware codec device for executing the onboard KVM hardware codec method, wherein the onboard KVM hardware codec device comprises a computing blade end, a user terminal and an input / output device connected in sequence, wherein the computing blade end and the user terminal are electrically connected via a network. Wherein, the computing blade end includes: A computing unit, the computing unit comprising a central processing unit (CPU), a hard disk and a memory, the hard disk and the memory being electrically connected to the central processing unit respectively; A coding unit, the coding unit comprising an audio and video interface conversion module connected to the central processing unit CPU, an FPGA module for dividing a video frame signal into strip signals, pixel reorganization, video data caching and video synthesis, a video interface conversion module for converting a video format and a compression module for compressing an audio and video signal, the audio and video interface conversion module, the FPGA module, the video interface conversion module and the compression module are electrically connected in sequence, and the audio and video interface conversion module is electrically connected to the compression module; The interface unit at least includes an intelligent platform management interface IPMI, a service data network interface, a terminal access network interface and an external interface, and the computing unit and the encoding unit are electrically connected to the interface unit respectively.

[0011] Further, the audio and video interface conversion module of the encoding unit includes at least an audio interface chip and a video interface chip; The audio interface chip includes an HDA to linear interface chip connected to the computing unit and an I2S interface chip connected to the compression module, wherein the video interface chip includes an HDMI to RGB interface chip connected to the computing unit, an RGB to MIPI interface chip connected to the FPGA module, and an RGB to HDMI interface chip; The compression module of the encoding unit at least includes an RK3588 chip for realizing compression encoding of I2S audio and multiple video interfaces, permission processing and transmission functions of USB signals, and sending audio and video data to the cloud PC user terminal through the network port; The external interface of the interface unit at least includes a power interface, a SERDES interface, an I2C interface and a slot IO interface, wherein: The power interface is used to connect a 12V power supply; The SERDES interface includes a first SERDES interface connected to the service data network interface and a second SERDES interface connected to the terminal access network interface; The I2C interface is connected to the intelligent platform management interface IPMI, and the I2C interface is used to perform intelligent platform management IPMI management; The interface type of the slot IO interface is GPIO, and at least one slot IO interface is provided.

[0012] Further, the user terminal includes a decoding unit and an interface conversion unit connected to the input and output units in sequence, The decoding unit is used to decode audio and video signals, and the decoding unit is connected to the interface unit of the computing blade end through the Internet or a local area network. The input-output unit includes at least one display device connected to the interface conversion unit and at least one USB device connected to the decoding unit, and the USB device includes at least a keyboard, a mouse, a U disk and an optical drive.

[0013] Furthermore, the present invention also provides a computer-readable storage medium on which program instructions are stored. When the program instructions are executed by a processor, the onboard KVM hardware encoding and decoding method is implemented.

[0014] The beneficial effects of the present invention are: The onboard KVM hardware encoding and decoding method, device and storage medium are connected to the computing blade end through the user terminal to realize multi-channel high-quality audio and video transmission, and at the same time obtain the user's keyboard and mouse operations through the input and output devices to ensure high fidelity, low latency, safe and reliable excellent access experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 The figure is the overall flow chart of the onboard KVM hardware encoding and decoding method.

[0016] Figure 2 The present invention is a flowchart of an audio and video interface conversion module in an onboard KVM hardware encoding and decoding method processing audio and video signals separately and then converting them into a network transmission format through a compression module.

[0017] Figure 3 It is a structural diagram of the onboard KVM hardware codec device.

[0018] Figure 4 It is a schematic diagram of the structure of the computing blade end in the onboard KVM hardware codec device.

[0019] Figure 5 This is a schematic diagram of a pop-up menu on the left side of a user terminal in the onboard KVM hardware encoding and decoding method.

[0020] Figure 6 This is a schematic diagram showing that a user terminal can select two computers to be controlled simultaneously in the onboard KVM hardware encoding and decoding method.

[0021] Figure 7This is a schematic diagram of superimposing a watermark on the output screen controlled by the user terminal in the onboard KVM hardware encoding and decoding method.

[0022] 100, computing blade end; 110, computing unit; 111, central processing unit CPU; 112, hard disk; 113, memory; 120, encoding unit; 121, audio and video interface conversion module; 122, FPGA module; 123, video interface conversion module; 124, compression module; 130, interface unit; 131, intelligent platform management interface IPMI; 132, business data network interface; 133, terminal access network interface; 134, external interface; 200, user terminal; 210, decoding unit; 220, interface conversion unit; 300, input and output device; 310, display device; 320, USB device. DETAILED DESCRIPTION

[0023] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments and features in the embodiments of this application can be combined with each other without conflict.

[0024] It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature, or it may be indirectly fixed or connected to the other feature. In addition, the descriptions of up, down, left, right, top, bottom, etc. used in the present invention are only relative to the relative positional relationship of the components of the present invention in the drawings.

[0025] In addition, unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art. The terms used in this specification are only for describing specific embodiments, not for limiting the present invention. The term "and / or" used herein includes any combination of one or more related listed items.

[0026] It should be understood that, although the terms first, second, third, etc. may be used to describe various elements in the present disclosure, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, without departing from the scope of the present disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.

[0027] Reference Figures 1 to 7 In some embodiments, the technical solution of the present invention is an onboard KVM hardware encoding and decoding method. The onboard KVM hardware encoding and decoding method is applied to an onboard KVM hardware encoding and decoding device, which includes: a computing blade end 100, a user terminal 200 and an input / output device 300 connected in sequence, wherein the computing blade end 100 and the user terminal 200 are electrically connected through a network, wherein the computing blade end 100 includes a computing unit 110, an encoding unit 120 and an interface unit 130, and the user terminal 200 includes a decoding unit 210 connected in sequence and an interface conversion unit 220 for connecting to the input / output unit, Figure 1 The onboard KVM hardware encoding and decoding method comprises the following steps: S100, the computing unit 110 of the computing blade end 100 outputs at least one audio and video signal to the audio and video interface conversion module 121 of the encoding unit 120; S200, the audio and video interface conversion module 121 of the encoding unit 120 processes the audio and video signals respectively, and then converts them into high-definition low-latency algorithm decoding through the compression module 124; S300, the media stream encoded by the encoding unit 120 is transmitted to the user terminal 200 via Ethernet or a local area network; S400 , the decoding unit 210 of the user terminal 200 performs high-definition low-latency algorithm decoding, and the decoded audio and video signals are output to the display device 310 through the interface conversion unit 220 .

[0028] The beneficial effects of the present invention are: The onboard KVM hardware encoding and decoding method, device and storage medium are connected to the computing blade end 100 through the user terminal 200 to achieve multi-channel high-quality audio and video transmission, and at the same time obtain the user's keyboard and mouse operations through the input and output device 300, ensuring high fidelity, low latency, safe and reliable excellent access experience.

[0029] Specifically, the present invention proposes an onboard KVM hardware encoding and decoding method, device and storage medium. The traditional KVM is an external device, and the present invention integrates the KVM function on the computing blade board; the remote management of the traditional server BMC adopts a dedicated BMC chip, and the present invention adopts a universal encoding and decoding SoC chip (system-on-chip SoC) to implement it.

[0030] The computing blade can be connected through the user terminal 200 to ensure an excellent access experience with high performance, low latency, security and reliability.

[0031] (1) Connect to the cloud PC computing blade: Use high-fidelity, low-latency video transmission and encoding and decoding technology to ensure high-performance, low-latency, secure and reliable access experience.

[0032] (2) High-quality audio transmission: Audio data is transmitted in PCM format to ensure high sound quality, synchronization, and low latency for voice communication, video conferencing, and media playback.

[0033] (3) Remote power on / off control: FPGA is used to simulate a short power-on signal to turn on the compute blade; a long power-on signal of 8 seconds is used to turn off the compute blade; and a short power-on signal is used to wake up the compute blade in sleep mode.

[0034] (4) Blade status acquisition: You can obtain the status of all computing blades under the current login account (powered on, powered off, sleeping, starting, network failure).

[0035] (5) Automatic recovery of session interruption: supports session recovery after network interruption (within 30 seconds) to maintain user work continuity.

[0036] (6) Multi-host connection management: Allows users to connect and manage multiple cloud PC computing blades to meet the needs of different application scenarios.

[0037] (7) Dual-screen function support: In the single-machine dual-screen mode, the main and auxiliary screen images of the same computing blade can be collected and presented separately; in the dual-machine dual-screen mode, the decoding end can be set to receive and display the images of two different computing blades; support for keyboard and mouse cross-screen operation; support for one-way copying of clipboard and file data; flexible mode switching, the two modes can be dynamically switched through simple configuration, and the display mode can be flexibly adjusted according to specific needs.

[0038] Further, refer to Figure 1 The onboard KVM hardware encoding and decoding method further comprises the following steps: S500, the decoding unit 210 of the user terminal 200 collects action information of the USB device 320 connected to the USB interface; S600, the decoding unit 210 of the user terminal 200 sends the action information to the encoding unit 120 of the computing blade end 100 through the network; S700 : The encoding unit 120 of the computing blade end 100 decodes the action information and sends it to the computing unit 110 of the computing blade end 100 .

[0039] Furthermore, in step S100, the audio and video signals are two-channel.

[0040] In a specific embodiment, the computing blade end 100 can be connected to a user terminal via a network, and the user terminal can be a user's computer. The present invention supports a set of mouse and keyboard, and controls two computers at the same time, realizing seamless sliding connection between the mouse and keyboard.

[0041] For steps S500-S700, the user terminal 200 uses shortcut keys (such as CTRL+Q, and shortcut keys can be customized) to call up the left menu bar, and quickly switch the control computer by selecting the computer on the menu bar. The left menu bar of the user terminal 200 supports computer status display, including power on / off / sleep, etc. Two computers can be selected at the same time through the left menu bar of the user terminal 200, and they can be controlled simultaneously. Through USB over IP computing, other USB devices 320 (U disk, optical drive, printer, emulator, etc.) of the user terminal 200 are transparently transmitted to the computer; and the user terminal 200 has a permission management function for the USB device 320, which needs to be used after the permission is opened. Specifically, the permission of a certain type of device can be opened, or all USB permissions can be opened. The user terminal 200 can control the superposition of a watermark on the output desktop, and the desktop picture can be traced back to the source.

[0042] For a complete process, refer to Figures 5 to 7 The audio and video processing includes the HDMI / DP and other display interfaces of the computing unit 110 outputting the desktop image; the audio and video interface conversion module 121 converts the HDMI / DP and other interfaces into HDMI / mipi and other interfaces supported by the encoding, the encoding unit 120 uses a high-definition low-latency encoding algorithm for encoding, and the encoded media stream is transmitted to the user terminal 200 via Ethernet or a local area network. The decoding module of the user terminal 200 performs high-definition low-latency algorithm decoding, and the decoded image is output to the display through the interface conversion module.

[0043] In addition, the mouse and keyboard are connected through the USB port of the user terminal 200. After the decoding unit 210 receives the keyboard key or mouse coordinate information, it transmits the data to the encoding unit 120 of the computing blade end 100 through Ethernet. The USB port of the SoC chip of the encoding unit 120 is connected to the computing core module as a device. The SoC chip is reported as a USB mouse and keyboard device through the driver software, and the acquired keyboard key or mouse coordinate information is passed to the computing unit 110.

[0044] Further, refer to Figure 2 , the step S200 includes: S210, the audio and video interface conversion module 121 of the encoding unit 120 splits at least one audio and video signal into an audio part and a video part respectively; S220, the audio part is processed by the HDA to linear interface chip and the I2S interface chip in turn, and then sent to the compression module 124 of the encoding unit 120 for encoding and compression processing; S230, the video part is processed by the HDMI to RGB interface chip and the RGB to MIPI interface chip or the RGB to HDMI interface chip in sequence, and then sent to the FPGA module 122 of the encoding unit 120 for video frame signal segmentation, pixel reorganization, video data caching and video synthesis; S240, after the video part is processed by the FPGA module 122, it is sent to the compression module 124 of the encoding unit 120 for encoding and compression processing; S250, the compression module 124 of the encoding unit 120 collects the processed audio part and video part, encodes and compresses them using a high-definition low-latency encoding algorithm, and recombines them into at least one audio and video signal; S260 , the compression module 124 of the encoding unit 120 sends at least one compressed audio and video signal to the interface unit 130 of the encoding unit 120 .

[0045] Further, refer to Figure 1 In step S500, The action information at least includes keyboard key information and mouse coordinate information.

[0046] Further, refer to Figure 2 In the step S600, The USB port of the SoC chip of the encoding unit 120 of the computing blade end 100 is connected to the computing unit 110 of the computing blade end 100 as a device. The SoC chip reports as a USB keyboard device and a USB mouse device through the driver software, and transmits the acquired action information containing keyboard key or mouse coordinate information to the computing unit 110 of the computing blade end 100.

[0047] Further, refer to Figure 3 and Figure 4 The present invention also proposes an onboard KVM hardware codec device for executing the onboard KVM hardware codec method. The onboard KVM hardware codec device comprises a computing blade end 100, a user terminal 200 and an input / output device 300 connected in sequence. The computing blade end 100 and the user terminal 200 are electrically connected via a network. The computing blade end 100 includes: A computing unit 110, wherein the computing unit 110 includes a central processing unit CPU 111, a hard disk 112 and a memory 113, wherein the hard disk 112 and the memory 113 are electrically connected to the central processing unit respectively; The encoding unit 120 includes an audio and video interface conversion module 121 connected to the central processing unit CPU111, an FPGA module 122 for dividing a video frame signal into strip signals, pixel reorganization, video data caching and video synthesis, a video interface conversion module 123 for converting a video format and a compression module 124 for compressing an audio and video signal, wherein the audio and video interface conversion module 121, the FPGA module 122, the video interface conversion module 123 and the compression module 124 are electrically connected in sequence, and the audio and video interface conversion module 121 is electrically connected to the compression module 124; The interface unit 130 at least includes an intelligent platform management interface IPMI 131 , a service data network interface 132 , a terminal access network interface 133 and an external interface 134 . The computing unit 110 and the encoding unit 120 are electrically connected to the interface unit 130 , respectively.

[0048] Further, refer to Figure 3 and Figure 4 The audio and video interface conversion module 121 of the encoding unit 120 includes at least an audio interface chip and a video interface chip. The audio interface chip includes an HDA to linear interface chip connected to the computing unit 110 and an I2S interface chip connected to the compression module 124, wherein the video interface chip includes an HDMI to RGB interface chip connected to the computing unit 110, an RGB to MIPI interface chip and an RGB to HDMI interface chip connected to the FPGA module 122; The compression module 124 of the encoding unit 120 includes at least an RK3588 chip for implementing compression encoding of I2S audio and multiple video interfaces, permission processing and transmission functions of USB signals, and sending audio and video data to the cloud PC user terminal 200 through the network port; The external interface 134 of the interface unit 130 at least includes a power interface, a SERDES interface, an I2C interface and a slot IO interface, wherein: The power interface is used to connect a 12V power supply; The SERDES interface includes a first SERDES interface connected to the service data network interface 132 and a second SERDES interface connected to the terminal access network interface 133; The I2C interface is connected to the intelligent platform management interface IPMI131, and the I2C interface is used to perform intelligent platform management IPMI management; The interface type of the slot IO interface is GPIO, and at least one slot IO interface is provided.

[0049] Further, refer to Figure 3 and Figure 4 The user terminal 200 includes a decoding unit 210 and an interface conversion unit 220 connected to the input and output units in sequence. The decoding unit 210 is used to decode audio and video signals. The decoding unit 210 is connected to the interface unit 130 of the computing blade end 100 through the Internet or a local area network. The input-output unit includes at least one display device 310 connected to the interface conversion unit 220 and at least one USB device 320 connected to the decoding unit 210. The USB device 320 includes at least a keyboard, a mouse, a USB disk and an optical drive.

[0050] In a specific embodiment, the computing blade end 100 includes a computing unit 110, an encoding unit 120 and an interface unit 130, wherein: The computing unit 110 includes: Hard disk 112: supports M.2 SSD hard disk 112 with various specifications such as 512G / 1T / 2T; Memory 113: Supports 8G / 16G / 32G and other specifications of memory 113; CPU: Supports Intel i3 / i5 / i7 and Feiteng D2000 and other CPUs; The encoding unit 120 includes: Interface conversion: including audio and video interface chips. Audio chips include HDA to linear interface chip (such as ALC897) and linear to I2S interface chip (such as ES8388); video chips include HDMI to RGB interface chip (such as IT66021), RGB to MIPI interface chip (such as LT9211) and RGB to HDMI interface chip (such as IT66122); RK3588: realizes the compression encoding of I2S audio and various video interfaces, the permission processing and transmission of USB signals, and sends the above data to the cloud PC user terminal 200 through the network port; FPGA: realizes the functions of strip segmentation, pixel reorganization, video data caching and video synthesis of two video channels. BTII20, or BT2020, is a color space standard established by the International Telecommunication Union (ITU) to define video color and resolution and ensure the quality and compatibility of ultra-high-definition video. BTII20 is mainly used for the production and transmission of ultra-high-definition video content, such as 4K and 8K TV broadcasting, high-end video production, etc. BTII20 is superior to the traditional BT.709 standard in color performance and can provide richer color details; Interface unit 130: The external interface 134 of the interface unit 130 includes four parts: power supply, SERDES, I2C and slot IO. The specific parameters and function descriptions are shown in Table 1.

[0051] Table 1, Interface Type direction Maximum rate Remark 12V power supply I / The maximum power supply capacity that the ADF connector can provide is 140W SERDES IO 1.25Gbps 2 groups, business data network + terminal access network I2C IO 400Kbps 1 group, for IPMI management GPIO I / 9, for slot identification In a specific embodiment, the CPU can select CPU Intel / AMD, etc., CPU Feiteng / Haiguang / Loongson, etc.; the transmitted image signal YUV444 high-fidelity image, and the delay is less than 30ms (LAN, network delay 1ms); support dual-screen display; through IP transmission, it can connect to the Internet; can enter BIOS and remotely install the system; USB has strong versatility and supports a large number of equipment weights; can remotely control the power on and off, and can power off and restart the computer; the management platform can obtain the computer status, read the computer CPU temperature, fan speed and other status; a user terminal 200 can use a set of mouse and keyboard to control two computers at the same time.

[0052] Among them, refer to Figure 4 In the interface unit 130, the PHY in the service data network PHY and the terminal access network PHY both represent physical layer interface devices (Physical Layer Interface Devices) in the corresponding network, which are key components for implementing the physical layer functions of the OSI model. The service data network PHY and the terminal access network PHY are responsible for converting digital signals into analog signals that can be transmitted on physical media (such as optical fiber or copper cable), and performing reverse conversion when receiving.

[0053] Reference Figure 4 In the interface unit 130, the MCU of the intelligent platform management interface IPMI 131 represents a microcontroller unit or a single chip microcomputer.

[0054] Further, refer to Figure 1 The present invention also provides a computer-readable storage medium having program instructions stored thereon, and when the program instructions are executed by a processor, the onboard KVM hardware encoding and decoding method is implemented.

[0055] The above is only a preferred embodiment of the present invention. The present invention is not limited to the above implementation. As long as the technical effect of the present invention is achieved by the same means, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the scope of protection of the present disclosure. All should belong to the protection scope of the present invention. Within the protection scope of the present invention, its technical scheme and / or implementation method can have various modifications and changes.

Claims

1. An onboard KVM hardware encoding and decoding method, the onboard KVM hardware encoding and decoding method is applied to an onboard KVM hardware encoding and decoding device, the onboard KVM hardware encoding and decoding device comprising: A computing blade end (100), a user terminal (200) and an input / output device (300) connected in sequence, wherein the computing blade end (100) and the user terminal (200) are electrically connected via a network, wherein the computing blade end (100) comprises a computing unit (110), an encoding unit (120) and an interface unit (130), and the user terminal (200) comprises a decoding unit (210) and an interface conversion unit (220) connected in sequence to the input / output unit, characterized in that the onboard KVM hardware encoding and decoding method comprises the following steps: S100, the computing unit (110) of the computing blade end (100) outputs at least one audio and video signal to the audio and video interface conversion module (121) of the encoding unit (120); S200, the audio and video interface conversion module (121) of the encoding unit (120) processes the audio and video signals respectively, and then converts them into high-definition low-latency algorithm decoding through the compression module (124); S300, the media stream encoded by the encoding unit (120) is transmitted to the user terminal (200) via Ethernet or a local area network; S400: The decoding unit (210) of the user terminal (200) performs high-definition low-latency algorithm decoding, and the decoded audio and video signals are output to the display device (310) through the interface conversion unit (220).

2. The onboard KVM hardware encoding and decoding method according to claim 1, characterized in that: The onboard KVM hardware encoding and decoding method also The following steps are involved: S500, the decoding unit (210) of the user terminal (200) collects action information of a USB device (320) connected to the USB interface; S600: The decoding unit (210) of the user terminal (200) sends the action information to the encoding unit (120) of the computing blade end (100) through the network; S700: The encoding unit (120) of the computing blade end (100) decodes the action information and sends the decoded action information to the computing unit (110) of the computing blade end (100).

3. The onboard KVM hardware encoding and decoding method according to claim 1, characterized in that: In step S100, the audio and video signals are two channels.

4. The onboard KVM hardware encoding and decoding method according to claim 1, characterized in that: The step S200 includes: S210, the audio and video interface conversion module (121) of the encoding unit (120) splits at least one audio and video signal into an audio part and a video part respectively; S220, the audio part is processed by the HDA to linear interface chip and the I2S interface chip in sequence, and then sent to the compression module (124) of the encoding unit (120) for encoding and compression processing; S230, after the video part is processed in sequence by the HDMI to RGB interface chip and the RGB to MIPI interface chip or the RGB to HDMI interface chip, it is sent to the FPGA module (122) of the encoding unit (120) for video frame signal segmentation, pixel reorganization, video data caching and video synthesis; S240, after the video portion is processed by the FPGA module (122), it is sent to the compression module (124) of the encoding unit (120) for encoding and compression processing; S250, the compression module (124) of the encoding unit (120) collects the processed audio part and video part, encodes and compresses them using a high-definition low-latency encoding algorithm, and recombines them into at least one audio and video signal; S260: The compression module (124) of the encoding unit (120) sends at least one compressed audio and video signal to the interface unit (130) of the encoding unit (120).

5. The onboard KVM hardware encoding and decoding method according to claim 2, characterized in that: In step S500, The action information at least includes keyboard key information and mouse coordinate information.

6. The onboard KVM hardware encoding and decoding method according to claim 2, characterized in that: In step S600, The USB port of the SoC chip of the encoding unit (120) of the computing blade end (100) is connected to the computing unit (110) of the computing blade end (100) as a device, and the SoC chip is reported as a USB keyboard device and a USB mouse device through driver software, and the acquired action information containing keyboard key or mouse coordinate information is transmitted to the computing unit (110) of the computing blade end (100).

7. An onboard KVM hardware encoding and decoding device, used to execute the onboard KVM hardware encoding and decoding method according to any one of claims 1 to 6, characterized in that: The onboard KVM hardware codec device comprises a computing blade end (100), a user terminal (200) and an input / output device (300) which are connected in sequence, wherein the computing blade end (100) and the user terminal (200) are electrically connected via a network. Wherein, the computing blade end (100) comprises: A computing unit (110), the computing unit (110) comprising a central processing unit (CPU) (111), a hard disk (112) and a memory (113), the hard disk (112) and the memory (113) being electrically connected to the central processing unit, respectively; A coding unit (120), the coding unit (120) comprising an audio and video interface conversion module (121) connected to the central processing unit CPU (111), an FPGA module (122) for dividing a video frame signal into strip signals, pixel reorganization, video data caching and video synthesis, a video interface conversion module (123) for converting a video format and a compression module (124) for compressing an audio and video signal, the audio and video interface conversion module (121), the FPGA module (122), the video interface conversion module (123) and the compression module (124) being electrically connected in sequence, and the audio and video interface conversion module (121) being electrically connected to the compression module (124); An interface unit (130), the interface unit (130) comprising at least an intelligent platform management interface IPMI (131), a service data network interface (132), a terminal access network interface (133) and an external interface (134), the computing unit (110) and the encoding unit (120) being electrically connected to the interface unit (130) respectively.

8. The onboard KVM hardware codec device according to claim 7, characterized in that: The audio and video interface conversion module (121) of the encoding unit (120) comprises at least an audio interface chip and a video interface chip; The audio interface chip comprises an HDA-to-linear interface chip connected to the computing unit (110) and an I2S interface chip connected to the compression module (124), wherein the video interface chip comprises an HDMI-to-RGB interface chip connected to the computing unit (110), an RGB-to-MIPI interface chip and an RGB-to-HDMI interface chip connected to the FPGA module (122); The compression module (124) of the encoding unit (120) at least includes an RK3588 chip for realizing compression encoding of I2S audio and multiple video interfaces, permission processing and transmission functions of USB signals, and sending audio and video data to the cloud PC user terminal (200) through a network port; The external interface (134) of the interface unit (130) comprises at least a power interface, a SERDES interface, an I2C interface and a slot IO interface, wherein: The power interface is used to connect a 12V power supply; The SERDES interface comprises a first SERDES interface connected to the service data network interface (132) and a second SERDES interface connected to the terminal access network interface (133); The I2C interface is connected to the intelligent platform management interface IPMI (131), and the I2C interface is used to perform intelligent platform management IPMI management; The interface type of the slot IO interface is GPIO, and at least one slot IO interface is provided.

9. The onboard KVM hardware codec device according to claim 7, characterized in that: The user terminal (200) comprises a decoding unit (210) and an interface conversion unit (220) connected in sequence to the input and output unit; The decoding unit (210) is used to decode audio and video signals, and the decoding unit (210) is connected to the interface unit (130) of the computing blade end (100) via the Internet or a local area network; The input-output unit comprises at least one display device (310) connected to the interface conversion unit (220), and at least one USB device (320) connected to the decoding unit (210), wherein the USB device (320) comprises at least a keyboard, a mouse, a USB disk and an optical drive. 10 . A computer-readable storage medium having program instructions stored thereon, wherein the program instructions are executed by a processor to implement the method according to claim 1 .

Images