Distributed seat control method, device and system, medium and computer equipment

Abstract

The invention discloses a distributed seat control method, device and system, a medium and computer equipment, and relates to the technical field of computer control. The method comprises the steps that action data generated by external equipment is received, the external equipment is connected to a decoding node, and the decoding node comprises a plurality of display interfaces and external equipment interfaces associated with the display interfaces; determining a target display interface in the plurality of display interfaces based on an association relationship between an external device interface connected with the external device and the display interfaces, and determining a target display device connected with the target display interface and a target menu interface control program associated with the target display interface; and sending the action data to the target menu interface control program so as to control the target display device to display an action corresponding to the action data through the target menu interface control program. The method is applied to a distributed multi-seat scene, the wiring complexity, the space occupation and the cost can be reduced, and the equipment stability is improved.

Description

Technical Field

[0001] The present application relates to the field of computer control technology, and in particular to a distributed seat control method, device, storage medium and computer equipment. Background Art

[0002] Distributed products play an important role in modern information systems, especially in the scenario of cross-regional equipment management and control. Among them, the mouse KVM (Keyboard, Video, Mouse) remote control function is one of the key technologies for realizing remote operation and maintenance. This technology allows users to collect mouse and keyboard events through decoding nodes, which are transmitted to encoding nodes through the switch network. The encoding nodes then pass these events to the PC host operating system through the USB interface to realize the control of the remote PC host.

[0003] At present, distributed seat equipment usually adopts a single-device single-seat design, that is, each decoding node only supports one display output and one OSD (On-Screen Display) menu interface, and each encoding node only supports remote mouse and keyboard control of one host device. In order to achieve independent control of multiple seats, the existing technology usually requires the independent deployment of multiple decoding nodes and multiple encoding nodes. However, the independent deployment of multiple decoding nodes and multiple encoding nodes will increase the complexity of wiring and the possibility of errors, and will increase the occupied space and overall cost of the seat equipment. In addition, the joint operation of multiple decoding nodes and multiple encoding nodes may also lead to a decrease in system stability, increasing the difficulty of maintenance and management. Summary of the invention

[0004] In view of this, the embodiments of the present application provide a distributed seat control method, device, system, medium and computer equipment, the main purpose of which is to solve the technical problems of complex deployment connections, high error rate, large space occupancy, high cost and poor equipment stability in distributed multi-seat control scenarios.

[0005] According to one aspect of the present application, a distributed seat control method is provided, the method comprising:

[0006] Receiving action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface;

[0007] Based on the association relationship between the external device interface connected to the external device and the display interface, determining a target display interface among the multiple display interfaces, and determining a target display device connected to the target display interface, and a target menu interface control program associated with the target display interface;

[0008] The action data is sent to the target menu interface control program, so that the target display device is controlled by the target menu interface control program to display the action corresponding to the action data.

[0009] According to another aspect of the present application, a distributed seat control method is provided, the method comprising:

[0010] Receiving the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration;

[0011] Based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, determine a target host interface among the multiple host interfaces, and determine a target host connected to the target host interface and a target serial composite device associated with the target host interface;

[0012] The encoded action data is decoded and sent to the target serial composite device, so as to transmit the decoded action data to the operating system of the target host through the target serial composite device.

[0013] According to another aspect of the present application, a distributed seat control device is provided, the device comprising:

[0014] A first receiving module, configured to receive action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface;

[0015] A first determining module, configured to determine a target display interface among the plurality of display interfaces based on an association relationship between an external device interface connected to the external device and a display interface, and to determine a target display device connected to the target display interface, and a target menu interface control program associated with the target display interface;

[0016] The first control module is used to send the action data to the target menu interface control program, so as to control the target display device to display the action corresponding to the action data through the target menu interface control program.

[0017] According to another aspect of the present application, a distributed seat control device is provided, the device comprising:

[0018] A second receiving module is used to receive the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration;

[0019] A second determination module is used to determine a target host interface among the plurality of host interfaces based on an association relationship between a display interface set on the decoding node and a host interface set on the encoding node, and to determine a target host connected to the target host interface and a target serial composite device associated with the target host interface;

[0020] The second control module is used to decode the encoded action data and send the decoded action data to the target serial compound device, so as to transmit the decoded action data to the operating system of the target host through the target serial compound device.

[0021] According to another aspect of the present application, a distributed seat control system is provided, the system comprising an external device, a decoding node and at least one display device, wherein:

[0022] An external device, connected to the decoding node via an external device interface, for generating action data;

[0023] A decoding node, comprising a plurality of display interfaces and an external device interface associated with each display interface, wherein each of the display interfaces is used to connect to a display device;

[0024] The distributed seat control system is used to execute the above-mentioned distributed seat control method.

[0025] According to another aspect of the present application, a storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned distributed seat control method is implemented.

[0026] According to another aspect of the present application, a computer device is provided, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the above-mentioned distributed agent control method when executing the program.

[0027] By means of the above technical scheme, the embodiment of the present application provides a distributed seat control method, device, system, medium and computer equipment. By setting multiple display interfaces, multiple sets of external device interfaces associated with the multiple display interfaces, and multiple independently running menu interface control programs on the decoding node of the distributed seat, multiple sets of external devices and multiple display devices can be connected through the same decoding node, so as to realize the independent control of multiple display devices through one decoding node. Among them, when performing seat control, the action data generated by external devices such as mouse and keyboard are first received, and then the target menu interface control program is determined based on the mapping relationship between the external device interface and the display interface and the mapping relationship between the display interface and the menu interface control program, and then the target display device is controlled to display the corresponding action through the target menu interface control program. The above method can realize the independent control of multiple sets of external devices and multiple display devices at the same time through one decoding node, effectively reducing the complexity of the distributed seat deployment connection and reducing the possibility of error. At the same time, it also reduces the occupied space and overall cost of the seat equipment. In addition, it also improves the operating stability of the seat equipment, thereby reducing the difficulty of equipment maintenance and management.

[0028] Another distributed seat control method, device, system, medium and computer equipment provided by the embodiment of the present application can connect multiple host devices through the same encoding node by setting multiple host interfaces and multiple serial composite devices associated with the multiple host interfaces on the encoding node of the distributed seat, so as to realize remote KVM control of multiple host devices through one encoding node. Wherein, when performing seat control, first receive the encoded action data sent by the decoding node, and then determine the target host interface and the target serial composite device based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, and then transmit the decoded action data to the operating system of the target host through the target serial composite device, so as to realize remote KVM control of the target host. The above method can realize remote KVM control of multiple host devices at the same time through one encoding node, thereby effectively reducing the complexity of the distributed seat deployment connection and reducing the possibility of errors. At the same time, it also reduces the occupied space and overall cost of the seat equipment. In addition, it also improves the operating stability of the seat equipment, thereby reducing the difficulty of equipment maintenance and management.

[0029] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0031] Figure 1 A schematic diagram of a distributed seat control method provided in an embodiment of the present application is shown;

[0032] Figure 2 A schematic diagram of a flow chart of another distributed seat control method provided in an embodiment of the present application is shown;

[0033] Figure 3 A structural schematic diagram of a distributed seat control system provided by the prior art is shown;

[0034] Figure 4 A structural schematic diagram of a distributed seat control system provided in an embodiment of the present application is shown;

[0035] Figure 5 A schematic diagram of the structure of another distributed seat control system provided in an embodiment of the present application is shown;

[0036] Figure 6 A schematic diagram of the structure of another distributed seat control system provided in an embodiment of the present application is shown;

[0037] Figure 7 A schematic diagram of a flow chart of another distributed seat control method provided in an embodiment of the present application is shown;

[0038] Figure 8 A schematic diagram of the structure of a distributed seat control device provided in an embodiment of the present application is shown;

[0039] Fig. 9 A schematic structural diagram of another distributed seat control device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0040] The present application will be described in detail below with reference to the accompanying drawings and in combination with embodiments. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other without conflict.

[0041] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0042] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0043] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0044] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0045] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0046] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0047] In one embodiment, Figure 1 As shown, a distributed agent control method is provided, which is described by taking the method applied to a listening program in a decoding node as an example, and includes the following steps:

[0048] Step 101 : receiving action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface.

[0049] The external device refers to a device for receiving user input commands, such as a mouse, keyboard, etc. In this embodiment, the external device can be connected to the decoding node through a specific external device interface (such as a USB interface). Further, the decoding node refers to a device in the distributed agent device for receiving data and converting the received data into an appropriate format for display or further processing.

[0050] In a possible implementation, the decoding node can receive and process action data generated from an external device through a listening program set inside it, such as receiving movement data or click data from a mouse, and receiving input data from a keyboard, etc. In this embodiment, the decoding node is provided with a plurality of display interfaces, each of which can be independently connected to a display device, such as a display, and each display interface is associated with a specific set of external device interfaces. Each set of external device interfaces includes a plurality of interfaces, which can be used to be connected to external devices such as a mouse and a keyboard, respectively, to receive action data generated by the external device in real time.

[0051] Step 102, based on the association relationship between the external device interface connected to the external device and the display interface, determine a target display interface among multiple display interfaces, and determine a target display device connected to the target display interface and a target menu interface control program associated with the target display interface.

[0052] Among them, the On-Screen Display (OSD) is a graphical user interface for displaying screen setting options and other information. The menu interface control program, also known as the OSD menu control program, refers to a program for controlling the display content of the display device. It can change the display content on the display device according to the received action data.

[0053] In a possible implementation, after receiving the action data generated by the external device, the listening program inside the decoding node can determine the target display interface among multiple display interfaces based on the association relationship between the external device interface connected to the external device and the display interface, wherein the determined target display interface is unique. In this embodiment, the target display interface can be implemented based on a mapping mechanism set inside the listening program of the decoding node, and the mapping mechanism records the association relationship between each external device interface and the display interface. When the decoding node receives the action data of the external device, it can find the display interface associated with the external device interface of the action data source according to this mapping relationship, and determine it as the target display interface. On this basis, the display device connected to the target display interface can be determined as the target display device, and the menu interface control program associated with the target display interface can be determined as the target menu interface control program.

[0054] Step 103: Send the action data to the target menu interface control program, so that the target menu interface control program controls the target display device to display the action corresponding to the action data.

[0055] In a possible implementation, after determining the target menu interface control program and the target display device, the listening program inside the decoding node can send the received action data to the target menu interface control program. After receiving the action data, the target menu interface control program can make corresponding adjustments to the display content on the target display device according to the content of the action data. For example, if the action data is a click operation performed by the user on the screen with a mouse, the target menu interface control program will update the display content on the target display device according to the position and method of the click to reflect the user's operation intention.

[0056] In this embodiment, with respect to the current distributed seat device single-device single-seat control mode, the method provided in this embodiment can support multiple sets of independent display of monitors and multiple sets of independent KVM control of mouse and keyboard through one device, which is equivalent to virtualizing multiple seat devices from one seat device. The multiple virtualized seat devices share a CPU, memory, and Flash hardware resources, and can be used as multiple independent seats or organized into a seat matrix, which greatly saves hardware costs and deployment space.

[0057] This embodiment, by setting multiple display interfaces, multiple sets of external device interfaces associated with the multiple display interfaces, and multiple independently running menu interface control programs on the decoding node of the distributed seat, can connect multiple sets of external devices and multiple display devices through the same decoding node, thereby realizing independent control of multiple display devices through one decoding node. Among them, when performing seat control, the action data generated by external devices such as the mouse and keyboard is first received, and then the target menu interface control program is determined based on the mapping relationship between the external device interface and the display interface and the mapping relationship between the display interface and the menu interface control program, and then the target display device is controlled by the target menu interface control program to display the corresponding action. The above method can realize the independent control of multiple sets of external devices and multiple display devices at the same time through one decoding node, effectively reducing the complexity of the distributed seat deployment connection and reducing the possibility of errors. At the same time, it also reduces the occupied space and overall cost of the seat equipment. In addition, it also improves the operating stability of the seat equipment, thereby reducing the difficulty of equipment maintenance and management.

[0058] Further, as a refinement and extension of the specific implementation of the above embodiment, in order to fully illustrate the specific implementation process of this embodiment, another distributed seat control method is provided, such as Figure 2 As shown, the method includes:

[0059] Step 201 : receiving action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface.

[0060] In this embodiment, the external device refers to a keyboard and / or a mouse connected to the decoding node. Among them, the keyboard can be used to input character data, such as letters, numbers, symbols, etc.; the mouse can be used to move and trigger operations on the screen, such as moving the cursor, clicking buttons, etc. The decoding node is provided with multiple display interfaces, such as multiple HDMI interfaces, and the decoding node is also provided with multiple external device interfaces associated with each display interface, such as multiple USB interfaces. When the external device (keyboard or mouse) is operated by the user, corresponding action data can be generated, and these action data can be sent to the decoding node through the external device interface.

[0061] Step 202, based on the association relationship between the external device interface connected to the external device and the display interface, determine a target display interface from multiple display interfaces, and determine a target display device connected to the target display interface and a target menu interface control program associated with the target display interface.

[0062] In a possible implementation, the listening program set in the decoding node can determine the target display interface from multiple display interfaces based on the association relationship between the external device interface connected to the external device and the display interface. Figure 4 , assuming that keyboard 1 and mouse 1 are connected to USB group 1, and USB group 1 is associated with HDMI1 display interface, then when keyboard 1 and mouse 1 generate action data, the decoding node will determine HDMI1 display interface as the target display interface. Furthermore, the monitoring program can also determine the target display device connected to the target display interface, and the target menu interface control program associated with the target display interface. For example, refer to Figure 4 and Figure 5 Assuming that the display connected to the HDMI1 display interface is display 1, and the menu interface control program associated with the HDMI1 display interface is the OSD1 program, then display 1 can be determined as the target display device, and the OSD1 program can be determined as the target menu interface control program.

[0063] Step 203: Send the action data to the target menu interface control program, so that the target menu interface control program controls the target display device to display the action corresponding to the action data.

[0064] In a possible implementation, after determining the target display interface, the target display device, and the target menu interface control program, the listening program set inside the decoding node can send the received action data to the target menu interface control program to control the target display device to display the corresponding action. In this embodiment, if the action data comes from the keyboard, the target menu interface control program can display the corresponding characters in the OSD menu interface of the target display device according to the input data. If the action data comes from the mouse, the target menu interface control program can move the cursor and / or trigger the corresponding event in the OSD menu interface according to the mouse movement data and / or trigger data. For example, referring to Figure 4 and Figure 5 When the user moves the cursor on the OSD menu interface of display 1 through mouse 1 connected to USB group 1, the monitoring program kmd1 inside the decoding node will monitor this action and send the movement data of mouse 1 to the OSD1 program. The OSD1 program then controls the cursor on display 1 to move accordingly based on the action data.

[0065] For example, in the prior art, Figure 3 As shown, the traditional distributed seat equipment mainly adopts a single-device single-seat mode, that is, each decoding node corresponds to only one display output and one OSD interface. However, this deployment method is complex in wiring, occupies a large space, and has poor stability. In view of the above problems, this embodiment proposes a single-device multi-seat mode, such as Figure 4 and Figure 5 As shown, taking the example of a decoding node connecting two sets of external devices and two sets of display devices, first, a hardware device that supports dual HDMI display interfaces can be selected as a decoding node, and two OSD programs can be run on the decoding node end, respectively associated with two HDMI display interfaces, and the two HDMI display interfaces are respectively connected to display 1 and display 2, and the two displays can independently display the OSD menu interface. Furthermore, the decoding node is also provided with multiple USB interfaces, and the USB interfaces are divided into two groups, namely USB group 1 and USB group 2, and USB group 1 is associated with HDMI1 display interface, and USB group 2 is associated with HDMI2 display interface, that is, external devices such as mouse 1 and keyboard 1 connected to USB group 1 are used to control the OSD menu interface of display 1, and external devices such as mouse 2 and keyboard 2 connected to USB group 2 are used to control the OSD menu interface of display 2.

[0066] In this scenario, the OSD seat menu interface control process is as follows: when the user moves mouse 1 or keyboard 1 connected to USB group 1 to input characters, mouse 1 or keyboard 1 connected to USB group 1 generates a message, and the listening program kmd1 set inside the decoding node can send the monitored mouse and keyboard messages to the OSD1 program, and control the mouse movement and keyboard input of the OSD interface of display 1; when mouse 2 or keyboard 2 connected to USB group 2 generates a message, the listening program kmd2 set inside the decoding node sends the monitored mouse or keyboard messages to the OSD2 program, and controls the mouse movement and keyboard input of the OSD interface of display 2. This embodiment can send the action data generated by the external device (keyboard and / or mouse) to the target menu interface control program associated with the target display interface by setting a mapping mechanism and a listening program inside the decoding node, thereby realizing independent control of multiple display devices. The above method not only improves the flexibility and scalability of distributed seat equipment, but also reduces the complexity of equipment deployment and maintenance.

[0067] Step 204, in response to the action data generated by the external device, the target host is mounted on the target display, and a mapping relationship between the target display device and the target host is established to display the video data sent by the target host through the target display device.

[0068] In a possible implementation, when the action data generated by the external device indicates that the target host is mounted on the target display, for example, when the user drags the logo of the target host to a display frame of the target display, or sets the mounted host as the target host through the display frame of the target display, the target display device can respond to this action data and mount the target host on the target display. Wherein, "mounting" refers to establishing a logical connection between the target display device and the target host, for example, associating the target display device with the identifier (such as IP address, host name, etc.) of the target host so that the target display device can receive and display video data from the target host. In this embodiment, the target host can be connected to the decoding node through the encoding node and the network connection device. Based on this, after the mapping relationship is established between the target display device and the target host, the decoding node can receive the video data sent by the target host through the network connection device and the encoding node, and display the video data sent by the target host through the target display device. In this embodiment, the encoding node can be connected to one host or multiple hosts, and the network connection device can include devices such as network switches and routers.

[0069] In an optional embodiment, the encoding node is connected to at least one host. Then step 204 can display the video data sent by the target host in the following manner: mount the target host on the target display in response to the action data generated by the external device, establish a mapping relationship between the target display device and the target host, and then associate the target display interface connected to the target display device with the target host interface connected to the target host. Subsequently, the encoding node collects the video data of the target host through the target host interface, and after encoding the video data, transmits it to the decoding node through the network connection device. After decoding, the decoding node can transmit the video data to the target display device through the target display interface, so as to display the video data sent by the target host through the target display device.

[0070] In one possible implementation, refer to Figure 4 and Figure 5 , when the encoding node is connected to multiple hosts (such as PC1, PC2, etc.), the target display can mount the target host (such as PC1) to the target display (such as display 1) when the user performs the action of mounting the target host to the target display, and establish a mapping relationship between the two. Then, the target display interface (such as HDMI1) connected to the target display device is associated with the target host interface (such as HDMI3) connected to the target host. Next, the encoding node can collect the video data of the target host through the target host interface, that is, capture the video signal through the graphics card output end of the host, and then encode the collected video data into a format suitable for network transmission, such as H.264, H.265 and other video stream data packets, and transmit it to the decoding node through network connection devices such as switches. After receiving these video stream data packets, the decoding node will perform decoding operations and restore them to the original video signal, and then transmit it to the target display device through the target display interface. Finally, the target display device (such as display 1) can display the real-time video data sent by the target host (such as PC1).

[0071] For example, refer to Figure 4 and Figure 5, take the decoding node connected to two sets of external devices and two sets of display devices, and the encoding node connected to two hosts as an example. When the user operates the OSD menu of display 1 through the external device connected to the decoding node (such as mouse 1), he can choose to take over any video source on the encoding node, that is, choose to mount any host connected to the encoding node, such as taking over the video source of PC1 or PC2 host. Similarly, display 2 can also take over any video source on the encoding node, such as the video source of PC1 or PC2 host. Assuming that the user chooses display 1 to take over the video source of PC1 host, then the encoding node can capture the video screen of PC1 host through its host interface (such as HDMI3), encode the video screen into video stream data packets, and then transmit it to the decoding node through the network connection device. After receiving these data packets, the decoding node will perform decoding operations and transmit the decoded video data to display 1 through its display interface (such as HDMI1). At this time, display 1 can display the real-time screen of PC1 host.

[0072] Step 205 , in response to the action data generated by the external device being displayed in the video display area of ​​the target host, the action data is transmitted to the operating system of the target host through the network connection device and the encoding node.

[0073] In a possible implementation, when a user operates an external device to generate action data in the video display area of ​​the target host, such as when the user zooms in or out on the video screen of the target host, the listening program set inside the decoding node can capture and encode these action data, and then convert the action data into a format suitable for network transmission, such as a data packet. Subsequently, the encoded data packet can be transmitted to the encoding node through a network connection device (such as a switch, a router). After receiving the data packet, the encoding node will perform a decoding operation and restore the data packet to the original action data format. The decoded action data is then transmitted to the operating system of the target host so that corresponding operations can be performed on the target host. In this way, KVM control can be performed on a remote PC host through an external device.

[0074] In an optional embodiment, the coding node is connected with at least one host. Then step 204 can transmit the action data to the operating system of the target host in the following manner: first, the decoding node encodes the action data and transmits it to the coding node through the network connection device. After receiving the encoded action data, the listening program set in the coding node determines the target host interface among multiple host interfaces based on the association relationship between the display interface set on the decoding node and the host interface set on the coding node, and determines the target host connected to the target host interface, and the target serial composite device associated with the target host interface. Finally, the encoded action data is decoded, and the decoded action data is sent to the target serial composite device, so that the decoded action data is transmitted to the operating system of the target host through the target serial composite device. In the present embodiment, the coding node is provided with multiple host interfaces and serial composite devices associated with each host interface, and the serial composite device is obtained by enumerating the serial peripherals.

[0075] In one possible implementation, refer to Figure 4 and Figure 5 , when the encoding node is connected to multiple hosts (such as PC1, PC2, etc.), the remote host can still be KVM controlled by the method proposed in this embodiment. In this scenario, the encoding node can send the decoded action data to the target serial composite device. Among them, the target serial composite device is obtained by the encoding node through serial peripheral enumeration (Serial Peripheral Enumeration), and it is actually a USB device simulated by software. This serial composite device is associated with the target host interface (such as OTG1 interface) of the encoding node and is used for data transmission with the target host (such as PC1). After the action data is sent to the target serial composite device, the device will then transmit the action data to the operating system of the target host (such as PC1) through the target host interface (such as OTG1 interface). In this way, the user can remotely control any host connected to the encoding node through an external device.

[0076] For example, refer to Figure 4 and Figure 5, take the decoding node connected to two sets of external devices and two sets of display devices, and the encoding node connected to two hosts as an example. Among them, the listening programs kmsd1 and kmsd2 of the encoding node enumerate a USB composite device through USB Gadget respectively, and associate them with the OTG1 host interface and the OTG2 host interface respectively. The two USB composite devices can interact and communicate with the operating systems of the PC1 host and the PC2 host respectively, and are recognized as physical mouse and keyboard devices by the operating systems of the PC1 host and the PC2 host. In this scenario, when the user operates through the external devices on the decoding node (such as keyboard 1 and mouse 1 of the USB1 group), the listening program of the decoding node (such as kmd1) can receive the action data generated by these operations in real time and encode them into data packets suitable for network transmission. Then, these data packets can be transmitted to the encoding node through the network. The listening program of the encoding node (such as kmsd1) can decode these data packets into data in the HID (Human Interface Device) protocol format, and send these data to the USB composite device enumerated by kmsd1 through Linux USB virtualization technology. The USB composite device transmits the HID data to the operating system of the PC1 host through the host interface (such as OTG1). In this way, the user can remotely control the PC1 host through the keyboard 1 and the mouse 1. It should be noted that the encoding and decoding referred to in this embodiment refers to encoding and decoding for the mouse and keyboard data, and the encoding and decoding process is opposite to the encoding and decoding process of the video stream.

[0077] Step 206 , in response to the action data generated by the external device, the external execution device is mounted on the target host, and a mapping relationship between the external execution device and the target host is established to display device information of the external execution device through the target display device.

[0078] In a possible implementation, when the action data generated by the external device indicates that an external execution device, such as a USB flash drive, USB printer, UKey, USB camera, etc., is mounted on a target host (such as PC1 or PC2), the system can respond to this instruction and establish a mapping relationship between the external execution device and the target host. Among them, "mounting" refers to establishing a logical connection between the external execution device and the target host, so that the target host can identify and access the external execution device. For storage devices such as USB flash drives, "mounting" refers to remotely mapping the USB storage device connected to the decoding node to the target host and presenting it as a block device, i.e., a disk. This storage device remote mapping technology allows users to read and write the mapped disk on the remote host just like operating a local disk.

[0079] In this embodiment, the type of the external execution device can be identified first, and a mapping relationship between the external execution device and the target host can be established according to its type. For example, when the external execution device is a USB flash drive, it can be mapped to a disk number of the target host. After the mapping relationship is established, the new block device can be registered in the operating system of the target host so that it can be identified and accessed. At the same time, the device information of the external execution device, such as the device name, capacity, used space, etc., can also be displayed by the target display device (such as display 1) so that the user can understand the status of the device. Among them, the device information of the external execution device can be sent to the encoding node through the network connection device after being encoded by the decoding node, and the encoding node sends the device information of the external execution device to the operating system of the target host after decoding, so that the operating system sets the device information of the external execution device in the video data of the target host, and then the video data of the target host is sent to the target display device through the encoding node, the network connection device and the decoding node, so that the user can view the device information on the target display device. The above process is also applicable to other types of USB devices, such as USB printers, UKey, USB cameras, etc., but the mapping method and displayed information will be different. For example, for a USB printer, the printer model, status, print queue, etc. may be displayed. By establishing a mapping relationship between the external execution device and the target host, the present embodiment can provide device information through the target display device, thereby facilitating remote management and operation by users.

[0080] For example, refer to Figure 4 and Figure 5 , the user can map the USB disk 1 connected to the decoding node USB group 1 to the encoding node PC1 host or PC2 host, and establish a mapping relationship between the USB disk 1 and the PC1 host or between the USB disk 1 and the PC2 host, and then display the device information of the USB disk on the display 1. Similarly, the USB disk 2 connected to the decoding node USB group 2 can also be mapped to the encoder node PC1 host or PC2 host, and establish a mapping relationship between the USB disk 2 and the PC1 host or between the USB disk 2 and the PC2 host, and then display the device information of the USB disk 2 on the display 2. The transparent transmission principle of other types of USB devices is the same, such as USB printers, UKey, USB cameras, etc., which will not be repeated here.

[0081] Step 207, in response to the action data generated by the external device, an operation is performed on the external execution device, an operation instruction sent by the operating system of the target host is received through the encoding node and the network connection device, and based on the operation instruction, an operation is performed on the external execution device.

[0082] In a possible implementation, when the action data generated by the external device indicates to perform an operation on an external execution device (such as a USB flash drive) that has been mapped to a target host (such as a PC1 host connected to the encoding node), the system can respond to this instruction and perform the operation on the external execution device. In this process, the decoding node first encodes the action data of the external execution device and transmits it to the operating system of the target host through the network connection device and the encoding node. After receiving these action data, the operating system of the target host will convert them into corresponding operation instructions, for example, into read, write or query commands for the USB flash drive. Subsequently, the encoding node can encode these operation instructions into a format suitable for network transmission and transmit them back to the decoding node through the network connection device. After receiving the encoded operation instruction, the decoding node will perform a decoding operation and restore it to the original operation instruction format, and then perform the corresponding operation on the external execution device accordingly.

[0083] For example, refer to Figure 4 , Figure 5 and Figure 6 , take the mapping of the U disk 1 connected to the USB group 1 of the decoding node to the PC1 host of the encoding node as an example. When the user operates on the OSD menu of the display 1 and chooses to mount the U disk 1 connected to the USB group 1 to the PC1 host of the encoding node, the operating system of the PC1 host will convert the action data input by the user into a read, write or query command for the U disk after receiving it, and send it to the listener kmsd1 of the encoding node through the host interface (such as OTG1). The listener kmsd1 forwards these commands to the listener kmd1 of the decoding node through the network connection device. The listener kmsd1 of the decoding node then converts the command into a read and write operation on the physical U disk. After completing the operation, the listener kmsd1 of the decoding node will generate an operation response packet and pass it to the listener kmsd1 of the encoding node through the network connection device. After receiving the response packet, the listener kmsd1 will pass it to the operating system of the PC1 host through the host interface (such as OTG1), thereby realizing data transparent transmission and remote operation of external execution devices such as U disks. This process ensures that users can flexibly operate and manage remote external execution devices through external devices.

[0084] Step 208, in response to the action data generated by the external device, the target display device and other display devices in the same network are combined into a seat matrix, the display device to be controlled is determined in the seat matrix, and the display device to be controlled is controlled through the menu interface control program to display the action corresponding to the action data.

[0085] In a possible implementation, when the external device generates action data indicating that the target display device and other display devices in the same network form a seat matrix, the system will respond to this instruction and form a seat matrix with the target display device (such as display 1) and other display devices in the same network (such as display 2). The "seat matrix" refers to a logical set composed of multiple display devices, in which a user is allowed to control multiple display devices simultaneously through a set of external devices, such as a set of mouse and keyboard.

[0086] In the seat matrix, the display device to be controlled can be determined based on the action data generated by the external device and the position of the cursor. Specifically, when the user moves the cursor or clicks on the menu interface through an external device, the listening program in the decoding node can receive these action data and determine the display device that the user intends to control based on the current position of the cursor, such as the screen area of ​​the display device where the cursor is displayed. After determining the display device to be controlled, the listening program can send the action data to the menu interface control program associated with the display device, so that the menu interface control program can control the display device to display the corresponding action or content according to these data.

[0087] In this embodiment, the decoding node device can virtualize multiple virtual decoding nodes, which can be used as independent seat nodes or formed into a seat matrix. After forming the seat matrix, the user can use a set of mouse and keys to control multiple screen nodes, thereby realizing multi-screen collaborative operation. In addition, the encoding node device can also virtualize multiple virtual encoder nodes, which can be used independently and used to process different video streams or data signals.

[0088] In an optional embodiment, other display devices in the same network as the target display device include display devices connected to the same decoding node as the target display device, and / or display devices connected to other decoding nodes via a network connection device.

[0089] In a possible implementation, other display devices in the same network as the target display device may include display devices connected to the same decoding node as the target display device, and may also include display devices connected to other decoding nodes through network connection devices. When the display devices in the seat matrix are connected to the same decoding node, the action data can be forwarded through multiple listening programs set in the decoding node; when the display devices in the seat matrix are connected to different decoding nodes, the action data can be forwarded through the network connection device connecting the two decoding nodes to achieve control of any display device in the seat device. This flexible networking method can make the seat matrix applicable to a variety of complex application scenarios.

[0090] The technical solution of this embodiment can effectively reduce the complexity of distributed agent deployment connections and the possibility of errors by applying a decoding node to simultaneously realize independent control of multiple sets of external devices and multiple display devices, and applying an encoding node to simultaneously realize remote control of multiple hosts and data transparent transmission of external devices. At the same time, it can reduce the space occupied and the overall cost of agent equipment. In addition, it can also improve the operating stability of agent equipment and reduce the difficulty of equipment maintenance and management.

[0091] In one embodiment, Figure 7 As shown, a distributed agent control method is provided, which is described by taking the method applied to a listening program in an encoding node as an example, and includes the following steps:

[0092] Step 301, receiving the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, the encoding node includes multiple host interfaces and a serial composite device associated with each host interface, and the serial composite device is obtained by serial peripheral enumeration.

[0093] Step 302, based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, determine a target host interface from multiple host interfaces, and determine a target host connected to the target host interface and a target serial composite device associated with the target host interface.

[0094] Step 303 , decoding the encoded action data, and sending the decoded action data to the target serial multifunction device, so as to transmit the decoded action data to the operating system of the target host through the target serial multifunction device.

[0095] The above steps 301 to 303 can be executed with reference to the content of step 205, which will not be repeated here.

[0096] This embodiment can connect multiple host devices through the same encoding node by setting multiple host interfaces and multiple serial composite devices associated with the multiple host interfaces on the encoding node of the distributed seat, thereby realizing remote KVM control of multiple host devices through one encoding node. Among them, when performing seat control, the encoded action data sent by the decoding node is first received, and then the target host interface and the target serial composite device are determined based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, and then the decoded action data is transmitted to the operating system of the target host through the target serial composite device, so as to realize remote KVM control of the target host. The above method can realize remote KVM control of multiple host devices at the same time through one encoding node, thereby effectively reducing the complexity of the distributed seat deployment connection and reducing the possibility of errors. At the same time, it also reduces the occupied space and overall cost of the seat equipment. In addition, it also improves the operating stability of the seat equipment, thereby reducing the difficulty of equipment maintenance and management.

[0097] In a possible implementation, before receiving the encoded action data, the method may further include the following steps: when the action data generated by the external device mounts the target host on the target display, a mapping relationship between the target host and the target display device is established, wherein the external device and the target display are connected to a decoding node. Then, the video data of the target host is collected through the target host interface, the video data is encoded and transmitted to the decoding node through the network connection device, and the decoding node transmits the video data to the target display device after decoding, so that the video data sent by the target host is displayed through the target display device.

[0098] In a possible implementation, the method for receiving encoded action data sent by a decoding node may be implemented in the following manner: when the action data generated by an external device is displayed in a video display area of ​​a target host, the encoded action data sent by the decoding node is received through a network connection device.

[0099] In a possible implementation, the method further includes the following steps: when the action data generated by the external device mounts the external execution device on the target host, a mapping relationship between the external execution device and the target host is established, wherein the external execution device is connected to the decoding node. The device information of the external execution device is received through the network connection device and the decoding node, and the device information is sent to the operating system of the target host, so that the target host sets the device information of the external execution device in the video data of the target host.

[0100] In a possible implementation, the method further includes the following steps: when the action data generated by the external device performs an operation on the external execution device, the action data is received through the network connection device, and the decoded action data is sent to the operating system of the target host, and the operating system of the target host converts the action data into an operation instruction. Then, the operation instruction is encoded and transmitted to the decoding node through the network connection device, and the decoding node performs the operation on the external execution device based on the operation instruction. The operation response packet sent by the decoding node is received through the network connection device, and the operation response packet is transmitted to the operating system of the target host.

[0101] The above-mentioned multiple implementations and corresponding technical effects can be implemented by referring to any possible implementation described in step 201 to step 208, and will not be described in detail here.

[0102] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. In addition, the numbers corresponding to the various steps in the above embodiments only serve as identification and are not used as a limitation on the order in which the steps are executed. The order in which the steps are executed in each embodiment can be set according to actual conditions.

[0103] Further, as Figure 1 and Figure 6 The specific implementation of the method, the embodiment of the present application provides a distributed seat control device, the device is arranged in a decoding node, such as Figure 8 As shown, the device comprises:

[0104] A first receiving module 41, which can be used to receive action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface;

[0105] A first determining module 42, which can be used to determine a target display interface among the multiple display interfaces based on the association relationship between the external device interface connected to the external device and the display interface, and determine a target display device connected to the target display interface, and a target menu interface control program associated with the target display interface;

[0106] The first control module 43 may be used to send the action data to the target menu interface control program, so as to control the target display device to display the action corresponding to the action data through the target menu interface control program.

[0107] In one possible implementation, the external device includes a keyboard and / or a mouse; the first control module 43 can be specifically used to send the input data of the keyboard to the target menu interface control program when the external device is a keyboard, so as to control the target display device to display the input data in the menu interface through the target menu interface control program; and / or, when the external device is a mouse, send the movement data and / or trigger data of the mouse to the target menu interface control program, so as to control the target display device to display the moved cursor and / or triggered event in the menu interface through the target menu interface control program.

[0108] In a possible implementation, the first control module 43 may also be used to mount the target host onto the target display in response to the action data generated by the external device, and to establish a mapping relationship between the target display device and the target host, wherein the target host is connected to the decoding node via an encoding node and a network connection device; the video data sent by the target host is received via the network connection device and the encoding node, and the video data sent by the target host is displayed via the target display device.

[0109] In a possible implementation, the first control module 43 may also be used to display the action data generated by the external device in the video display area of ​​the target host, encode the action data and transmit it to the encoding node through the network connection device, and the encoding node decodes and transmits the action data to the operating system of the target host.

[0110] In a possible implementation, the first control module 43 may also be used to mount the external execution device on the target host in response to the action data generated by the external device, and establish a mapping relationship between the external execution device and the target host, wherein the external execution device is connected to the decoding node; the device information of the external execution device is sent to the operating system of the target host through the network connection device and the encoding node, so that the target host sets the device information of the external execution device in the video data of the target host; and the device information of the external execution device is displayed through the target display device.

[0111] In a possible implementation, the first control module 43 may also be used to perform operations on the external execution device in response to action data generated by the external device, and transmit the action data for operating the external execution device to the operating system of the target host through the network connection device and the encoding node, the operating system of the target host converts the action data into operation instructions, the encoding node encodes the operation instructions and transmits them to the decoding node for decoding through the network connection device; based on the decoded operation instructions, the operation is performed on the external execution device; an operation response packet is generated, and the operation response packet is transmitted to the encoding node through the network connection device, and the encoding node transmits the operation response packet to the operating system of the target host.

[0112] In a possible implementation, the first control module 43 may also be used to respond to the action data generated by the external device, form a seat matrix between the target display device and other display devices in the same network, and determine the display device to be controlled in the seat matrix based on the action data generated by the external device and the position of the cursor, and send the action data to a menu interface control program associated with the display device to be controlled, so as to control the display device to be controlled to display an action corresponding to the action data through the menu interface control program.

[0113] In a possible implementation, other display devices in the same network as the target display device include display devices connected to the same decoding node as the target display device, and / or display devices connected to other decoding nodes via the network connection device.

[0114] It should be noted that for other corresponding descriptions of the functional units involved in the distributed seat control device provided in the embodiment of the present application, reference can be made to Figures 1 to 6 The corresponding description in the method will not be repeated here.

[0115] Further, as Figure 7 The specific implementation of the method, the embodiment of the present application provides a distributed seat control device, the device is arranged in the encoding node, such as Fig. 9 As shown, the device comprises:

[0116] A second receiving module 51, which can be used to receive the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, and the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration;

[0117] A second determining module 52, which can be used to determine a target host interface among the multiple host interfaces based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, and determine a target host connected to the target host interface and a target serial composite device associated with the target host interface;

[0118] The second control module 53 can be used to decode the encoded action data and send the decoded action data to the target serial compound device, so as to transmit the decoded action data to the operating system of the target host through the target serial compound device.

[0119] In a possible implementation, the device also includes a data sending module, which can be used to establish a mapping relationship between the target host and the target display device when the action data generated by the external device mounts the target host to the target display, wherein the external device and the target display are connected to a decoding node; the video data of the target host is collected through the target host interface, the video data is encoded and transmitted to the decoding node through a network connection device, and the decoding node transmits the video data to the target display device after decoding, so that the video data sent by the target host is displayed through the target display device.

[0120] In a possible implementation, the second receiving module 51 may be specifically configured to receive the encoded action data sent by the decoding node through the network connection device when the action data generated by the external device is displayed in the video display area of ​​the target host.

[0121] In a possible implementation, the second control module 53 is also used to establish a mapping relationship between the external execution device and the target host when the action data generated by the external device mounts the external execution device on the target host, wherein the external execution device is connected to the decoding node; the device information of the external execution device is received through the network connection device and the decoding node, and the device information is sent to the operating system of the target host, so that the target host sets the device information of the external execution device in the video data of the target host.

[0122] In a possible implementation, the second control module 53 is also used to receive the action data through a network connection device when the action data generated by the external device performs an operation on the external execution device, and send the decoded action data to the operating system of the target host, and the operating system of the target host converts the action data into operation instructions; encodes the operation instructions and transmits them to the decoding node through the network connection device, and the decoding node performs the operation on the external execution device based on the operation instructions; receives the operation response packet sent by the decoding node through the network connection device, and transmits the operation response packet to the operating system of the target host.

[0123] It should be noted that for other corresponding descriptions of the functional units involved in the distributed seat control device provided in the embodiment of the present application, reference can be made to Figure 7 The corresponding description in the method will not be repeated here.

[0124] Further, as Figures 1 to 7 The specific implementation of the method, the embodiment of the present application provides a distributed seat control system, the system includes an external device, a decoding node and at least one display device, wherein:

[0125] An external device, connected to the decoding node via an external device interface, for generating action data;

[0126] A decoding node, comprising a plurality of display interfaces and an external device interface associated with each display interface, wherein each of the display interfaces is used to connect to a display device;

[0127] The distributed seat control system can be used to receive action data generated by an external device; based on the association relationship between the external device interface connected to the external device and the display interface, determine the target display interface among the multiple display interfaces, and determine the target display device connected to the target display interface, and the target menu interface control program associated with the target display interface; send the action data to the target menu interface control program to control the target display device to display the action corresponding to the action data through the target menu interface control program.

[0128] In one possible implementation, the external device includes a keyboard and / or a mouse; the distributed seat control system is also used to, when the external device is a keyboard, send the input data of the keyboard to the target menu interface control program, so as to control the target display device to display the input data in the menu interface through the target menu interface control program; and / or, when the external device is a mouse, send the movement data and / or trigger data of the mouse to the target menu interface control program, so as to control the target display device to display the moved cursor and / or triggered event in the menu interface through the target menu interface control program.

[0129] In a possible implementation, the distributed seat control system is also used to mount the target host to the target display in response to the action data generated by the external device, and establish a mapping relationship between the target display device and the target host, wherein the target host is connected to the decoding node through an encoding node and a network connection device; receives video data sent by the target host through the network connection device and the encoding node, and displays the video data sent by the target host through the target display device.

[0130] In a possible implementation, the distributed seat control system is also used to respond to the action data generated by the external device and display it in the video display area of ​​the target host, encode the action data and transmit it to the encoding node through the network connection device, and the encoding node decodes and transmits the action data to the operating system of the target host.

[0131] In a possible implementation, the distributed seat control system is also used to mount the external execution device on the target host in response to the action data generated by the external device, and establish a mapping relationship between the external execution device and the target host, wherein the external execution device is connected to the decoding node; the device information of the external execution device is sent to the operating system of the target host through the network connection device and the encoding node, so that the target host sets the device information of the external execution device in the video data of the target host; and the device information of the external execution device is displayed through the target display device.

[0132] In a possible implementation, the distributed seat control system is also used to perform operations on the external execution device in response to action data generated by the external device, and transmit the action data for operating the external execution device to the operating system of the target host through the network connection device and the encoding node, the operating system of the target host converts the action data into operation instructions, the encoding node encodes the operation instructions and transmits them to the decoding node for decoding through the network connection device; based on the decoded operation instructions, the operation is performed on the external execution device; an operation response packet is generated, and the operation response packet is transmitted to the encoding node through the network connection device, and the encoding node transmits the operation response packet to the operating system of the target host.

[0133] In one possible implementation, the distributed seat control system is also used to respond to the action data generated by the external device, form a seat matrix between the target display device and other display devices in the same network, and determine the display device to be controlled in the seat matrix based on the action data generated by the external device and the position of the cursor, and send the action data to a menu interface control program associated with the display device to be controlled, so as to control the display device to be controlled to display an action corresponding to the action data through the menu interface control program.

[0134] In a possible implementation, other display devices in the same network as the target display device include display devices connected to the same decoding node as the target display device, and / or display devices connected to other decoding nodes via the network connection device.

[0135] In a possible implementation, the system further includes a network connection device, an encoding node and at least one host, wherein the encoding node is connected to the decoding node via the network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration; the distributed seat control system is also used to receive encoded action data sent by the decoding node; based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, determine a target host interface from the plurality of host interfaces, and determine a target host connected to the target host interface, and a target serial composite device associated with the target host interface; decode the encoded action data, and send the decoded action data to the target serial composite device, so as to transmit the decoded action data to the operating system of the target host through the target serial composite device.

[0136] In a possible implementation, the distributed seat control system is also used to establish a mapping relationship between the target host and the target display device when the action data generated by the external device mounts the target host to the target display, wherein the external device and the target display are connected to a decoding node; the video data of the target host is collected through the target host interface, the video data is encoded and transmitted to the decoding node through a network connection device, and the decoding node transmits the video data to the target display device after decoding, so that the video data sent by the target host is displayed through the target display device.

[0137] In a possible implementation, the distributed seat control system is further configured to receive the encoded action data sent by the decoding node through the network connection device when the action data generated by the external device is displayed in the video display area of ​​the target host.

[0138] In a possible implementation, the distributed seat control system is also used to establish a mapping relationship between the external execution device and the target host when the action data generated by the external device mounts the external execution device on the target host, wherein the external execution device is connected to the decoding node; the device information of the external execution device is received through the network connection device and the decoding node, and the device information is sent to the operating system of the target host, so that the target host sets the device information of the external execution device in the video data of the target host.

[0139] In a possible implementation, the distributed seat control system is also used to receive the action data through a network connection device when the action data generated by an external device performs an operation on an external execution device, and send the decoded action data to the operating system of the target host, and the operating system of the target host converts the action data into operation instructions; encodes the operation instructions and transmits them to a decoding node through a network connection device, and the decoding node performs the operation on the external execution device based on the operation instructions; receives the operation response packet sent by the decoding node through the network connection device, and transmits the operation response packet to the operating system of the target host.

[0140] The embodiment of the present application also provides a computer device, which can be a personal computer, a server, a network device, etc. The computer device includes a bus, a processor, a memory and a communication interface, and can also include an input and output interface and a display device. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store location information. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the steps in each method embodiment are implemented.

[0141] Those skilled in the art will appreciate that the structure of the above-mentioned computer device is only a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. In a possible implementation, the computer device may include more or fewer components, or combine certain components, or have a different arrangement of components.

[0142] In one embodiment, a computer-readable storage medium is provided. The computer-readable storage medium may be non-volatile or volatile, and stores a computer program thereon. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0143] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0144] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0145] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A distributed seat control method, characterized in that: The method comprises: Receiving action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface; Based on the association relationship between the external device interface connected to the external device and the display interface, determining a target display interface among the multiple display interfaces, and determining a target display device connected to the target display interface, and a target menu interface control program associated with the target display interface; The action data is sent to the target menu interface control program, so that the target display device is controlled by the target menu interface control program to display the action corresponding to the action data.

2. The method according to claim 1, characterized in that The external device includes a keyboard and / or a mouse; the sending of the action data to the target menu interface control program so as to control the target display device to display an action corresponding to the action data through the target menu interface control program includes: When the external device is a keyboard, the input data of the keyboard is sent to the target menu interface control program, so that the target display device is controlled by the target menu interface control program to display the input data in the menu interface; and / or, When the external device is a mouse, the movement data and / or trigger data of the mouse is sent to the target menu interface control program, so that the target display device is controlled by the target menu interface control program to display the moved cursor and / or triggered event in the menu interface.

3. The method according to claim 1 or 2, characterized in that: After sending the action data to the target menu interface control program so as to control the target display device to display the action corresponding to the action data through the target menu interface control program, the method further includes: In response to the action data generated by the external device, a target host is mounted on the target display, and a mapping relationship between the target display device and the target host is established, wherein the target host is connected to the decoding node through an encoding node and a network connection device; The video data sent by the target host is received through the network connection device and the encoding node, and the video data sent by the target host is displayed through the target display device.

4. The method according to claim 3, characterized in that After displaying the video data sent by the target host through the target display device, the method further includes: In response to the action data generated by the external device being displayed in the video display area of ​​the target host, the action data is encoded and transmitted to the encoding node through the network connection device, and the encoding node decodes and transmits the action data to the operating system of the target host.

5. The method according to claim 3, characterized in that: After displaying the video data sent by the target host through the target display device, the method further includes: In response to the action data generated by the external device, mounting the external execution device on the target host and establishing a mapping relationship between the external execution device and the target host, wherein the external execution device is connected to the decoding node; Sending the device information of the external execution device to the operating system of the target host through the network connection device and the encoding node, so that the target host sets the device information of the external execution device in the video data of the target host; The device information of the external execution device is displayed through the target display device.

6. The method according to claim 5, characterized in that After displaying the device information of the external execution device through the target display device, the method further includes: In response to the action data generated by the external device, the external execution device is operated, and the action data for operating the external execution device is transmitted to the operating system of the target host through the network connection device and the encoding node. The operating system of the target host converts the action data into an operation instruction. The encoding node encodes the operation instruction and transmits it to the decoding node through the network connection device for decoding. Based on the decoded operation instruction, perform an operation on the external execution device; An operation response packet is generated, and the operation response packet is transmitted to the encoding node through the network connection device, and the encoding node transmits the operation response packet to the operating system of the target host.

7. The method according to claim 1 or 2, characterized in that: After sending the action data to the target menu interface control program so as to control the target display device to display the action corresponding to the action data through the target menu interface control program, the method further includes: In response to the action data generated by the external device, the target display device and other display devices in the same network are combined into a seat matrix, and based on the action data generated by the external device and the position of the cursor, the display device to be controlled is determined in the seat matrix, and the action data is sent to a menu interface control program associated with the display device to be controlled, so that the display device to be controlled can display an action corresponding to the action data through the menu interface control program.

8. The method according to claim 7, characterized in that Other display devices in the same network as the target display device include display devices connected to the same decoding node as the target display device, and / or display devices connected to other decoding nodes via the network connection device.

9. A distributed seat control method, characterized in that: The method comprises: Receiving the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration; Based on the association relationship between the display interface set on the decoding node and the host interface set on the encoding node, determine a target host interface among the multiple host interfaces, and determine a target host connected to the target host interface and a target serial composite device associated with the target host interface; The encoded action data is decoded and sent to the target serial composite device, so as to transmit the decoded action data to the operating system of the target host through the target serial composite device.

10. The method according to claim 9, characterized in that Before receiving the encoded action data sent by the decoding node, the method further includes: When the action data generated by the external device mounts the target host on the target display, a mapping relationship between the target host and the target display device is established, wherein the external device and the target display are connected to the decoding node; The video data of the target host is collected through the target host interface, the video data is encoded and transmitted to the decoding node through the network connection device, and the decoding node transmits the video data to the target display device after decoding, so that the video data sent by the target host can be displayed through the target display device.

11. The method according to claim 10, characterized in that The receiving and decoding the encoded action data sent by the node includes: When the action data generated by the external device is displayed in the video display area of ​​the target host, the encoded action data sent by the receiving decoding node is received through the network connection device.

12. The method according to claim 10, characterized in that The method further comprises: When the action data generated by the external device mounts the external execution device on the target host, establishing a mapping relationship between the external execution device and the target host, wherein the external execution device is connected to the decoding node; The device information of the external execution device is received through the network connection device and the decoding node, and the device information is sent to the operating system of the target host, so that the target host sets the device information of the external execution device in the video data of the target host.

13. The method according to claim 12, characterized in that The method further comprises: When the action data generated by the external device performs an operation on the external execution device, the action data is received through the network connection device, and the decoded action data is sent to the operating system of the target host, and the operating system of the target host converts the action data into an operation instruction; The operation instruction is encoded and transmitted to the decoding node through the network connection device, and the decoding node performs the operation on the external execution device based on the operation instruction; The operation response packet sent by the decoding node is received through the network connection device, and the operation response packet is transmitted to the operating system of the target host.

14. A distributed seat control device, characterized in that: The device comprises: A first receiving module, configured to receive action data generated by an external device, wherein the external device is connected to a decoding node, and the decoding node includes a plurality of display interfaces and an external device interface associated with each display interface; A first determining module, configured to determine a target display interface among the plurality of display interfaces based on an association relationship between an external device interface connected to the external device and a display interface, and to determine a target display device connected to the target display interface, and a target menu interface control program associated with the target display interface; The first control module is used to send the action data to the target menu interface control program, so as to control the target display device to display the action corresponding to the action data through the target menu interface control program.

15. A distributed seat control device, characterized in that: The device comprises: A second receiving module is used to receive the encoded action data sent by the decoding node, wherein the decoding node is connected to the encoding node through a network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration; A second determination module is used to determine a target host interface among the plurality of host interfaces based on an association relationship between a display interface set on the decoding node and a host interface set on the encoding node, and to determine a target host connected to the target host interface and a target serial composite device associated with the target host interface; The second control module is used to decode the encoded action data and send the decoded action data to the target serial compound device, so as to transmit the decoded action data to the operating system of the target host through the target serial compound device.

16. A distributed seat control system, characterized in that: The system includes an external device, a decoding node and at least one display device, wherein: The external device is connected to the decoding node via an external device interface, and is used to generate action data; The decoding node includes a plurality of display interfaces and an external device interface associated with each display interface, wherein each of the display interfaces is used to connect to a display device; The distributed agent control system is used to execute the method according to any one of claims 1 to 8.

17. The distributed seat control system according to claim 16, characterized in that: The system also includes a network connection device, a coding node and at least one host, wherein: The encoding node is connected to the decoding node through the network connection device, the encoding node includes a plurality of host interfaces and a serial composite device associated with each of the host interfaces, and the serial composite device is obtained by serial peripheral enumeration; The distributed agent control system is also used to execute the method according to any one of claims 9 to 13.

18. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.

19. A computer device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 13 is implemented.

Images