Signal source acquisition and control method and system

Abstract

This invention relates to a signal source retrieval and control method, comprising: receiving and analyzing user input; determining control commands for controlling a user interface (UI) and for controlling a signal source; controlling the UI to respond; drawing the UI based on the UI response result; and outputting the drawn UI to a video overlay and fusion device via a unidirectional video transmission device; determining UI data corresponding to the UI response result; and outputting the UI data corresponding to the UI response result to the video overlay and fusion device via a first unidirectional transmission path; controlling the signal source to respond via a second unidirectional transmission path according to the control commands for controlling the signal source; and causing the signal source to output the signal source response result to the video overlay and fusion device via a third unidirectional transmission path. This invention ensures the security of the signal source retrieval and control process.

Description

Technical Field

[0001] This invention relates to the field of signal source retrieval and control, and more particularly to signal source retrieval and control methods, systems, devices and computer program products for secure retrieval and control of signal sources. Background Technology

[0002] In existing technology, when a person with low-level access wants to operate a high-level signal source and display it on the screen for multiple people to view, they need to obtain the corresponding authorization first so that they can access the high-level signal source and send a signal retrieval command to it. However, this authorized operation and subsequent operation process have the following risks: the data of the high-level signal source being retrieved may be intercepted during the retrieval process, or other data of the high-level signal source may be stolen during the operation. Summary of the Invention

[0003] To address the above problems, this invention provides a signal source acquisition and control system, comprising:

[0004] UI interface and signal source control device, first unidirectional transmission device, unidirectional video transmission device, image overlay and fusion device, second unidirectional transmission device, third unidirectional transmission device and fourth unidirectional transmission device;

[0005] The fourth unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device.

[0006] The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input, and determine the control commands for controlling the UI interface and the control commands for controlling the signal source in the user input and the auxiliary input according to the pre-stored correspondence between input and control commands. It also controls the UI interface to respond according to the control commands for controlling the UI interface, draws the interface according to the UI interface response result, and outputs the drawn UI interface to the image overlay and fusion device through the unidirectional video transmission device.

[0007] The UI interface and signal source control device is also used to output the UI data corresponding to the UI interface response result to the screen overlay and fusion device through the first one-way transmission device, and to control the signal source through the second one-way transmission device so that it responds according to the control command for controlling the signal source and transmits the signal source response result to the screen overlay and fusion device through the third one-way transmission device.

[0008] The image overlay and fusion device receives a UI interface, receives UI data corresponding to the UI interface response result and determines the signal source display window information and mouse position information therein, receives the signal source response result, performs fusion, and outputs the fusion result to the display device; the fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse instructions at the corresponding positions according to the mouse position information.

[0009] A second aspect of the present invention provides a signal source acquisition and control system, comprising:

[0010] UI interface and signal source control device, one-way video transmission device, first one-way transmission device, image overlay and fusion device, one-way control device, second one-way transmission device, and third one-way transmission device;

[0011] The third unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device.

[0012] The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input, determine the control commands for controlling the UI interface and the control commands for controlling the signal source from the user input and the auxiliary input according to the pre-stored correspondence between input and control commands, control the UI interface to respond according to the control commands for controlling the UI interface, draw the UI interface according to the UI interface response result, and output the drawn UI interface through the unidirectional video transmission device; the UI interface and signal source control device is also used to determine the UI data corresponding to the UI interface response result, and output the UI data corresponding to the UI interface response result to the image overlay and fusion device through the first unidirectional transmission device.

[0013] The UI interface and signal source control device are also used to send the control command for controlling the signal source to the one-way control device, so that the one-way control device controls the signal source, so that it responds according to the control command for controlling the signal source and transmits the signal source response result to the screen overlay and fusion device through the second one-way transmission device.

[0014] The image overlay and fusion device receives a UI interface, receives UI data corresponding to the UI interface response result and determines the signal source display window information and mouse position information therein, receives the signal source response result, performs fusion, and outputs the fusion result to the display device; the fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse instructions at the corresponding positions according to the mouse position information.

[0015] A third aspect of the present invention provides a signal source acquisition and control system, comprising:

[0016] UI interface and signal source control device, one-way video transmission device, first one-way transmission device, image overlay and fusion device, one-way control equipment, control network switch, video network switch, video encoding equipment, second one-way transmission device and third one-way transmission device;

[0017] The third unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device.

[0018] The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input, and determine the control command for controlling the UI interface and the control command for controlling the signal source according to the pre-stored correspondence between input and control commands. It also controls the UI interface to respond according to the control command for controlling the UI interface, draws the interface according to the UI interface response result, and outputs the drawn UI interface to the image overlay and fusion device through the unidirectional video transmission device.

[0019] The UI interface and signal source control device is also used to determine the UI data corresponding to the UI interface response result and output it to the image overlay and fusion device through the first unidirectional transmission device.

[0020] The UI interface and signal source control device will also send the control commands for controlling the signal source to the control network switch, which will then send them to the one-way control device. The one-way control device will control the signal source to respond according to the control commands for controlling the signal source and output the response results to the video encoding device through the second one-way transmission device.

[0021] The video encoding device is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then the video network switch transmits it to the image overlay and fusion device.

[0022] The image overlay and fusion device receives a UI interface, receives UI data corresponding to the UI interface response result and determines the signal source display window information and mouse position information therein, receives the network stream signal, decodes the network stream signal into video stream data, uses this video stream data as the signal source response result, performs fusion, and outputs the fusion result to the display device; the fusion includes displaying the signal source response result in the signal source display window on the UI interface, and providing mouse pointers at corresponding positions according to the mouse position information.

[0023] Through the above embodiments of the present invention, users can enjoy an experience and efficiency similar to operating a local computer when retrieving and controlling signal sources, while ensuring the security of the interaction process. Simultaneously, the signal source itself can participate in the interaction through a secure mechanism, rather than being completely passively interacted with. Furthermore, by directly outputting the UI interface rendering results to the screen overlay and fusion device, on the one hand, the UI interface can be quickly displayed on the screen, avoiding re-analysis and rendering that would cause screen lag; on the other hand, it further ensures the security of information transmission and the interaction process, preventing others from obtaining useful information by intercepting information from one path. Attached Figure Description

[0024] Figure 1a A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0025] Figure 1b A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0026] Figure 1c A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0027] Figure 1d A schematic diagram of a security interface isolation box according to some embodiments of the present invention is shown;

[0028] Figure 1e A schematic diagram of a one-way isolation box for instructions is shown according to some embodiments of the present invention;

[0029] Figure 1f A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0030] Figure 2a A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0031] Figure 2b A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0032] Figure 2c A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0033] Figure 2d A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0034] Figure 3a A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0035] Figure 3bA schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown;

[0036] Figure 4 This illustrates the changes in the signal source display window during signal source retrieval and control according to some embodiments of the present invention;

[0037] Figure 5 A flowchart illustrating a signal source retrieval and control method according to some embodiments of the present invention is shown schematically;

[0038] Figure 6 A flowchart illustrating a signal source retrieval and control method according to some embodiments of the present invention is shown schematically;

[0039] Figure 7 A schematic diagram of a device for signal source acquisition and control according to some embodiments of the present invention is shown. Detailed Implementation

[0040] In this application, any mention of network implementation essentially encompasses wired or wireless network connections implemented through necessary firmware or software such as switches and routers, as well as wired or wireless network connections mediated by servers or other computers. For the sake of simplicity and highlighting the inventive points, descriptions of routers / switches are sometimes omitted when describing network connections. In this application, the networks involved can include Wi-Fi networks, Bluetooth networks, private area networks (PANs), local area networks (LANs), wide area networks (WANs), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network can also include digital cellular telephone networks, which may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, Evolution-Data Optimized (EV-DO), Enhanced Data Rate GSM Evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Communication (DECT), Digital AMPS (IS-136 / TDMA), Integrated Digital Enhanced Network (iDEN), WiMAX, LTE, LTE Advanced, Mobile Broadband Wireless Access (MBWA), and IEEE 802.20. The network can be publicly accessible, private, or virtual private, such as a VPN.

[0041] The present invention will now be described by way of example with reference to the accompanying drawings and embodiments. It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. Furthermore, the described embodiments are only some, not all, of the embodiments of the present invention.

[0042] This application involves the use of fiber optic cables, serial ports, and other connections. To use these connections, a matching conversion module may be required. For example, when converting a signal from a network to an optical fiber, a network-to-optical module is needed. However, if the computer network port itself is an optical port, the additional network-to-optical module can be omitted. Since the necessity of such a module can be determined based on the actual application scenario and is well known to those skilled in the art, it is not described one by one for the sake of simplicity, but this does not indicate the omission of necessary conversion modules.

[0043] Figure 1a A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown.

[0044] The signal source retrieval and control system includes a UI interface and a signal source control device 102, related devices on the first unidirectional transmission path 104, a unidirectional video transmission device 1041, a screen overlay and fusion device 108, related devices on the second unidirectional transmission path 1061, related devices on the third unidirectional transmission path 1063, and related devices on the fourth unidirectional transmission path 1064.

[0045] In this application, the first, second, third, and fourth unidirectional transmission paths may include various devices capable of realizing unidirectional transmission or unidirectional control. These devices can be a unidirectional control device or a unidirectional transmission cable (e.g.,...). Figure 1f As shown, a unidirectional transmission device, or an integral unit consisting of a control device and transmission cables, etc., when used as a whole to achieve unidirectional transmission or unidirectional control, does not limit the individual control devices or connecting cables in the whole to be unidirectional. For example, some devices or connecting cables between devices may have bidirectional or multidirectional paths, but the unidirectional transmission device as a whole can still achieve unidirectional transmission or unidirectional control. For another example, the path may involve network connections, but when the network connection is combined with other devices, the combined whole can achieve a unidirectional purpose, as will be described below. Such cases are also within the scope of the present invention and the scope of protection claimed.

[0046] The UI interface and signal source control device can pre-store multiple UI interfaces and the correspondence between each UI interface and input. For example, storing the correspondence between each UI interface and each login information allows the corresponding UI interface to be determined based on the login information: when a user logs in with different accounts, the UI interface and signal source control device receives and analyzes the user's input (account), and retrieves the corresponding UI interface based on the input (account). Furthermore, when screen 100 is composed of multiple screens, the UI interface and signal source control device can also store the correspondence between UI interfaces and screens, or the correspondence between login information and screens, allowing the corresponding screen to be determined after the UI interface is determined, or the corresponding screen to be determined based on the login information. Additionally, different permissions can be set for different accounts, so that when certain accounts log in, only a specific UI interface can be used.

[0047] According to some embodiments of the present invention, the content of the UI interface may include interactive labels such as save, plot, delete, screen record, undo, and clear, display window distribution, mouse, etc. Different UI interfaces may have different labels, border distributions, etc. Plotting refers to actions such as drawing lines, adding geometric structure diagrams and flowcharts, as well as adding annotations, text, and coloring; UI data is data describing the various components of a UI interface and the position of each component, such as interactive labels such as save, plot, delete, screen record, undo, and clear, display windows, mouse, etc.

[0048] The UI interface and signal source control device 102 can receive and analyze user input, determine the UI interface to be retrieved, the control command for controlling the UI interface 1025, and the control command for controlling the signal source (assuming the controlled signal source is signal source 1) according to the pre-stored correspondence between input and control commands, and control the UI interface to respond according to the control command for controlling the UI interface 1025, draw the UI interface according to the UI interface response result, and output the drawn UI interface to the image overlay and fusion device 108 through the unidirectional video transmission device 1041.

[0049] According to some embodiments of the present invention, when only one UI interface exists, the UI interface and the signal source control device 102 do not need to separately determine the UI interface to be invoked, nor respond to the input (e.g., once an input related to signal source invocation and control is detected). The screen corresponding to the UI interface is output to the screen overlay and fusion device 108 via the one-way video transmission device 1041, and the screen overlay and fusion device 108 outputs the UI interface to the screen 100. By outputting the desired UI interface to the screen 100, the user can refer to the displayed content on the screen for input operations in subsequent interactive actions, such as moving the local mouse, pressing the local keyboard, or entering shortcut keys, in order to change the UI interface or control the signal source, ultimately causing the signal source's display interface on the screen to change accordingly or the signal source's output content to change.

[0050] According to some embodiments of the present invention, the control commands of the control UI interface may include, for example, clicking the drop-down menu in the square where the signal source 1 is located in the figure, moving, enlarging or shrinking the display window position of the signal source 1, etc.

[0051] According to some embodiments of the present invention, the control commands for controlling the signal source may include, for example, control commands for playing, pausing, or turning off the signal source.

[0052] The UI interface and signal source control device 102 is also used to output the UI data corresponding to the initial UI interface response result, and the UI data corresponding to the UI interface response result after the subsequent response control command, to the screen overlay and fusion device 108 through the first unidirectional transmission path 104. The UI interface and signal source control device 102 can determine the changes in the UI interface and the corresponding UI data in real time through the UI interface and the control commands used to control the UI interface.

[0053] According to other embodiments of the present invention, only the mouse position information and signal source display window information in the UI data corresponding to the UI interface response result are transmitted to the screen overlay and fusion device. The mouse position information includes pointer position data.

[0054] The UI interface and signal source control device 102 also controls the signal source 1 to respond through the second unidirectional transmission path 1061 according to the control command for controlling the signal source, and causes the signal source 1 to output the response result to the screen overlay and fusion device 108 through the third unidirectional transmission path 1063.

[0055] The image overlay and blending device 108 is used to receive the UI interface (i.e., UI interface frame), receive UI data corresponding to the UI interface response result and determine the signal source display window information and mouse position information therein, receive the signal source response result, perform blending, and output the blending result to the screen. The blending includes displaying the signal source response result in the signal source display window on the UI interface, and providing mouse pointers at corresponding positions according to the mouse position information. For example, displaying the content from signal source 1 to... Figure 1a The UI interface displays the words "Signal Source 1" and provides a mouse cursor at the corresponding location. One possible fusion method is to first output the UI interface, then display the signal source response result in the signal source display window within the UI interface, and finally output a mouse cursor at the mouse position on the UI interface. Since fusion methods involving integrating other information onto an interface are known to those skilled in the art, they will not be described in detail here, and these fusion methods are also within the scope of this invention.

[0056] According to some embodiments of the present invention, the signal source acquisition and control system may further include an input generation device 101. (See reference) Figure 1a The input generating device 101 can be, for example, a keyboard, mouse, or other input device. In some embodiments, the input from the input generating device can trigger the UI interface and the signal source control device 102 to output the UI interface to be operated to the image overlay and fusion device 108 via a one-way video transmission device. According to some embodiments of the present invention, control commands for controlling the signal source and control commands for controlling the UI interface can be input through the input generating device.

[0057] The input generating device can be, for example, an infrared frame touch input device or a capacitive touch device. Furthermore, the input generating device can also be an input generating device that captures touch or other control actions using various methods such as inductive, magnetic, thermal, and optical sensing. Additionally, control commands can be generated via a network. According to some embodiments of the present invention, the input generating device can be spatially superimposed on the screen 100. As will be described below, the screen 100 can provide a view of the controlled object. When the input generating device is a transparent touch device, by superimposing the touch device on the screen and referring to the view of the screen below the transparent touch device, visual touch can be achieved on the input generating device. The connection method of the screen 100 and the input generating device in the entire device is as follows: Figure 1a As shown.

[0058] According to some embodiments of the present invention, the UI interface and signal source control device 102 can also save the UI interface response results for updating the pre-stored UI interface as the UI interface to be retrieved next time.

[0059] According to some embodiments of the present invention, the UI interface and signal source control device 102 outputs UI data of the UI interface to the image overlay and fusion device 108 through the first unidirectional transmission path 104, including outputting the UI data to the image overlay and fusion device 108 in the following manner:

[0060] The UI data is output to the image overlay and blending device 108 via one of the following a)-b):

[0061] a) Unidirectional optical fiber;

[0062] b) One-way serial cable;

[0063] At this time, the first unidirectional transmission path includes a unidirectional optical fiber, or a unidirectional connector such as a unidirectional video cable. The unidirectional optical fiber includes an optical fiber and an optical fiber isolator. Furthermore, in this application, for the sake of simplicity, the term "unidirectional optical fiber" is intended to encompass accessories such as optical transceivers (optical-to-serial converters that convert optical signals to electrical signals or electrical-to-optical converters that convert electrical signals to optical signals) that may be used in conjunction with it. Given that such compatibility is common knowledge in the art, it is not described in detail where the context is obvious. Additionally, other devices for implementing unidirectional transmission are also within the scope of this invention. Correspondingly, the signal source retrieval and control system according to some embodiments of the present invention may further include the first unidirectional transmission device; the following cases are similar and will not be repeated.

[0064] According to some embodiments of the present invention, UI data can be output to the screen overlay and blending device 108 in the following manner:

[0065] The UI data is transmitted sequentially through the first network, the network-to-optical device, and the unidirectional optical fiber to the image overlay and fusion device.

[0066] According to some embodiments of the present invention, UI data can be output to the image overlay and blending device in the following manner:

[0067] The UI data is sequentially output to the image overlay and fusion device via a first network, a first unidirectional transmission device (c)-d) below, and a second network:

[0068] c) Unidirectional optical fiber;

[0069] d) A combination of network-to-optical equipment, unidirectional optical fiber, and optical-to-network equipment.

[0070] According to some embodiments of the present invention, UI data can be output to the image overlay and blending device in the following manner:

[0071] The UI data is sequentially output to the image overlay and fusion device via one of the following e)-f):

[0072] e) Unidirectional optical fiber;

[0073] f) Combination of unidirectional optical fiber and optical-to-network equipment.

[0074] In this application, the first network and the second network are only concepts used to distinguish and describe the two networks, and have no other specific meaning; in some drawings and descriptions, the network where the control network switch or the video network switch is located can be used to refer to the first network and the second network.

[0075] According to some embodiments of the present invention, the control signal source responds via a second unidirectional transmission path in accordance with the control command for controlling the signal source, including by means of the following:

[0076] The signal source responds via one of the following a)-d):

[0077] a) Unidirectional optical fiber;

[0078] b) One-way serial cable;

[0079] c) A combination of unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0080] d) A combination of unidirectional optical fiber, optical-to-serial converter, and unidirectional serial cable;

[0081] According to some embodiments of the present invention, the control signal source responds via a second unidirectional transmission path in accordance with the control command for controlling the signal source, including by means of the following:

[0082] The control signal source responds sequentially via the first network and one of the second unidirectional transmission devices (e)-h) below:

[0083] e) A combination of a network-to-serial converter and a unidirectional serial cable;

[0084] f) A combination of network-to-optical equipment and unidirectional optical fiber;

[0085] g) A combination of network-to-serial converter, unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0086] h) A combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment, and unidirectional serial cable;

[0087] According to some embodiments of the present invention, the control signal source responds via a second unidirectional transmission path in accordance with the control command for controlling the signal source, including by means of the following:

[0088] The signal source responds sequentially via a first network, a second unidirectional transmission device (i)-m) below, and a third network where the signal source is located:

[0089] i) Unidirectional optical fiber;

[0090] j) A combination of a network-to-serial converter, a unidirectional serial cable, and a serial-to-network converter;

[0091] k) A combination of network-to-optical equipment, unidirectional optical fiber, and optical-to-network equipment;

[0092] l) A combination of network-to-serial conversion equipment, unidirectional serial cable, serial-to-optical conversion equipment, unidirectional optical fiber, and optical-to-network conversion equipment;

[0093] m) A combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment, unidirectional serial cable, and serial-to-network equipment;

[0094] According to some embodiments of the present invention, the control signal source responds via a second unidirectional transmission path in accordance with the control command for controlling the signal source, including by means of the following:

[0095] The response is sequentially transmitted via one of the following n)-r) second unidirectional transmission devices and the third network where the signal source is located, controlling the signal source:

[0096] n) Unidirectional optical fiber;

[0097] o) A combination of unidirectional optical fiber, optical-to-serial converter, unidirectional serial cable and serial-to-network converter;

[0098] p) A combination of unidirectional optical fiber and optical network conversion equipment;

[0099] q) A combination of a unidirectional serial cable and a serial-to-network converter;

[0100] r) A combination of unidirectional serial cable, serial-to-optical converter, unidirectional optical fiber, and optical-to-network converter;

[0101] According to some embodiments of the present invention, the control signal source responds via a second unidirectional transmission path in accordance with the control command for controlling the signal source, including by means of the following:

[0102] The signal source is controlled by a one-way control device to respond.

[0103] According to some embodiments of the present invention, the response via the control signal source through the second unidirectional transmission path is achieved by means of the following:

[0104] The control command for controlling the signal source is transmitted to the control device via one of the following a)-d), and the control device controls the signal source to respond:

[0105] a) Unidirectional optical fiber;

[0106] b) One-way serial cable;

[0107] c) A combination of unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0108] d) A combination of unidirectional optical fiber, optical-to-serial converter, and unidirectional serial cable;

[0109] According to some embodiments of the present invention, the response via the control signal source through the second unidirectional transmission path is achieved by means of the following:

[0110] The control command for controlling the signal source is transmitted to the control device sequentially through the first network and one of the second unidirectional transmission devices (e)-h) below, and the control device controls the signal source to respond:

[0111] e) A combination of a network-to-serial converter and a unidirectional serial cable;

[0112] f) A combination of network-to-optical equipment and unidirectional optical fiber;

[0113] g) A combination of network-to-serial converter, unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0114] h) A combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment, and unidirectional serial cable.

[0115] According to some embodiments of the present invention, the response via the control signal source through the second unidirectional transmission path is achieved by means of the following:

[0116] The control commands for controlling the signal source are transmitted to the control device via the first network, and the control device controls the signal source to respond via one of the following i)-l):

[0117] i) Unidirectional optical fiber;

[0118] j) One-way serial cable;

[0119] k) A combination of unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0120] l) A combination of unidirectional optical fiber, optical-to-serial converter, and unidirectional serial cable.

[0121] According to some embodiments of the present invention, the signal source response result is output to the image overlay and fusion device via a third unidirectional transmission path in the following manner:

[0122] 1) The signal source transmits its response to the image overlay and fusion device via one of the following a)-b):

[0123] a) Unidirectional optical fiber;

[0124] b) One-way video cable;

[0125] According to some embodiments of the present invention, the signal source response result is output to the image overlay and fusion device via a third unidirectional transmission path in the following manner:

[0126] The signal source transmits its response result to a video encoding device via one of the following (c)-d): the signal source response result is encoded into a network stream signal, and the network stream signal is sent to the image overlay and fusion device via a second network. The image overlay and fusion device decodes the network stream signal into video stream data, uses this video stream data as the signal source response result for fusion, and outputs the fusion result to the corresponding screen 100.

[0127] c) Unidirectional optical fiber;

[0128] d) One-way video cable.

[0129] According to some embodiments of the present invention, the first network and the second network are isolated; the second network and the third network are isolated; and the first network and the third network are isolated.

[0130] According to some embodiments of the present invention, when a user operates on a signal source, the signal source outputs control commands to control the UI interface on screen 100; to distinguish it from the user input mentioned above, the input generated on the signal source is referred to as auxiliary input. This auxiliary input is transmitted to the UI interface and the signal source control device via a fourth unidirectional transmission path. As one of all control commands received by the UI interface and the signal source control device, the auxiliary input is transmitted to the UI interface and the signal source control device via the fourth unidirectional transmission path, including transmission to the UI interface and the signal source control device via one of the following i)-l):

[0131] i) Unidirectional optical fiber;

[0132] j) One-way serial cable;

[0133] k) A combination of unidirectional serial cable, serial-to-optical converter and unidirectional optical fiber;

[0134] l) A combination of unidirectional optical fiber, optical-to-serial converter, and unidirectional serial cable.

[0135] The UI interface and signal source control device process and respond to the auxiliary input in a manner similar to the processing and response to the input generated by the input generating device 101, but can refuse to respond to inputs generated by the signal source that are not used to control the UI interface.

[0136] In the above description, the various transmissions and controls implemented via the first path, the second path, and the third path can be combined without conflict to achieve the inventive objective of this invention. A further description of the unidirectional control device follows.

[0137] Figure 1b A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown.

[0138] Among them Figure 1a The difference lies in the dotted line portion of the diagram; the part outside the dotted line frame is different from... Figure 1a Similarly, therefore, it will continue to be used. Figure 1a The attached figures are labeled with reference to the figures.

[0139] Figure 1b The system shown further includes a security command service box 365. Control commands are sent to the security command service box 365 via the control network switch 33. (The security command service box 365 is referenced.) Figure 1c This includes a command distribution server 3651, a serial optical transceiver transmitter 3652, a serial optical transceiver receiver 3654, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3653 within the optical fiber, and a unidirectional serial cable connecting the transmitter and the command distribution server, and a unidirectional serial cable connecting the receiver 3654. In this application, for simplicity, the optical fiber and optical fiber isolator are sometimes collectively referred to as a unidirectional optical fiber. The transmitter and receiver of the serial optical transceiver can also be called serial-to-optical or optical-to-serial devices. The command distribution server 3651 is used to convert control commands in network signal form into control commands in serial port form, and outputs these control commands along the corresponding serial optical transceiver transmitter, unidirectional optical fiber, and serial optical transceiver receiver, such as along... Figure 1c The transmission link output is shown in row 1, or along the transmission link in row 2. Two sets of transmission links are shown in the figure; the number of sets of transmission links can be configured according to the actual number of signal sources. When the network connection is fiber optic, the security command service box 365 may include a command distribution server 3651 and multiple unidirectional optical fibers. The command distribution server 3651 distributes control commands to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers. That is, it is not necessary to convert the network signal into an optical signal separately. According to some embodiments of the present invention, when the network connection is cable, the command distribution server converts control commands in network signal form into control commands in optical signal form, and distributes the control commands in optical signal form to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers.

[0140] According to some embodiments of the present invention, Figure 1b The system shown further includes an instruction output box (3611, 3621). This instruction output box includes a serial port and a USB port for receiving control instructions (such as mouse, keyboard, and multi-touch commands) in serial format from the security instruction service box, parsing them, and ultimately forming an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source. According to some embodiments of the invention, this functionality can also be integrated into the security instruction service box. If the security instruction service box transmits signals in other non-serial formats, the instruction output box can also parse them and ultimately form an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source.

[0141] According to some embodiments of the present invention, Figure 1b The system shown may further include a security interface isolation box 366, which includes a video optical transceiver transmitter 3661, a video optical transceiver receiver 3662, an optical fiber connecting the video optical transceiver receiver and transmitter, an optical fiber isolator 3663 in the optical fiber, and a video cable connecting to the output port of the transmitter, such as... Figure 1d As shown. The security interface isolation box 366 is used to achieve unidirectional transmission in the x-direction as illustrated. The transmitter and receiver of a video optical transceiver can also be called electro-optical to optical or optical-electrical, or video-to-optical or optical-to-video, depending on the object they are converting. The figure shows two sets of transmission links; the number of transmission links can be configured according to the actual number of signal sources. Each transmission link includes a video optical transceiver transmitter, a video optical transceiver receiver, an optical fiber connecting the receiver and transmitter, and an optical fiber isolator within the optical fiber.

[0142] According to some embodiments of the present invention, Figure 1b The system shown may further include a unidirectional command isolation box 367, which includes a unidirectional serial cable connected in sequence to a signal source, a serial optical transceiver transmitter 3671, a serial optical transceiver receiver 3672, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3673 in the optical fiber, and a unidirectional serial cable connected to the receiver 3672 of the serial optical transceiver. Figure 1e As shown. The unidirectional isolation box receives control commands generated by the signal source and transmits them unidirectionally to the UI interface and the signal source control device. The UI interface and the signal source control device receive the control commands and perform corresponding processing and responses, including converting the control commands in serial port signal form into, for example, USB control commands; determining the UI interface to be invoked or the control command used to control the UI interface based on the pre-stored correspondence between input and control commands; and performing corresponding control, as detailed in the previous reference. Figure 1aThe response method for control commands described herein will not be repeated here; if it is determined that the control command is a control command used to control other signal sources, then the command will be refused to be executed.

[0143] Figure 2a A schematic diagram of a signal source acquisition and control system according to further embodiments of the present invention is shown. Wherein, with Figure 1a The difference lies in the dotted line portion of the diagram; the part outside the dotted line frame is different from... Figure 1a Similarly, therefore, it will continue to be used. Figure 1a The attached figures are labeled with reference to the figures.

[0144] exist Figure 2a In this process, the UI interface and signal source control device 102 send control commands for controlling the signal source to the one-way control device 161 through the control network switch 13. The one-way control device 161 receives the control commands from the UI interface and signal source control device 12 and controls the signal source 1 according to the control commands. The signal source 1 responds to the control of the one-way control device 161, performs corresponding keyboard, mouse, touch and other operations, and sends the content of the signal source 1 (such as video content in the form of video stream data) corresponding to the operation result or response result to the video encoding device 163 through a one-way transmission device such as a one-way video cable or one-way optical fiber. The video encoding device encodes the video stream data into a network stream signal and sends the video content in the form of the network stream signal to the screen overlay and fusion device 18 through the video network switch 15.

[0145] According to some embodiments, the composition of the one-way control device 161 and its function on the signal source can vary depending on the signal source. For example, when the signal source is a computer, the one-way control device 161 can send control data in protocol form to the signal source to perform one-way control of the signal source, and the content of the signal source will not be transmitted back to the one-way control device. When the signal source is a device such as a camera, the one-way control device may include a one-way transmission device and a control device. The control device is used to control the camera according to the control data, and the one-way transmission device can prevent the camera content from flowing back to the one-way control device. For example, the one-way control device may include a one-way transmission device and a USB controller. The USB controller is a standard USB-HID device that is connected to the signal source via USB and can control the signal source with a keyboard and mouse.

[0146] The image overlay and fusion device 18 receives video content in the form of a network stream signal from the signal source 1 of the video network switch, decodes it into video stream data, and receives a UI interface, receives the UI data and determines the signal source display window information and mouse position information therein, as well as receives video content in the form of a network stream signal from the signal source 1 of the video network switch, decodes it into video stream data signal source response results, performs fusion, and outputs the fusion result to the corresponding screen. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse pointers at the corresponding positions according to the mouse position information.

[0147] According to some embodiments of the present invention, the control commands for controlling the signal source are encrypted to further improve the security of the interaction. The encryption can be performed before sending the control commands for controlling the signal source, or on the second unidirectional transmission path. For example, an encryption device can be introduced on the second unidirectional transmission path (such as after a network-to-serial converter) to encrypt the commands, or encryption software can be introduced within some hardware on the second unidirectional transmission path (such as a network-to-serial converter) to encrypt the commands. Correspondingly, the signal source receiving the control commands decrypts the control commands and responds, or a decryption device can be introduced at a nearby signal source to decrypt the commands.

[0148] According to some embodiments of the present invention, the method may further include encrypting the signal source response result before transmitting it to the image overlay and fusion device, or encrypting it on a third unidirectional transmission path; correspondingly, the image overlay and fusion device receiving the signal source response result decrypts the encrypted content, or a decryption device may be introduced at a nearby image overlay and fusion device to decrypt it. The following embodiments are similar.

[0149] Figure 2b A schematic diagram of a signal source acquisition and control system according to further embodiments of the present invention is shown. Wherein, with Figure 2a The difference lies in that the first unidirectional transmission path 104 is located between the control network switch and the video network switch, and the UI data is output to the image overlay and fusion device through the control network switch, the first unidirectional transmission path (or unidirectional transmission device), and the video network switch. The remaining parts and Figure 2a Similarly, for the sake of simplicity, it will not be elaborated further.

[0150] Depending on the network requirements of the working environment, in some other embodiments of the present invention, the components of the above system can be changed, for example, the components related to network access can be included or omitted. For example, 1) if a video network switch is not required, and only a control network switch is needed, the UI data can be output to the image overlay and fusion device through the control network switch and the unidirectional transmission device; 2) if a control network switch is not required, and only a video network switch is needed, the UI data can be output to the image overlay and fusion device through the unidirectional transmission device and the video network switch; 3) if a video network and control network environment are not required, the UI data can be directly output to the image overlay and fusion device through the unidirectional transmission device. Corresponding to 1) above, control data can be transmitted to the unidirectional control device through the control network switch. Corresponding to 2) and 3) above, control data can be directly transmitted to the unidirectional control device. Corresponding to 1) and 3) above, the response result of the signal source is output to the image overlay and fusion device through a unidirectional optical fiber or a unidirectional video line. Corresponding to 2) above, the response result of the signal source is encoded by the video encoding device, and the encoding result is transmitted to the video network switch through a unidirectional optical fiber or other unidirectional transmission line (such as a cable), and then transmitted by the video network switch to the image overlay and fusion device 18.

[0151] In addition, the front is surrounded Figure 1a The details of the signal source retrieval and control process described herein can be applied here, or can be applied here with appropriate modifications. For simplicity, they will not be repeated here.

[0152] Figure 2c A schematic diagram of a signal source acquisition and control system according to further embodiments of the present invention is shown. Wherein, with Figure 2a The difference lies in the dashed box section. Given the components within the dashed box and... Figure 1b Since the parts involved are similar, the same reference numerals are used in the accompanying drawings.

[0153] Compared to Figure 2a , Figure 2c The system shown further includes a security command service box 365. Control commands are sent to the security command service box 365 via the control network switch 33. (The security command service box 365 is referenced.) Figure 1c This includes a command distribution server 3651, a serial optical transceiver transmitter 3652, a serial optical transceiver receiver 3654, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3653 within the optical fiber, a unidirectional serial cable connecting the transmitter and the command distribution server, and a unidirectional serial cable connecting the receiver 3654. The command distribution server 3651 converts control commands in network signal form into control commands in serial port form, and outputs these control commands along the corresponding serial optical transceiver transmitter, unidirectional optical fiber, and serial optical transceiver receiver, such as along... Figure 1c The transmission link output is shown in row 1, or along the transmission link in row 2. Two sets of transmission links are shown in the figure; the number of sets of transmission links can be configured according to the actual number of signal sources. When the network connection is fiber optic, the security command service box 365 may include a command distribution server 3651 and multiple unidirectional optical fibers. The command distribution server 3651 distributes control commands to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers. That is, it is not necessary to convert the network signal into an optical signal separately. According to some embodiments of the present invention, when the network connection is cable, the command distribution server converts control commands in network signal form into control commands in optical signal form, and distributes the control commands in optical signal form to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers.

[0154] According to some embodiments of the present invention, Figure 2c The system shown further includes an instruction output box (3611, 3621). This instruction output box includes a serial port and a USB port for receiving control instructions (such as mouse, keyboard, and multi-touch commands) in serial form from the security instruction service box, parsing them, and ultimately forming an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source.

[0155] According to some embodiments of the present invention, Figure 2c The system shown may further include a security interface isolation box 366, which includes a video optical transceiver transmitter 3661, a video optical transceiver receiver 3662, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3663 in the optical fiber, and a video cable connecting the output port of the transmitter. The security interface isolation box 366 is used to realize unidirectional transmission in the x-direction shown in the figure.

[0156] The unidirectional command isolation box 367 includes a unidirectional serial cable connected in sequence to the signal source, a serial optical transceiver transmitter 3671, a serial optical transceiver receiver 3672, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3673 in the optical fiber, and a unidirectional serial cable connected to the receiver 3672. The unidirectional command isolation box is used to receive control commands generated on the signal source and transmit them unidirectionally to the UI interface and the signal source control device. The UI interface and the signal source control device receive the control commands and perform corresponding processing and responses, including converting the control commands in serial signal form into, for example, USB control commands; determining the UI interface to be invoked or the control command used to control the UI interface based on a pre-stored correspondence between input and control commands; and performing corresponding control, as detailed in the previous reference. Figure 1aThe described response method to control commands will not be repeated here; if it is determined that the control command is for controlling other signal sources rather than the UI interface, then the command will be refused execution. Furthermore, those skilled in the art will understand that... Figure 2a Other descriptive techniques may also be applicable here depending on the context, but for the sake of simplicity, they will not be elaborated here.

[0157] Figure 2d A schematic diagram of a signal source acquisition and control system according to further embodiments of the present invention is shown. Wherein, with Figure 2b The difference lies in the dashed box section. Given the components within the dashed box and... Figure 1b Since the parts involved are similar, the same reference numerals are used in the accompanying drawings.

[0158] Compared to Figure 2b , Figure 2d The system shown further includes a security command service box 365. Control commands are sent to the security command service box 365 via the control network switch 33. (The security command service box 365 is referenced.) Figure 1c This includes a command distribution server 3651, a serial optical transceiver transmitter 3652, a serial optical transceiver receiver 3654, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3653 within the optical fiber, a unidirectional serial cable connecting the transmitter and the command distribution server, and a unidirectional serial cable connecting the receiver 3654. The command distribution server 3651 converts control commands in network signal form into control commands in serial port form, and outputs these control commands along the corresponding serial optical transceiver transmitter, unidirectional optical fiber, and serial optical transceiver receiver, such as along... Figure 1c The transmission link output in line 1, or the transmission link output along line 2.

[0159] According to some embodiments of the present invention, Figure 2d The system shown further includes an instruction output box (3611, 3621). This instruction output box includes a serial port and a USB port for receiving control instructions (such as mouse, keyboard, and multi-touch commands) in serial form from the security instruction service box, parsing them, and ultimately forming an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source.

[0160] According to some embodiments of the present invention, Figure 2dThe system shown may further include a security interface isolation box 366, which includes a video optical transceiver transmitter 3661, a video optical transceiver receiver 3662, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3663 in the optical fiber, and a video cable connecting the output port of the transmitter. The security interface isolation box 366 is used to realize unidirectional transmission in the x-direction shown in the figure.

[0161] The unidirectional command isolation box 367 includes a unidirectional serial cable connected in sequence to the signal source, a serial optical transceiver transmitter 3671, a serial optical transceiver receiver 3672, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3673 in the optical fiber, and a unidirectional serial cable connected to the receiver 3672. The unidirectional command isolation box is used to receive control commands generated on the signal source and transmit them unidirectionally to the UI interface and the signal source control device. The UI interface and the signal source control device receive the control commands and perform corresponding processing and responses, including converting the control commands in serial signal form into, for example, USB control commands; determining the UI interface to be invoked or the control command used to control the UI interface based on a pre-stored correspondence between input and control commands; and performing corresponding control, as detailed in the previous reference. Figure 1a The described response to control commands will not be repeated here; if it is determined that the control command is for controlling other signal sources, then the command will be refused execution. Furthermore, those skilled in the art will understand that... Figure 2a Other descriptive techniques, including those in the accompanying drawings, may be applied here, or may be applied here with appropriate modifications. For the sake of simplicity, they will not be elaborated further here.

[0162] Figure 3a A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown.

[0163] The signal source retrieval and control system includes a multi-network security device 300, a control network switch 33, a video network switch 35, unidirectional control devices (361, 362; 371, 372), video encoding devices (363, 364; 373, 374), and a unidirectional transmission device connecting the signal sources (signal source 1, signal source 2; signal source n, signal source m) and the video encoding devices (363, 364; 373, 374). According to some embodiments of the present invention, the UI interface and signal source control device 32 may further include an input generation device 31.

[0164] The multi-network security device 300 includes: a UI interface and signal source control device 32, a one-way transmission device 34, a one-way video transmission device 341 (such as a one-way HDMI video cable or VGA video cable), and a screen overlay and fusion device 38.

[0165] The UI interface and signal source control device receives and analyzes user input (such as login account), determines the UI interface 325 corresponding to the operation, and the operation object (signal source 1). It then draws the UI interface based on the UI data related to UI interface 325 and sends the UI interface to the image overlay and fusion device 38 via the one-way video transmission device 341. The image overlay and fusion device 38 then outputs the UI interface to the screen 301, allowing the user to see the desired UI interface 325 on the screen. Subsequently, the user can refer to the interface 305 on the screen 301 for further operations.

[0166] The UI interface and signal source control device 32 can receive and analyze further user input. Based on a pre-stored correspondence between input and control commands, it determines the corresponding control commands for controlling the UI interface 325 and the signal source 1. It also controls the UI interface to respond according to the control commands, draws the UI interface based on the response results, and outputs the drawn UI interface to the image overlay and fusion device 38 via the unidirectional video transmission device. The UI interface and signal source control device 32 also determines real-time UI data based on the initial UI data and the control commands for controlling the UI interface, and outputs the UI data to the image overlay and fusion device 38 via the unidirectional transmission device 34. The UI interface and signal source control device 32 also send the control commands for controlling signal source 1 to the corresponding one-way control device 361 through the control network switch 33. The one-way control device 361 controls signal source 1 to respond according to the control commands for controlling signal source 1, and outputs the response result to video encoding device 363 through a one-way transmission device. The video encoding device 363 is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then the video network switch transmits it to the image overlay and fusion device.

[0167] The image overlay and fusion device 38 is used to receive the UI interface, receive the UI data and determine the signal source display window information and mouse position information therein, as well as receive the signal source response result, perform fusion, and output the fusion result to the corresponding screen 301. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse instructions at the corresponding position according to the mouse position information.

[0168] According to some embodiments of the present invention, as mentioned above, the screen can also be composed of multiple screens spliced ​​together. If the UI interface and signal source control device receives and analyzes the input login account and determines that the operation corresponds to the UI interface 325, as well as to one of the screens and signal source 1, then the UI interface and signal source control device sends the screen ID together with the mouse position information and the signal source display position information to the screen overlay and fusion device, so that the screen overlay and fusion device outputs the final image to the target screen.

[0169] According to some embodiments of the present invention, the control network switch 33, the video network switch 35, the one-way control devices (361, 362; 371, 372), the video encoding devices (363, 364; 373, 374), and the one-way transmission device connecting the signal source (signal source 1, signal source 2; signal source n, signal source m) and the video encoding devices (363, 364; 373, 374) can all be integrated into the multi-network security device 300. In actual use, it is only necessary to connect the signal source to the integrated multi-network security device.

[0170] According to some embodiments of the present invention, the UI interface and signal source control device 32 may include an event acquisition unit 321, a UI interface drawing and event response unit 322, a layout data distribution unit 323, a UI interface video output unit 320, and a control data processing and distribution unit 324.

[0171] The event acquisition unit 321 receives the input signal from the input generation device and sends the signal to the UI interface drawing and event response unit 322.

[0172] The UI interface drawing and event response unit 322 receives and analyzes user input sent by the event acquisition unit 321, determines control commands for controlling the UI interface and control commands for controlling the signal source, and controls the UI interface to respond and draw the UI interface according to the control commands for controlling the UI interface, and sends the control commands for controlling the signal source to the control data processing and distribution unit 324. According to some embodiments of the present invention, the UI interface drawing and event response unit 322 can also analyze and determine the initial UI interface corresponding to the input, for example when multiple UI interfaces are available for invocation.

[0173] The UI drawing process includes drawing the initial UI interface and drawing the UI interface after real-time response to the control commands. The UI interface drawing and event response unit 322 also sends the drawn UI interface to the UI interface video output unit 320, which then transmits it to the image overlay and fusion device 38 via the unidirectional video transmission device 341. The image overlay and fusion device 38 then outputs the UI interface to the screen. Figure 4 As shown, the UI interface drawing and event response unit 322 draws the initial UI interface, analyzes the user's mouse dragging action (e.g., causing the signal source display window in the UI interface to change from the solid line box a to the position of the dotted line box b shown in the figure), and draws accordingly, and sends the drawing result to the UI interface video output unit 320, which then sends the drawing result to the screen overlay and fusion device 38, which then displays the real-time UI interface on the screen.

[0174] The UI interface drawing and event response unit 322 analyzes and determines the control commands used to control the signal source. These control commands may include, for example, commands to play, pause, or turn off the signal source, or commands to input text within the window corresponding to the signal source. The control data processing and distribution unit 324 receives the control commands and sends them to the control network switch 33. The control network switch 33 then sends the data to the unidirectional control device, which controls the signal source 1 to perform the corresponding actions, as described above. In addition to receiving and distributing control commands, the control data processing and distribution unit can also encode and encrypt the data format of the control commands before distribution to facilitate further transmission and ensure information confidentiality.

[0175] The UI interface rendering and event response unit 322 also determines the signal source display window information and mouse position information in the UI interface, and sends the signal source display window information and mouse position information to the layout data distribution unit 323. The latter sends the data to the screen overlay and fusion device 38 through the one-way transmission device 34, so that the screen overlay and fusion device 38 outputs the video content of the relevant signal source to the signal source display window and performs mouse pointing at the corresponding position. When the signal source display window is zoomed in by the user, the position of the signal source display window and the mouse position change. The UI interface rendering and event response unit 322 sends the changed UI data to the layout data distribution unit 323. The latter sends the data to the screen overlay and fusion device 38 through the one-way transmission device 34. The screen overlay and fusion device 38 determines the mouse position information and signal source display window information in the UI data, and outputs the video content of the relevant signal source to the changed signal source display window and performs mouse pointing at the corresponding new position.

[0176] According to some other embodiments of the present invention, the various units of the UI interface and signal source control device 32 can also be merged or re-divided in different ways to achieve the same overall function of the UI interface and signal source control device 32. For example, some functions in the UI interface drawing and event response unit 322 can be distributed to the UI interface video output unit 320, the layout data distribution unit 323, and the control data processing and distribution unit 324.

[0177] According to some embodiments of the present invention, the image overlay and fusion device 38 may include: a UI interface video receiving unit 381, for receiving the UI interface output by the UI interface video output unit 320; a layout data receiving unit 382, ​​for receiving the UI data sent by the layout data distribution unit 323, and determining the signal source display window information and mouse position information therein; a video decoding unit 383, for receiving the signal source response result, including receiving the network stream signal corresponding to the signal source response result from the video network switch 35, and decoding it into video stream data; and a fusion unit 380, for outputting the drawn UI interface, displaying the signal source response result in the corresponding signal source display window according to the signal source display window information, and providing mouse pointers in the final output screen according to the mouse position information. The output result will be displayed on the screen 301.

[0178] According to some other embodiments of the present invention, the various units of the image overlay and fusion device 38 may also be merged with each other or re-divided in different ways to achieve the same function of the image overlay and fusion device 38.

[0179] In addition, the front is surrounded Figures 1a-2d The details of the signal source retrieval and control process described herein can be applied here, or can be applied here with appropriate modifications. For simplicity, they will not be repeated here.

[0180] Figure 3b A schematic diagram of a signal source retrieval and control system according to some embodiments of the present invention is shown.

[0181] For the sake of simplicity, with Figure 3a The same parts are indicated here by the same reference numerals.

[0182] Figure 3b The system shown further includes a security command service box 365. Control commands are sent to the security command service box 365 via the control network switch 33. (The security command service box 365 is referenced.) Figure 1cThis includes a command distribution server 3651, a serial optical transceiver transmitter 3652, a serial optical transceiver receiver 3654, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3653 within the optical fiber, and a unidirectional serial cable connecting the transmitter and the command distribution server, and a unidirectional serial cable connecting the receiver 3654. In this application, for simplicity, the optical fiber and optical fiber isolator are sometimes collectively referred to as a unidirectional optical fiber. The transmitter and receiver of the serial optical transceiver can also be called serial-to-optical or optical-to-serial devices. The command distribution server 3651 is used to convert control commands in network signal form into control commands in serial port form, and outputs these control commands along the corresponding serial optical transceiver transmitter, unidirectional optical fiber, and serial optical transceiver receiver, such as along... Figure 1c The transmission link output is shown in row 1, or along the transmission link in row 2. Two sets of transmission links are shown in the figure; the number of sets of transmission links can be configured according to the actual number of signal sources. When the network connection is fiber optic, the security command service box 365 may include a command distribution server 3651 and multiple unidirectional optical fibers. The command distribution server 3651 distributes control commands to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers. That is, it is not necessary to convert the network signal into an optical signal separately. According to some embodiments of the present invention, when the network connection is cable, the command distribution server converts control commands in network signal form into control commands in optical signal form, and distributes the control commands in optical signal form to the corresponding unidirectional optical fibers, allowing the control commands to be transmitted unidirectionally to the signal source to be controlled via the corresponding unidirectional optical fibers.

[0183] According to some embodiments of the present invention, Figure 3b The system shown further includes an instruction output box (3611, 3621). This instruction output box includes a serial port and a USB port for receiving control instructions (such as mouse, keyboard, and multi-touch commands) in serial form from the security instruction service box, parsing them, and ultimately forming an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source. According to some embodiments of the invention, this functionality can also be integrated into the security instruction service box. If the security instruction service box transmits other forms of signals, the instruction output box can also parse them and ultimately form an HID standard device protocol to achieve multi-touch, mouse, and keyboard control of the signal source.

[0184] According to some embodiments of the present invention, Figure 3bThe system shown may further include a security interface isolation box 366, which includes a video optical transceiver transmitter 3661, a video optical transceiver receiver 3662, an optical fiber connecting the video optical transceiver receiver and transmitter, an optical fiber isolator 3663 in the optical fiber, and a video cable connecting the output port of the transmitter. The security interface isolation box 366 is used to realize unidirectional transmission in the x-direction shown in the figure. Depending on the object being converted, the transmitter and receiver of the video optical transceiver may also be called electro-optical devices or optical-electrical devices, or video-to-optical devices or optical-to-video devices. Two sets of transmission links are shown in the figure; the number of transmission links can be configured according to the actual number of signal sources. Each transmission link includes a video optical transceiver transmitter, a video optical transceiver receiver, an optical fiber connecting the video optical transceiver receiver and transmitter, and an optical fiber isolator in the optical fiber.

[0185] The unidirectional command isolation box 367 includes a unidirectional serial cable connected in sequence to the signal source, a serial optical transceiver transmitter 3671, a serial optical transceiver receiver 3672, an optical fiber connecting the receiver and transmitter, an optical fiber isolator 3673 in the optical fiber, and a unidirectional serial cable connected to the receiver 3672. The unidirectional command isolation box receives control commands generated from the signal source and transmits them unidirectionally to the UI interface and the signal source control device, such as the acquisition and conversion module 3211. The acquisition and conversion module 3211 converts the control commands in serial signal form into, for example, USB control commands and sends them to the UI interface drawing and event response unit 322. The UI interface drawing and event response unit 322 analyzes the control commands. If it determines that the command is for controlling the UI interface, it controls the UI interface to respond and draw the UI interface according to the control command, as described above with reference to Figure 3. If it determines that the control command is for controlling other signal sources, it refuses to execute the command.

[0186] Figure 3b The functions and principles of the remaining components are the same as Figure 3a Similarly, for the sake of simplicity, this will not be repeated here.

[0187] In this application, the switch can also be a managed switch, providing multiple network management methods such as console-based, web-based, and Telnet-based remote login. It allows for real-time monitoring of the switch's operating status and network operation, providing a comprehensive overview of the operating status and mode of all switch ports.

[0188] In this application, an additional server (which may be called a cascaded server) may also be introduced, which is network-connected to multiple screen overlay and fusion devices to uniformly schedule the fusion results of each screen overlay and fusion device.

[0189] Figure 5 A flowchart illustrating a signal source acquisition and control method according to some embodiments of the present invention is shown. The method includes:

[0190] S1. Receive and analyze user input and auxiliary input for controlling the UI interface from the signal source in a one-way manner; determine the control command for controlling the UI interface and the control command for controlling the signal source from the user input and auxiliary input according to the pre-stored correspondence between input and control commands; control the UI interface to respond according to the control command for controlling the UI interface; draw the UI interface according to the UI interface response result; and output the drawn UI interface to the image overlay and fusion device through the one-way video transmission device.

[0191] S2. Determine the UI data corresponding to the UI response result, and output the UI data corresponding to the UI response result to the screen overlay and fusion device through the first unidirectional transmission path;

[0192] S3. According to the control command for controlling the signal source, the signal source is controlled to respond through the second unidirectional transmission path, and the signal source outputs the signal source response result to the image overlay and fusion device through the third unidirectional transmission path.

[0193] Furthermore, the method may further include: the screen overlay and fusion device receiving a UI interface, receiving the UI data and determining the signal source display window information and mouse position information therein, performing fusion, and outputting the fusion result to the corresponding screen; the fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse instructions at the corresponding position according to the mouse position information.

[0194] Figure 6 A flowchart illustrating a signal source retrieval and control method according to further embodiments of the present invention is shown. The method includes:

[0195] S11. Receive and analyze user input and auxiliary input for controlling the UI interface from the signal source in a one-way direction; determine the control command for controlling the UI interface and the control command for controlling the signal source from the user input and auxiliary input according to the pre-stored correspondence between input and control commands; control the UI interface to respond according to the control command for controlling the UI interface; draw the UI interface according to the UI interface response result; and output the drawn UI interface to the image overlay and fusion device through the one-way video transmission device.

[0196] S12. Determine the UI data corresponding to the UI response result, and output the UI data corresponding to the UI response result to the screen overlay and fusion device through the first unidirectional transmission path;

[0197] S13. The control command for controlling the signal source is sent to the one-way control device through the control network switch. The one-way control device controls the signal source according to the control command, so that the signal source responds to the control of the one-way control device, and sends the response result to the video encoding device through the one-way transmission device. The video encoding device encodes the video stream data into a network stream signal and sends the video content in the form of the network stream signal to the image overlay and fusion device through the video network switch.

[0198] Furthermore, the method may also include:

[0199] The image overlay and fusion device receives the UI interface, receives the UI data and determines the signal source display window information and mouse position information therein, and receives video content in the form of network stream signal from the signal source of the video network switch, decodes it into video stream data signal source response result, performs fusion, and outputs the fusion result to the corresponding display device. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and giving mouse pointers at the corresponding positions according to the mouse position information.

[0200] Furthermore, the signal source retrieval process or method described above with reference to the figures in the signal source retrieval and control system is also applicable here. For example, according to some embodiments of the present invention, the method may further include determining an initial UI interface corresponding to the input. For example, when multiple UI interfaces are available for retrieval, the UI interface to be operated is determined according to a pre-stored correspondence between the input and the UI interface; drawing the UI interface includes drawing the initial UI interface, and also drawing the UI interface after real-time response according to the control command. For simplicity, further details are omitted here.

[0201] This application also proposes a device for signal source acquisition and control. According to some embodiments of the invention, the device includes a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to perform the following steps:

[0202] The system receives and analyzes user input and auxiliary input for controlling the UI interface from a one-way signal source. Based on a pre-stored correspondence between input and control commands, it determines control commands for controlling the UI interface and control commands for controlling the signal source. Based on the control commands for controlling the UI interface, it controls the UI interface to respond. Based on the UI interface response results, it draws the UI interface and outputs the drawn UI interface through the one-way video transmission device (output to the image overlay and fusion device).

[0203] UI data is output through the first unidirectional transmission path (to the image overlay and fusion device);

[0204] According to the control command for controlling the signal source, the signal source is controlled to respond via the second unidirectional transmission path, and the signal source outputs the signal source response result to the image overlay and fusion device via the third unidirectional transmission path.

[0205] Furthermore, the signal source retrieval process or method involved in the signal source retrieval and control system described above with reference to the figures also applies here, that is, it is also within the protection scope of the present invention, and will not be described again here for the sake of simplicity.

[0206] Figure 7 An exemplary device for signal source retrieval and control is shown, the device including a processor 51, a memory 52 and a bus 53.

[0207] In some instances, the device may further include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, processor 51, memory 52, and output port 503 are interconnected via a bus 53. The input device 501 and output device 504 are connected to the bus 53 via input port 502 and output port 503, respectively, and thus connected to other components of the multi-signal source scheduling device. It should be noted that the output and input interfaces here can also be represented by I / O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 via the input port 502. The processor 51 processes the input information based on computer-executable instructions stored in the memory 52 to generate output information, temporarily or permanently storing the output information in the memory 52, and then transmitting the output information to the output device 504 via the output port 503. The output device 504 outputs the output information to the outside of the device.

[0208] The aforementioned memory 52 includes a large-capacity memory for data or instructions. For example, and not limitingly, memory 52 may include an HDD, floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where suitable, memory 52 may include removable or non-removable (or fixed) media. Where suitable, memory 52 may be internal or external to a device. In a particular embodiment, memory 52 is a non-volatile solid-state memory. In a particular embodiment, memory 52 includes read-only memory (ROM). Where suitable, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0209] Bus 53 includes hardware, software, or both, that couples components of a multi-source scheduling device together. For example, and not as a limitation, bus 53 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. While specific buses are described and illustrated in embodiments of the invention, the invention contemplates any suitable bus or interconnect.

[0210] The processor 51, based on the computer program stored in the memory 52, receives and analyzes user input and auxiliary input from a signal source (one-way input) for controlling the UI interface. According to a pre-stored correspondence between input and control commands, it determines the control commands for controlling the UI interface and the control commands for controlling the signal source from the user input and auxiliary input. Based on the control commands for controlling the UI interface, it controls the UI interface to respond, draws the UI interface based on the response results, and outputs the drawn UI interface to the image overlay and fusion device through the one-way video transmission device. It also outputs UI data to the image overlay and fusion device through a first one-way transmission path; controls the signal source to respond through a second one-way transmission path according to the control commands for controlling the signal source, and causes the signal source to output its response results to the image overlay and fusion device through a third one-way transmission path.

[0211] Furthermore, the signal source retrieval process or method involved in the signal source retrieval and control system described above with reference to the figures can also be included here as one of the execution steps of the processor, that is, it is also within the protection scope of the present invention. For the sake of simplicity, it will not be described again here.

[0212] According to further embodiments of the present invention, the computer program may be divided into one or more units in various ways and stored in the memory, and executed by the processor to perform the present invention. The one or more units may be a series of computer program instruction segments capable of performing a specific function, the instruction segments describing the execution process of the computer program in the device. The computer program may be based on the foregoing reference... Figure 3a The functions of each unit in the various embodiments described are used to divide the system into multiple units, or include those referenced above. Figure 3a The various units in the described embodiments are not repeated here for the sake of simplicity.

[0213] The processor referred to may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the device, connecting various parts of the device via various interfaces and lines. The device may be a desktop computer, laptop, handheld computer, cloud server, or other computing devices or a part thereof. The device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that the schematic diagrams are merely examples of the device and do not constitute a limitation on the device.

[0214] The relevant details described above with reference to Figures 1-4 are included here by reference and will not be repeated here.

[0215] This application also proposes a computer-readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, performs the following steps:

[0216] The system receives and analyzes user input and auxiliary input from a signal source (one-way input) for controlling the UI interface. Based on a pre-stored correspondence between input and control commands, it determines the control commands for controlling the UI interface and the control commands for controlling the signal source from the user input and auxiliary input. According to the control commands for controlling the UI interface, it controls the UI interface to respond, and draws the UI interface based on the response results. It then outputs the drawn UI interface to the image overlay and fusion device via the one-way video transmission device. The system also outputs UI data to the image overlay and fusion device via a first one-way transmission path; controls the signal source to respond via a second one-way transmission path according to the control commands for controlling the signal source, and causes the signal source to output its response results to the image overlay and fusion device via a third one-way transmission path.

[0217] The computer program includes computer program code, which may be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0218] Through the above embodiments of the present invention, users can enjoy an experience and efficiency similar to operating a local computer when retrieving and controlling signal sources, while ensuring the security of the interaction process. Simultaneously, the signal source itself can participate in the interaction through a secure mechanism, rather than being completely passively interacted with. Furthermore, by directly outputting the UI interface rendering results to the screen overlay and fusion device, on the one hand, the UI interface can be quickly displayed on the screen, avoiding re-analysis and rendering that would cause screen lag; on the other hand, it further ensures the security of information transmission and the interaction process, preventing others from obtaining useful information by intercepting information from one path.

Claims

1. A signal source acquisition and control system, including: UI interface and signal source control device, first unidirectional transmission device, unidirectional video transmission device, image overlay and fusion device, second unidirectional transmission device, third unidirectional transmission device and fourth unidirectional transmission device; The fourth unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device. The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input, and determine the control commands for controlling the UI interface and the control commands for controlling the signal source in the user input and the auxiliary input according to the pre-stored correspondence between input and control commands. It also controls the UI interface to respond according to the control commands for controlling the UI interface, draws the interface according to the UI interface response result, and outputs the drawn UI interface to the image overlay and fusion device through the unidirectional video transmission device. The UI interface described is not a virtual UI interface; The UI interface and signal source control device is also used to output only the mouse position information and signal source display window information in the UI data corresponding to the UI interface response result to the screen overlay and fusion device through the first one-way transmission device, and to control the signal source through the second one-way transmission device so that it responds according to the control command for controlling the signal source and transmits the signal source response result to the screen overlay and fusion device through the third one-way transmission device. The image overlay and fusion device receives the UI interface, receives the signal source display window information and mouse position information in the UI data corresponding to the UI interface response result, receives the signal source response result, performs fusion, and outputs the fusion result to the display device. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and providing mouse pointers at the corresponding positions based on the mouse position information; The UI interface and signal source control device pre-store multiple UI interfaces, as well as the correspondence between login information and UI interfaces, so that the corresponding UI interface can be determined according to the login information. The UI interface and signal source control device outputs the image of the UI interface corresponding to the login information to the image overlay and fusion device through a one-way video transmission device, and the image overlay and fusion device outputs the UI interface to the display device. The system also includes an input generation device for generating the user input; The input generating device is spatially superimposed on the screen of the display device. The input generating device is a transparent touch device. Visual touch is achieved on the input generating device by referring to the image of the screen below the transparent touch device.

2. The signal source retrieval and control system according to claim 1, wherein the second unidirectional transmission device includes a safety interface isolation box, which includes one or more sets of second transmission links. The second transmission links consist of a first video line, a video-to-optical device, a second unidirectional optical fiber, an optical-to-video device, and a video line. Each set of second transmission links is used to enable the signal source response result to be unidirectionally transmitted to the image overlay and fusion device.

3. The signal source acquisition and control system according to claim 1, wherein, The second unidirectional transmission device includes a security command service box, which is used to receive the control command and transmit the control command unidirectionally to the signal source to be controlled, so that the signal source responds according to the control command.

4. A signal source acquisition and control system, including: UI interface and signal source control device, one-way video transmission device, first one-way transmission device, image overlay and fusion device, one-way control device, second one-way transmission device, and third one-way transmission device; The third unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device. The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input. Based on a pre-stored correspondence between input and control commands, it determines the control commands for controlling the UI interface and the control commands for controlling the signal source from the user input and the auxiliary input. Based on the control commands for controlling the UI interface, it controls the UI interface to respond, draws the UI interface based on the response result, and outputs the drawn UI interface through the unidirectional video transmission device. The UI interface and signal source control device is also used to determine the UI data corresponding to the UI response result, and only outputs the mouse position information and signal source display window information from the UI data corresponding to the UI response result to the image overlay and fusion device through the first unidirectional transmission device. The UI interface described is not a virtual UI interface; The UI interface and signal source control device are also used to send the control command for controlling the signal source to the one-way control device, so that the one-way control device controls the signal source, so that it responds according to the control command for controlling the signal source and transmits the signal source response result to the screen overlay and fusion device through the second one-way transmission device. The image overlay and fusion device receives the UI interface, receives the signal source display window information and mouse position information in the UI data corresponding to the UI interface response result, receives the signal source response result, performs fusion, and outputs the fusion result to the display device. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and providing mouse pointers at the corresponding positions based on the mouse position information; The UI interface and signal source control device pre-store multiple UI interfaces, as well as the correspondence between login information and UI interfaces, so that the corresponding UI interface can be determined according to the login information. The UI interface and signal source control device outputs the image of the UI interface corresponding to the login information to the image overlay and fusion device through a one-way video transmission device, and the image overlay and fusion device outputs the UI interface to the display device. The system also includes an input generation device for generating the user input; The input generating device is spatially superimposed on the screen of the display device. The input generating device is a transparent touch device. Visual touch is achieved on the input generating device by referring to the image of the screen below the transparent touch device.

5. The signal source acquisition and control system according to claim 4, wherein, The second unidirectional transmission device includes a security command service box, which is used to receive the control command and transmit the control command unidirectionally to the signal source to be controlled, so that the signal source responds according to the control command.

6. The signal source retrieval and control system according to claim 4, wherein the second unidirectional transmission device includes a safety interface isolation box, which includes one or more sets of second transmission links. The second transmission links consist of a first video line, a video-to-optical device, a second unidirectional optical fiber, an optical-to-video device, and a video line. Each set of second transmission links is used to enable the signal source response result to be unidirectionally transmitted to the image overlay and fusion device.

7. A signal source acquisition and control system, including: UI interface and signal source control device, one-way video transmission device, first one-way transmission device, image overlay and fusion device, one-way control equipment, control network switch, video network switch, video encoding equipment, second one-way transmission device and third one-way transmission device; The third unidirectional transmission device is used to transmit the auxiliary input generated by the signal source for controlling the UI interface to the UI interface and the signal source control device. The UI interface and signal source control device is used to receive and analyze user input and the auxiliary input, and determine the control command for controlling the UI interface and the control command for controlling the signal source according to the pre-stored correspondence between input and control commands. It also controls the UI interface to respond according to the control command for controlling the UI interface, draws the interface according to the UI interface response result, and outputs the drawn UI interface to the image overlay and fusion device through the unidirectional video transmission device. The UI interface described is not a virtual UI interface; The UI interface and signal source control device is also used to determine the UI data corresponding to the UI response result, and only output the mouse position information and signal source display window information in the UI data corresponding to the UI response result to the screen overlay and fusion device through the first unidirectional transmission device. The UI interface and signal source control device will also send the control commands for controlling the signal source to the control network switch, which will then send them to the one-way control device. The one-way control device will control the signal source to respond according to the control commands for controlling the signal source and output the response results to the video encoding device through the second one-way transmission device. The video encoding device is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then the video network switch transmits it to the image overlay and fusion device. The image overlay and fusion device receives the UI interface, receives the signal source display window information and mouse position information in the UI data corresponding to the UI interface response result, receives the network stream signal, decodes the network stream signal into video stream data, uses the video stream data as the signal source response result, performs fusion, and outputs the fusion result to the display device. The fusion includes displaying the signal source response result in the signal source display window on the UI interface, and providing mouse pointers at the corresponding positions based on the mouse position information; The UI interface and signal source control device pre-store multiple UI interfaces, as well as the correspondence between login information and UI interfaces, so that the corresponding UI interface can be determined according to the login information. The UI interface and signal source control device outputs the image of the UI interface corresponding to the login information to the image overlay and fusion device through a one-way video transmission device, and the image overlay and fusion device outputs the UI interface to the display device. The system also includes an input generation device for generating the user input; The input generating device is spatially superimposed on the screen of the display device. The input generating device is a transparent touch device. Visual touch is achieved on the input generating device by referring to the image of the screen below the transparent touch device.

8. The signal source acquisition and control system according to claim 7, wherein, The one-way control device includes: a safety command service box, which is used to receive the control command and transmit the control command unidirectionally to the signal source to be controlled, so that the signal source responds according to the control command.

9. The signal source acquisition and control system according to claim 8, wherein, The security instruction service box includes an instruction distribution server and one or more first transmission links; The first transmission link consists of a first serial-to-optical device, a first unidirectional optical fiber, a first optical-to-serial device, and a first unidirectional serial port line connected sequentially to the command distribution server. The number of groups of the first transmission link is the same as the number of signal sources. The command distribution server is used to convert control commands in the form of network signals into control commands in the form of serial port signals, and distribute the control commands in the form of serial port signals to the corresponding first transmission link, so that the control commands are transmitted to the signal source to be controlled through the corresponding first transmission link.

10. The signal source retrieval and control system according to claim 7, wherein the second unidirectional transmission device includes a security interface isolation box, which includes one or more sets of second transmission links, the second transmission links being composed of a first video line, a video-to-optical device, a second unidirectional optical fiber, an optical-to-video device, and a video line, each set of second transmission links being used to enable the signal source response result to be unidirectionally transmitted to the video encoding device.

11. The signal source acquisition and control system according to claim 3, 5 or 8, wherein, The security command service box includes a command distribution server and multiple third unidirectional optical fibers. The command distribution server is used to distribute control commands to the corresponding third unidirectional optical fibers, so that the control commands are transmitted unidirectionally to the signal source to be controlled through the corresponding third unidirectional optical fibers.

12. The signal source retrieval and control system according to claim 2 or 6, wherein the safety interface isolation box includes multiple fourth unidirectional optical fibers, each fourth unidirectional optical fiber being used to receive the corresponding signal source response result and to transmit the response result unidirectionally to the splicing controller through the corresponding fourth unidirectional optical fiber.

13. The signal source retrieval and control system according to claim 3, 5, or 8, wherein, The security command service box includes a command distribution server and multiple fifth unidirectional optical fibers. The command distribution server is used to convert control commands in the form of network signals into control commands in the form of optical signals, and distribute the control commands in the form of optical signals to the corresponding fifth unidirectional optical fibers, so that the control commands are transmitted unidirectionally to the signal source to be controlled through the corresponding fifth unidirectional optical fibers.

14. The signal source retrieval and control system according to claim 2, 6, or 10, wherein, The device also includes one or more instruction output boxes; The instruction output box includes a serial port and a USB port. The instruction output box is used to convert control commands into HID standard device protocols and output the control commands to the corresponding signal source through the USB port. The number of instruction output boxes is the same as the number of signal sources.

15. The signal source acquisition and control system according to claim 1, 4, or 7, wherein, The signal sources are located in different network-isolated subnets; Each subnet is isolated from the others; the signal sources include: network cameras, network sensing devices, network intelligent display and / or control devices, network computing devices, mobile devices or combinations thereof.

16. The signal source retrieval and control system according to claim 1, 4, or 7, wherein, The signal source includes a GIS map device, and the control commands include retrieving hotspot cameras on the map and displaying the content captured by the hotspot cameras on a display device.

17. The signal source retrieval and control system according to claim 1, 4 or 7 further includes a cascaded server, which is network-connected to multiple image overlay and fusion devices to uniformly schedule the fusion results of each image overlay and fusion device.

Images