Method and system for cross-network secure push
Through cross-network security push methods and systems, the problem of interactive interface drawing and response in cross-network interactive terminals is solved, and the complete display of the interactive interface and an efficient and secure interaction process are realized.
Patent Information
- Application Number
- CN202310147673.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-20
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2043-02-20
Smart Images

Figure CN116996562B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method and system for cross-network push, and in particular to a method and system for cross-network secure push. Background Art
[0002] In the prior art, such as Figure 1a As shown, the interactive terminal 1000 is connected to the one-way transmission device 1200 and the signal source 1100, as well as the one-way transmission device 2200 and the signal source 2100 through the switch 1010. The one-way transmission devices 1200 and 2200 can transmit the instructions of the interactive terminal 1000 to the signal sources 1100 and 2100 in one direction. The interactive terminal 1000 and the interactive terminal 2000 are in two network environments and cannot be directly connected through the network.
[0003] The interactive terminal 1000 can output the interactive interface it generates (such as windows A and B in the figure) to the interactive terminal 2000 in the form of an image through a video line. At the same time, the response result interface of the signal sources 1100 and 2100 is also output to the interactive terminal 2000 through the switch 2020. The interactive terminal 2000 directly superimposes the response result interface of the signal sources 1100 and 2100 above the window A position and the window B position in the interactive interface, thereby realizing display on the interactive interface.
[0004] The above approach can only achieve a simple overlay of the response result interface of signal sources 1100 and 2100 and the interactive interface. However, some problems arise when plotting the interactive interface. For example, when a plot is added to the interactive interface, the added interactive interface will be transmitted to interactive terminal 2000 as an image. If the plot is located within windows A and B, the plots in windows A and B will eventually be overwritten by the signal sources 1100 and 2100 to be displayed on windows A and B. Only the plots outside windows A and B will remain unobstructed and continue to be displayed. Summary of the Invention
[0005] In view of the above problems, the first aspect of the present invention proposes a cross-network secure push method, which includes:
[0006] Receiving and analyzing user input, determining a control command for controlling the interactive interface, a control command for implementing the push, and a control command for controlling the signal source, controlling the interactive interface to respond according to the control command for controlling the interactive interface, drawing the interactive interface according to the interactive interface response result, and outputting the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device;
[0007] Outputting the control command for implementing the push, the mouse position information, and the signal source display window information to the image superposition and fusion device via a first unidirectional transmission path;
[0008] According to the control command for controlling the signal source, the signal source is controlled to respond through the second unidirectional transmission path, and the signal source outputs the signal source response result to the image superposition and fusion device through the third unidirectional transmission path;
[0009] The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information used to implement the push.
[0010] A second aspect of the present invention provides a cross-network secure push system, comprising:
[0011] Interactive interface and signal source control device, first one-way transmission device, one-way video transmission device, picture superposition and fusion device, second one-way transmission device and third one-way transmission device.
[0012] The interactive interface and signal source control device is used to receive and analyze user input, determine a control command for controlling the interactive interface, a control command for implementing the push, and a control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device;
[0013] The interactive interface and signal source control device is further configured to output the control command for implementing the push, the mouse position information, and the signal source display window information to the image superposition and fusion device via the first unidirectional transmission device, and to control the signal source via the second unidirectional transmission device so that the signal source responds according to the control command for controlling the signal source and transmits the signal source response result to the image superposition and fusion device via the third unidirectional transmission device;
[0014] The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information used to implement the push.
[0015] A third aspect of the present invention provides a cross-network secure push system, comprising:
[0016] Interactive interface and signal source control device, one-way video transmission device, first one-way transmission device, picture superposition and fusion device, one-way control equipment and second one-way transmission device;
[0017] The interactive interface and signal source control device is used to receive and analyze user input, determine a control command for controlling the interactive interface, a control command for implementing the push, and a control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device;
[0018] The interactive interface and signal source control device is further configured to determine a control command, mouse position information, and signal source display window information for implementing the push, and output the control command, mouse position information, and signal source display window information for implementing the push to the image superposition and fusion device via a first unidirectional transmission device;
[0019] The interactive interface and signal source control device are further configured to send the control command for controlling the signal source to the one-way control device, and the one-way control device controls the signal source to respond according to the control command for controlling the signal source and transmit the signal source response result to the image superposition and fusion device via the second one-way transmission device;
[0020] The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information used to implement the push.
[0021] A fourth aspect of the present invention provides a cross-network secure push system, comprising:
[0022] Interactive interface and signal source control device, one-way video transmission device, first one-way transmission device, picture superposition and fusion device, one-way control device, control network switch, video network switch, video encoding device and second one-way transmission device;
[0023] The interactive interface and signal source control device is used to receive and analyze user input, determine a control command for controlling the interactive interface, a control command for implementing the push, and a control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device;
[0024] The interactive interface and signal source control device is further configured to determine a control command, mouse position information, and signal source display window information for implementing the push, and output the information to the image superposition and fusion device via a first unidirectional transmission device;
[0025] The interactive interface and signal source control device further transmits a control command for controlling the signal source to the control network switch, which then transmits the control command to the unidirectional control device. The unidirectional control device controls the signal source to respond according to the control command for controlling the signal source and outputs the response result to the video encoding device via the second unidirectional transmission device.
[0026] The video encoding device is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then transmit it to the picture superposition and fusion device by the video network switch;
[0027] The picture overlay and fusion device decodes the network stream signal into video stream data, and uses this video stream data as the signal source response result. The picture overlay and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information used to implement the push.
[0028] Through the above-mentioned embodiments of the present invention, an interactive terminal can implement various push operations on another cross-network interactive terminal, thereby improving the interaction efficiency. At the same time, it also ensures the security of the interaction process and avoids the flow of high-level information caused by the interaction process to low-level interactive devices, such as avoiding the content of a high-level signal source from flowing to the interactive interface and signal source control device or flowing to the low-level interactive terminal where the input generating device is located. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1a A schematic diagram of a cross-network interaction system according to the prior art is shown;
[0030] Figure 1b A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown;
[0031] Figure 2a A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown;
[0032] Figure 2b A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown;
[0033] Figure 2c A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown;
[0034] Figure 3 A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown;
[0035] Figure 4 shows changes in the signal source display window during cross-network secure push according to some embodiments of the present invention;
[0036] Figure 5 Schematically illustrating a flow chart of a cross-network secure push method according to some embodiments of the present invention;
[0037] Figure 6 Schematically illustrating a flow chart of a cross-network secure push method according to some embodiments of the present invention;
[0038] Figure 7 The following is a schematic diagram schematically illustrating a device for cross-network secure push according to some embodiments of the present invention. DETAILED DESCRIPTION
[0039] In this application, any reference to a network connection essentially encompasses any wired or wireless network connection implemented through necessary firmware or software, such as a switch or router, as well as any wired or wireless network connection implemented through a server or other computer as an intermediary. To simplify the description and highlight the key points of the invention, this application sometimes omits the description of routers / switches when describing network connections. In this application, the networks involved may include Wi-Fi networks, Bluetooth networks, private area networks (PANs), local area networks (LANs), wide area networks (WANs), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), cdmaOne, CDMA2000, Evolution-Data Optimized (EV-DO), Enhanced Data Rates for GSM Evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), Digital AMPS (IS-136 / TDMA), Integrated Digital Enhanced Network (iDEN), WiMAX, LTE, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, or virtual private such as a VPN.
[0040] The present invention will be exemplarily described below with reference to the accompanying drawings and in conjunction with embodiments. It should be noted that the embodiments and features in the embodiments of this application can be combined with each other without conflict. In addition, the embodiments described are only some embodiments of the present invention, not all embodiments.
[0041] In this application, the use of optical fiber, serial port and other connections is involved. In order to match these connections, a matching conversion module may be required. For example, when converting the signal from the network to the optical fiber, a network-to-optical module is required. However, when the computer network port itself is an optical port, the additional network-to-optical module can be omitted. Since the necessity of such a module can be determined based on the actual application scenario and is well known to those skilled in the art, it is not explained one by one for the sake of simplicity, but it does not mean that the necessary conversion module is omitted.
[0042] The interactive interface, signal source control device, and image overlay and fusion device mentioned below can be computing devices such as desktop computers, notebooks, PDAs, and cloud servers, or parts thereof.
[0043] In the present application, cross-network push includes cross-network push mapping; the control command for implementing the push includes a cross-network mapping command; and a push response is performed based on the control command for implementing the push and the mouse position information, including performing mapping based on the mouse position. The cross-network push also includes cross-network push pop-up window; the control command for implementing the push includes a cross-network pop-up window command; and a push response is performed based on the control command for implementing the push and the mouse position information, including performing a pop-up window at the mouse position. The cross-network push also includes a cross-network identification action; the control command for implementing the push includes a cross-network identification command; and a push response is performed based on the control command for implementing the push and the mouse position information, including identifying the mouse selected area.
[0044] Figure 1b A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown.
[0045] The cross-network secure push system includes an interactive interface and signal source control device 102, related devices on the first unidirectional transmission path 104, a unidirectional video transmission device 1041, a picture overlay and fusion device 108, related devices on the second unidirectional transmission path 1061 and related devices on the third unidirectional transmission path 1063.
[0046] In the present application, the first, second and third unidirectional transmission paths may include various devices that can achieve unidirectional transmission or unidirectional control purposes. The device for achieving unidirectional transmission or unidirectional control purposes may be a unidirectional transmission device such as a unidirectional control device or a unidirectional transmission cable, or a whole composed of a control device and a transmission cable. When achieving unidirectional transmission or unidirectional control as a whole, the present application does not limit the individual control devices or connecting cables in the whole to unidirectional operation. For example, some devices or connecting cables between devices may have bidirectional or multidirectional paths, but the unidirectional transmission device as a whole can still achieve unidirectional transmission or unidirectional control; for another example, the path may involve a network connection (components), but when the network connection is combined with other devices, the combined whole can achieve the unidirectional purpose, as will be described below. Such situations are also within the expected scope and scope of protection required by the present invention.
[0047] The interactive interface and signal source control device can pre-store multiple interactive interfaces, as well as the correspondence between each interactive interface and input. For example, the correspondence between each interactive interface and each login information is stored so that the corresponding interactive interface can be determined based on the login information: when the user logs in with different accounts, the interactive interface and signal source control device receives and analyzes the user's input (account), and calls the interactive interface with the corresponding ID based on the input (account). In addition, in the case where the screen 100 is composed of multiple screens spliced together, the interactive interface and signal source control device can also store the correspondence between the interactive interface and the screen, or the correspondence between the login information and the screen, so that after determining the interactive interface, the corresponding screen can be determined, or the corresponding screen can be determined based on the login information. In addition, different permissions can be set for different accounts, so that when certain accounts log in, only a specific interactive interface can be used.
[0048] According to some embodiments of the present invention, the content of the interactive interface may include interactive labels such as save, plot, delete, screen recording, undo, and clear, display window distribution, mouse, etc. Different interactive interfaces may have different labels, frame line distribution, etc. The plotting refers to actions such as drawing lines, adding geometric structure diagrams, flow charts, as well as annotations, adding text, and coloring; UI data is data that describes the various components of an interactive interface and the location of each component, such as interactive labels such as save, plot, delete, screen recording, undo, and clear, display window, mouse, etc.
[0049] The interactive interface and signal source control device 102 can receive and analyze user input, determine the interactive interface to be called, the control command for controlling the interactive interface 1025, the control command for implementing the push and the control command for controlling the signal source (assuming that the controlled signal source is signal source 1), and control the interactive interface to respond according to the control command for controlling the interactive interface 1025, draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture overlay and fusion device 108 through the one-way video transmission device 1041.
[0050] According to some embodiments of the present invention, when there is only one interactive interface, the interactive interface and signal source control device 102 will not need to separately determine the interactive interface to be called, and in response to the input (for example, once input related to cross-network security push is detected), the screen corresponding to the interactive interface is output to the screen overlay and fusion device 108 through the one-way video transmission device 1041, and the screen overlay and fusion device 108 outputs the interactive interface to the screen 100. By outputting the interactive interface to be operated to the screen 100, the user can refer to the displayed content on the screen to perform input operations in subsequent interactive actions, for example, moving the local mouse, tapping the local keyboard, entering shortcut keys, etc., in order to change the interactive interface or control the signal source, and ultimately causing the display interface of the signal source on the screen to change accordingly or the output content of the signal source to change.
[0051] According to some embodiments of the present invention, the control commands for controlling the interactive interface may include, for example, clicking a drop-down menu in the square where the signal source 1 is located in the figure, moving, enlarging or reducing the display window position of the signal source 1, and the like.
[0052] According to some embodiments of the present invention, the control command for controlling the signal source may include, for example, a control command for playing, pausing, or shutting down the signal source.
[0053] The interactive interface and signal source control device 102 is further configured to output initial mouse position information and signal source display window information, subsequent mouse position information and signal source display window information, and control commands for implementing the plotting to the image superposition and fusion device 108 via the first unidirectional transmission path 104. The interactive interface and signal source control device 102 can determine changes in the interactive interface and corresponding mouse position information and signal source display window information in real time through the interactive interface and the control commands used to control the interactive interface. The mouse position information includes pointer position data.
[0054] The interactive interface and signal source control device 102 also controls the signal source 1 to respond through the second unidirectional transmission path 1061 according to the control command for controlling the signal source, and enables the signal source 1 to output the response result to the picture superposition and fusion device 108 through the third unidirectional transmission path 1063.
[0055] The image overlay fusion device 108 displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information used to implement the push. The push response result can be output to the screen 100. When the user operates on the interactive interface and the signal source control device 102, he can directly visually view the content on the screen 100, thereby realizing various operations similar to those of a local computer. Although the content on the screen 100 is actually formed by a series of processing by the image overlay fusion device 108, the processing includes displaying the interactive interface, outputting the display signal source at the signal source window position on the interactive interface, outputting the mouse pattern at the mouse position on the interactive interface, and implementing plotting on the visual top layer according to the control command and mouse position information for plotting, the aforementioned series of image displays can also be called image fusion.
[0056] In the above embodiment of the present invention, the user input may correspond to a control command for controlling the interactive interface at a certain moment, may correspond to a control command for implementing the push at the next moment, may correspond to a control command for controlling the signal source at the next moment, or may not involve one or both of the above situations. When the user refers to the screen to operate the interactive interface, the user input corresponds to the control command for controlling the interactive interface; when the user refers to the screen 100 and clicks the drawing button and then selects a brush to draw, the user input corresponds to the control command for implementing the drawing; when the user clicks the control in the signal source interface, the user input corresponds to the control command for controlling the signal source. The cross-network push may also include a cross-network push pop-up window; the control command for implementing the push includes a cross-network pop-up window command; and a push response is performed based on the control command for implementing the push and the mouse position information, including implementing a pop-up window at the mouse position; and the cross-network push may also include a cross-network recognition action; the control command for implementing the push includes a cross-network recognition command; and a push response is performed based on the control command for implementing the push and the mouse position information, including recognizing the mouse selected area.
[0057] In an embodiment of the present invention, the mouse position information is sent to the screen overlay and fusion device. On the one hand, it can be used to display the mouse at the corresponding position, thereby knowing the position of the user's operation and improving operational efficiency. On the other hand, the mouse position can be used as an auxiliary parameter of the control command to complete the implementation of the control command, for example, to implement plotting along the mouse position trajectory. Therefore, the push response based on the control command and mouse position information used to implement the push can include the case of completing the control command based on the mouse position, and also includes the case of only using the mouse position information as the basis for displaying the mouse position when completing the control command.
[0058] According to some embodiments of the present invention, the cross-network secure push system may further include an input generating device 101. Figure 1b The input generating device 101 may be, for example, a keyboard, mouse, or other input device. In some embodiments, the input from the input generating device may trigger the interactive interface and signal source control device 102 to output the desired interactive interface to the image overlay and fusion device 108 via a one-way video transmission device. According to some embodiments of the present invention, control commands for controlling the signal source, control commands for controlling the interactive interface, and control commands for implementing the plotting may be input through the input generating device.
[0059] The input generating device may also be, for example, an infrared frame touch input device, or a capacitive touch device. In addition, the input generating device may also be an input generating device that captures touch or other control actions in various ways such as electric induction, magnetic induction, thermal induction, light induction, etc. In addition, control instructions may also be generated through a network. According to some embodiments of the present invention, the input generating device may be spatially superimposed on the screen 100. As will be described below, the screen 100 may provide a picture of the control object. When the input generating device is a transparent touch device, by superimposing the touch device on the screen, visual touch may be achieved on the input generating device by referring to the picture of the screen below the transparent touch device. The screen 100 and the input generating device are connected in the entire device as follows. Figure 1b shown.
[0060] The input generating device may also be, for example, an infrared light curtain touch screen based on screen 100, wherein an infrared light curtain is disposed on the screen surface. The infrared light curtain can be formed on the screen surface by an infrared laser or laser array above the screen. When a user acts on the screen 100 disposed with the infrared light curtain using a finger, the user's touch input on the screen is captured by an infrared camera. For example, when a touch is performed on the screen, the light distribution of the infrared light curtain at the touch point X will change due to the touch behavior. For example, part of the infrared light at the touch point is diffusely reflected off the screen by the touching finger and then captured by the infrared camera located in front of the screen; or part of the infrared light at the touch point is transmitted through the screen by the touching finger (for example, when the screen is a semi-transmissive DLP screen) and then captured by the infrared camera located behind the screen. The touch can be identified by identifying the position of the infrared touch point in the captured result.
[0061] According to some embodiments of the present invention, the interactive interface and signal source control device 102 may further save the interactive interface response result for updating the pre-stored interactive interface as the interactive interface to be retrieved next time.
[0062] According to some embodiments of the present invention, the interactive interface and signal source control device 102 outputs the control command for implementing the push, the mouse position information, and the signal source display window information to the screen overlay and fusion device 108 via the first unidirectional transmission path 104 in the following manner:
[0063] The control command for implementing the push, the mouse position information and the signal source display window information are output to the image superposition and fusion device 108 via one of the following first unidirectional transmission devices a)-b):
[0064] a) unidirectional optical fiber;
[0065] b) One-way serial line;
[0066] At this time, the first unidirectional transmission path includes a unidirectional optical fiber, or includes a unidirectional connector such as a unidirectional video cable. The unidirectional optical fiber includes an optical fiber and an optical fiber isolator. In addition, in the present application, in order to simplify the description, the unidirectional optical fiber is intended to cover accessories such as an optical terminal (which converts an optical signal into an electrical signal or converts an electrical signal into an optical signal) that may need to be used in conjunction with it. Since whether such a supporting use is used belongs to common knowledge in the field, it is not described one by one when it is obvious from the context. In addition, other devices for achieving unidirectional transmission are also within the scope of the present invention. Accordingly, the cross-network security push system according to some embodiments of the present invention may further include the first unidirectional transmission device. The following situations are similar to this and will not be repeated.
[0067] According to some embodiments of the present invention, the control command for implementing the push, the mouse position information, and the signal source display window information may be output to the image overlay and fusion device 108 in the following manner:
[0068] The control command for implementing the push, the mouse position information and the signal source display window information are sequentially transmitted to the image superposition and fusion device through the first network, the network-to-optical device and the unidirectional optical fiber.
[0069] According to some embodiments of the present invention, the control command for implementing the push, the mouse position information, and the signal source display window information may be output to the image overlay and fusion device in the following manner:
[0070] The control command for implementing the push, the mouse position information and the signal source display window information are sequentially output to the image superposition and fusion device through the first network, the first unidirectional transmission device of one of the following c)-d) and the second network:
[0071] c) unidirectional optical fiber;
[0072] d) A combination of network-to-optical equipment, unidirectional optical fiber and optical-to-network equipment.
[0073] According to some embodiments of the present invention, the control command for implementing the push, the mouse position information, and the signal source display window information may be output to the image overlay and fusion device in the following manner:
[0074] The control command for implementing the push, the mouse position information and the signal source display window information are sequentially output to the image superposition and fusion device through the first unidirectional transmission device and the second network of one of the following e)-f):
[0075] e) unidirectional optical fiber;
[0076] f) Combination of unidirectional optical fiber and optical switching network equipment.
[0077] In this application, the first network and the second network are concepts used only to distinguish and describe the two networks and have no other specific meanings; in some drawings and descriptions, the network where the control network switch or the video network switch is located can be used to refer to the first network and the second network.
[0078] According to some embodiments of the present invention, controlling the signal source to respond via the second unidirectional transmission path according to the control command for controlling the signal source includes:
[0079] The second one-way transmission device controls the signal source to respond by one of the following a)-d):
[0080] a) unidirectional optical fiber;
[0081] b) One-way serial line;
[0082] c) Combination of unidirectional serial cables, serial-to-optical converters, and unidirectional optical fibers;
[0083] d) Combination of unidirectional optical fiber, optical-to-serial converter and unidirectional serial cable;
[0084] According to some embodiments of the present invention, controlling the signal source to respond via the second unidirectional transmission path according to the control command for controlling the signal source includes:
[0085] The signal source is controlled to respond sequentially through the first network and the second one-way transmission device of one of the following e)-h):
[0086] e) Combination of network-to-serial equipment and one-way serial cables;
[0087] f) Combination of network-to-optical equipment and unidirectional optical fiber;
[0088] g) Combination of network-to-serial equipment, unidirectional serial cables, serial-to-optical equipment, and unidirectional optical fibers;
[0089] h) Combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment, and unidirectional serial cables;
[0090] According to some embodiments of the present invention, controlling the signal source to respond via the second unidirectional transmission path according to the control command for controlling the signal source includes:
[0091] The signal source is controlled to respond sequentially through the first network, the second unidirectional transmission device of one of the following i)-m) and the third network where the signal source is located:
[0092] i) unidirectional optical fiber;
[0093] j) Combination of network-to-serial equipment, one-way serial cables, and serial-to-network equipment;
[0094] k) Combination of network-to-optical equipment, unidirectional optical fiber, and optical-to-network equipment;
[0095] l) Combination of network-to-serial equipment, unidirectional serial cables, serial-to-optical equipment, unidirectional optical fibers, and optical-to-network equipment;
[0096] m) Combinations of network-to-optical devices, unidirectional optical fibers, optical-to-serial devices, unidirectional serial cables, and serial-to-network devices;
[0097] According to some embodiments of the present invention, controlling the signal source to respond via the second unidirectional transmission path according to the control command for controlling the signal source includes:
[0098] The second unidirectional transmission device of one of the following n)-r) and the third network control signal source where the signal source is located respond in sequence:
[0099] n) unidirectional optical fiber;
[0100] o) Combination of unidirectional optical fiber, optical-to-serial converter, unidirectional serial cable and serial-to-network converter;
[0101] p) Combination of unidirectional optical fiber and optical switching network equipment;
[0102] q) Combination of one-way serial cable and serial-to-network equipment;
[0103] r) Combination of unidirectional serial cables, serial-to-optical devices, unidirectional optical fibers, and optical-to-network devices;
[0104] According to some embodiments of the present invention, controlling the signal source to respond via the second unidirectional transmission path according to the control command for controlling the signal source includes:
[0105] The signal source is controlled by a one-way control device to respond.
[0106] According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path includes implementing the following:
[0107] The control command for controlling the signal source is transmitted to the control device via a second unidirectional transmission device in one of the following a)-d), and the control device controls the signal source to respond:
[0108] a) unidirectional optical fiber;
[0109] b) One-way serial line;
[0110] c) Combination of unidirectional serial cables, serial-to-optical converters, and unidirectional optical fibers;
[0111] d) Combination of unidirectional optical fiber, optical-to-serial converter and unidirectional serial cable;
[0112] According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path includes implementing the following:
[0113] The control command for controlling the signal source is transmitted to the control device via the first network and the second unidirectional transmission device of one of the following e)-h) in sequence, and the control device controls the signal source to respond:
[0114] e) Combination of network-to-serial equipment and one-way serial cables;
[0115] f) Combination of network-to-optical equipment and unidirectional optical fiber;
[0116] g) Combination of network-to-serial equipment, unidirectional serial cables, serial-to-optical equipment, and unidirectional optical fibers;
[0117] h) Combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment and unidirectional serial cable.
[0118] According to some embodiments of the present invention, controlling the signal source to respond through the second unidirectional transmission path includes implementing the following:
[0119] The control command for controlling the signal source is transmitted to the control device via the first network, and the control device controls the signal source to respond via the second unidirectional transmission device of one of the following i) to 1):
[0120] i) unidirectional optical fiber;
[0121] j) One-way serial line;
[0122] k) Combination of unidirectional serial cables, serial-to-optical converters, and unidirectional optical fibers;
[0123] l) Combination of unidirectional optical fiber, optical-to-serial converter and unidirectional serial cable.
[0124] According to some embodiments of the present invention, the signal source response result is output to the image superposition and fusion device via the third unidirectional transmission path in the following manner:
[0125] 1) The signal source transmits the signal source response result to the image superposition and fusion device through one of the following third unidirectional transmission devices a)-b):
[0126] a) unidirectional optical fiber;
[0127] b) One-way video line;
[0128] According to some embodiments of the present invention, the signal source response result is output to the image superposition and fusion device via the third unidirectional transmission path in the following manner:
[0129] The signal source transmits the signal source response result to the video encoding device via a third unidirectional transmission device selected from one of the following c) to d) below. The video encoding device encodes the signal source response result into a network stream signal, and transmits the network stream signal to the image superposition and fusion device via a second network. The image superposition and fusion device decodes the network stream signal into video stream data, uses the video stream data as the signal source response result for the fusion, and outputs the fusion result to the corresponding screen 100.
[0130] c) unidirectional optical fiber;
[0131] d) One-way video cable.
[0132] According to some embodiments of the present invention, the first network is network isolated from the second network; the second network is network isolated from the third network; and the first network is network isolated from the third network.
[0133] In the above description, the various transmission and control methods implemented via the first path, the various transmission and control methods implemented via the second path, and the various transmission and control methods implemented via the third path can be combined without conflict to achieve the purpose of the present invention. Regarding the unidirectional control device, further description is provided below.
[0134] Figure 2a Schematic diagram of a cross-network secure push system according to some further embodiments of the present invention is shown. Figure 1b The difference is the dotted line part in the figure, and the part outside the dotted line is the same as Figure 1b Similar, so continue to use Figure 1b 's reference numerals.
[0135] exist Figure 2a In the embodiment, the interactive interface and signal source control device 102 sends the control command for controlling the signal source to the one-way control device 161 through the control network switch 13. The one-way control device 161 receives the control command from the interactive interface and signal source control device 12, and controls the signal source 1 according to the control command. The signal source 1 responds to the control of the one-way control device 161, performs corresponding keyboard, mouse, touch and other operations, and sends the signal source 1 content corresponding to the operation result or response result (such as video content in the form of video stream data) to the video encoding device 163 in a one-way manner through a one-way transmission device such as a one-way video line or a one-way optical fiber. The video encoding device encodes the video stream data into a network stream signal and sends the video content in the form of the network stream signal to the picture overlay and fusion device 108 via the video network switch 15.
[0136] According to some embodiments, depending on the signal source, the composition of the one-way control device 161 and the way it acts on the signal source can vary accordingly. For example, in the case where the signal source is a computer, control data in the form of a protocol can be sent to the signal source through the one-way control device 161 to perform one-way control of the signal source, and the content of the signal source will not be transmitted back to the one-way control device. In the case where the signal source is a device such as a camera, the one-way control device may include a one-way transmission device and a control device, the control device is used to control the camera according to the control data, and the one-way transmission device can block the camera content from flowing back toward the one-way control device. For example, the one-way control device may include a one-way transmission device and a USB controller, the USB controller being a standard USB-HID device, connected to the signal source via USB, and capable of controlling the signal source with a keyboard and a mouse.
[0137] The image overlay and fusion device 108 receives video content in the form of a network stream signal from the signal source 1 of the video network switch and decodes it into video stream data. The image overlay and fusion device is used to receive an interactive interface, receive control commands for implementing the push, mouse position information, and signal source display window information, and receive video content in the form of a network stream signal from the signal source 1 of the video network switch and decode it into a video stream data signal source response result. The image overlay and fusion device displays the signal source response result in the signal source display window on the interactive interface based on the signal source display window information, and pushes a response based on the control commands and mouse position information used to implement the push. The push response result can be output to the screen 100.
[0138] According to some embodiments of the present invention, the control command for controlling the signal source is encrypted to further improve interaction security. The encryption can be performed before the control command for controlling the signal source is sent, or on the second unidirectional transmission path. For example, an encryption device is introduced on the second unidirectional transmission path (such as after the network-to-serial device) to encrypt the control command, or encryption software can be introduced within a piece of hardware on the second unidirectional transmission path (such as the network-to-serial device) to encrypt the control command. Accordingly, the signal source that receives the control command decrypts the control command and responds, or a decryption device can be introduced near the signal source to decrypt the control command.
[0139] According to some embodiments of the present invention, the method may further include encrypting the signal source response result before transmitting it to the image superposition and fusion device, or encrypting it on a third unidirectional transmission path; accordingly, the image superposition and fusion device that receives the signal source response result decrypts the encrypted content, or a decryption device may be introduced at a location adjacent to the image superposition and fusion device to decrypt it. The same applies to the following embodiments.
[0140] Figure 2b Schematic diagram of a cross-network secure push system according to some further embodiments of the present invention is shown. Figure 2a The difference is that the first unidirectional transmission path 104 is located between the control network switch and the video network switch, and is used to implement the push control command, mouse position information and signal source display window information to be output to the image superposition and fusion device through the control network switch, the first unidirectional transmission path (or unidirectional transmission device) and the video network switch. Figure 2a Therefore, for the sake of simplicity, it will not be repeated.
[0141] Depending on whether a network environment is required in the work environment, in some other embodiments of the present invention, the components of the above system may be modified, for example, components related to network access may be included or omitted. For example, 1) if a video network switch is not required and only a control network switch is required, the control commands, mouse position information, and signal source display window information used to implement the push can be output to the image superposition and fusion device via the control network switch and a one-way transmission device; 2) if a control network switch is not required and only a video network switch is required, the control commands, mouse position information, and signal source display window information used to implement the push can be output to the image superposition and fusion device via a one-way transmission device and the video network switch; 3) if neither a video network nor a control network environment is required, the control commands, mouse position information, and signal source display window information used to implement the push can be output directly to the image superposition and fusion device via the one-way transmission device. Corresponding to 1) above, control data can be transmitted to the one-way control device via the control network switch. Corresponding to 2) and 3) above, control data can be transmitted directly to the one-way control device. Corresponding to 1) and 3) above, the signal source's response is output to the image superposition and fusion device via a one-way optical fiber or a one-way video cable. Corresponding to the above 2), the response result of the signal source is encoded by the video encoding device, and the encoding result is transmitted to the video network switch through a unidirectional optical fiber or other unidirectional transmission line (such as a cable), and then transmitted to the picture overlay and fusion device by the video network switch.
[0142] In addition, the front surround Figure 1b The various details of the cross-network secure push process described herein can be applied here, or can be applied here after appropriate adjustments. For the sake of simplicity, they are not repeated here.
[0143] Figure 2c A cascade diagram of a cross-network secure push system according to some further embodiments of the present invention is shown.
[0144] The dotted line frame parts 1112 and 1113 in the figure are the same as the part 1111 in the figure. The description of the part 1111 can be found in Figure 2a . Figure 2cThe system further includes a cascade server 1110, which is connected to a plurality of interactive interfaces and signal source control devices through a network to cascade the various interactive interfaces and signal source control devices, for example, acting as a server to store information of the plurality of interactive interfaces and signal source control devices, and to coordinate the mutual calling, access and control between the plurality of interactive interfaces and signal source control devices. For example, one of the interactive interfaces and signal source control devices can transmit the control command, mouse position information and signal source display window information for implementing the push to the other interactive interfaces and signal source control devices through the cascade server 1110, and the other interactive interfaces and signal source control devices then transmit the received control command, mouse position information and signal source display window information for implementing the push to their respective corresponding screen overlay fusion devices, and the respective corresponding screen overlay fusion devices display the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and push the response according to the control command and mouse position information for implementing the push.
[0145] According to some embodiments of the present invention, it is also possible to Figure 2c The system includes a cascade server 1114, which is connected to multiple screen superposition and fusion devices through a network to cascade the devices. For example, it acts as a server to store information about the multiple screen superposition and fusion devices and coordinate the mutual calls, access, and control between the multiple screen superposition and fusion devices. For example, multiple screen superposition and fusion devices transmit the push response result screen to other multiple screen superposition and fusion devices through the server.
[0146] According to some embodiments of the present invention, (the functions of) the above cascade servers 1110 and 1114 may be integrated into a control network switch and a video network switch, respectively.
[0147] According to some embodiments of the present invention, (the functions of) the above cascade servers 1110 and 1114 may also be integrated into the interactive interface and signal source control device and the image overlay and fusion device, respectively.
[0148] The application of the above cascade server is also applicable to other embodiments, for example, it can be used for Figure 2b and below Figure 3 , no more details.
[0149] If Figure 1a The prior art shown introduces a cascade server and multiple interactive terminals in parallel with the interactive terminal 1000, because, Figure 1a In the technology shown, the interactive terminal 1000 sends all the interfaces after the interactive response in the form of video images to the interactive terminal 2000 on the left. Therefore, it is impossible for each interactive terminal to apply control commands for implementing the push to each other's interactive interfaces, that is, it is impossible to realize the push cascade in the present invention.
[0150] Figure 3 A schematic diagram of a cross-network secure push system according to some embodiments of the present invention is shown.
[0151] The cross-network secure push system includes a multi-network secure use device 300, a control network switch 13, a video network switch 35, one-way control devices (361, 362; 371, 372), video encoding devices (363, 364; 373, 374), and a one-way transmission device connecting signal sources (signal source 1, signal source 2; signal source n, signal source m) and the video encoding devices (363, 364; 373, 374). According to some embodiments of the present invention, the interactive interface and signal source control device 32 may also include an input generation device 31.
[0152] The multi-network safe use device 300 includes: an interactive interface and signal source control device 32, a first unidirectional transmission path 34, a unidirectional video transmission device 341 (such as a unidirectional HDMI video cable or a VGA video cable), and a picture superposition and fusion device 38.
[0153] The interactive interface and signal source control device receives and analyzes user input (such as a login account), determines the interactive interface 325 corresponding to the operation, and the operation object (signal source 1), draws the interactive interface based on the UI data related to the interactive interface 325, and transmits the interactive interface to the image superposition and fusion device 38 via the one-way video transmission device 341. The image superposition and fusion device 38 then outputs the interactive interface 325 to the screen 301, allowing the user to see the interactive interface 325 to be operated on the screen. The user can then refer to the interface on the screen 301 to perform further operations.
[0154] The interactive interface and signal source control device 32 can receive and analyze further user input, determine control commands corresponding to the input for controlling the interactive interface 325, control commands for implementing the push, and control commands for controlling the signal source 1; and control the interactive interface to respond according to the control commands for controlling the interactive interface, draw the interactive interface based on the interactive interface response, and output the drawn interactive interface to the image superposition and fusion device 38 via the one-way video transmission device. The interactive interface and signal source control device 32 also outputs the control commands for implementing the push, mouse position information, and signal source display window information to the image superposition and fusion device 38 via the first one-way transmission path 34. The interactive interface and signal source control device 32 will also send the control command for controlling the signal source 1 to the corresponding one-way control device 361 through the control network switch 13, and the one-way control device 361 will control the signal source 1 to respond according to the control command for controlling the signal source 1, and output the response result to the video encoding device 363 through a one-way transmission device; the video encoding device 363 is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then the video network switch transmits it to the picture overlay and fusion device.
[0155] The image overlay and fusion device 38 is configured to receive an interactive interface, receive control commands for implementing the push, mouse position information, and signal source display window information, and receive a signal source response result; display the signal source response result in the signal source display window on the interactive interface according to the signal source display window information; and push a response according to the control commands for implementing the push and the mouse position information. The push response result may be output to a screen.
[0156] According to some embodiments of the present invention, as mentioned above, the screen may also be composed of multiple screens. If the interactive interface and signal source control device receives and analyzes the input login account and determines that the operation corresponds to the interactive interface 325, and corresponds to one of the screens and signal source 1, the interactive interface and signal source control device sends the screen ID together with the mouse position information and the signal source display position information to the picture overlay and fusion device, so that the picture overlay and fusion device outputs the final picture to the target screen.
[0157] According to some embodiments of the present invention, the control network switch 13, the video network switch 35, the one-way control device (361, 362; 371, 372), the video encoding device (363, 364; 373, 374), and the one-way transmission device connecting the signal source (signal source 1, signal source 2; signal source n, signal source m) and the video encoding device (363, 364; 373, 374) can all be integrated into the multi-network safety use device 300. In actual use, it is only necessary to connect the signal source to the multi-network safety use device formed after integration.
[0158] According to some embodiments of the present invention, the interactive interface and signal source control device 32 may include an event acquisition unit 321, an interactive interface drawing and event response unit 322, a layout data distribution unit 323, an interactive interface video output unit 320, and a control data processing and distribution unit 324.
[0159] The event collection unit 321 receives an input signal from the input generation device and sends the signal to the interactive interface drawing and event response unit 322 .
[0160] The interactive interface drawing and event response unit 322 receives and analyzes the user input sent by the event acquisition unit 321, determines the control command for controlling the interactive interface and the control command for controlling the signal source, controls the interactive interface to respond and draws the interactive interface according to the control command for controlling the interactive interface, and sends the control command for controlling the signal source to the control data processing and distribution unit 324. According to some embodiments of the present invention, the interactive interface drawing and event response unit 322 may also analyze and determine the initial interactive interface corresponding to the input (for example, when there are multiple interactive interfaces available for call).
[0161] The interactive interface drawing includes drawing the initial interactive interface, and also includes drawing the interactive interface after responding to the control command in real time. The interactive interface drawing and event response unit 322 also sends the drawn interactive interface to the interactive interface video output unit 320, which then sends it to the screen superposition and fusion device 38 through the one-way video transmission device 341, and the screen superposition and fusion device 38 outputs the interactive interface to the screen. Figure 4 As shown, the interactive interface drawing and event response unit 322 draws the initial interactive interface, analyzes the user's mouse dragging action (such as causing the signal source display window in the interactive interface to change from the solid-line frame a to the position of the dotted-line frame b in the figure), draws accordingly, and sends the drawing result to the interactive interface video output unit 320, which sends the drawing result to the picture overlay fusion device 38, and the picture overlay fusion device presents the real-time interactive interface on the screen.
[0162] The interactive interface drawing and event response unit 322 analyzes and determines control commands for controlling the signal source, which may include, for example, commands for playing, pausing, or turning off the signal source, or commands for entering text within the window corresponding to the signal source. The control data processing and distribution unit 324 receives the control commands for controlling the signal source and sends them to the control network switch 13. The control network switch 13 then sends the data to the unidirectional control device, which controls the signal source 1 to perform the corresponding action, as described above. In addition to receiving and distributing the control commands, the control data processing and distribution unit can also encode and encrypt the control commands before distribution to ensure that the data format is suitable for further transmission and maintains confidentiality.
[0163] The interactive interface drawing and event response unit 322 also determines the control command for implementing the push, the signal source display window information in the interactive interface, and the mouse position information, and sends the control command for implementing the push, the signal source display window information in the interactive interface, and the mouse position information to the layout data distribution unit 323. The layout data distribution unit 323 sends the data to the screen overlay fusion device 38 via the first unidirectional transmission path 34, so that the screen overlay fusion device 38 displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushes the response according to the control command and mouse position information for implementing the push. When the signal source display window is enlarged by the user dragging and dropping, the position of the signal source display window and the mouse position change. The interactive interface drawing and event response unit 322 sends the changed position of the signal source display window and the mouse position to the layout data distribution unit 323. The layout data distribution unit 323 sends the data to the screen overlay fusion device 38 via the first unidirectional transmission path 34. The screen overlay fusion device 38 outputs the video content of the relevant signal source to the changed signal source display window and points the mouse at the corresponding new position.
[0164] According to some other embodiments of the present invention, the various units of the interactive interface and signal source control device 32 may be combined with each other or re-divided in different ways to similarly implement the entire functionality of the interactive interface and signal source control device 32. For example, some functions of the interactive interface drawing and event response unit 322 may be distributed to the interactive interface video output unit 320, the layout data distribution unit 323, and the control data processing and distribution unit 324.
[0165] According to some embodiments of the present invention, the screen overlay fusion device 38 may include: an interactive interface video receiving unit 381 for receiving the interactive interface output by the interactive interface video output unit 320; a layout data receiving unit 382 for receiving the signal source display window information and mouse position information sent by the layout data distribution unit 323; a video decoding unit 383 for receiving the signal source response result, including receiving the network stream signal corresponding to the signal source response result from the video network switch 35 and decoding it into video stream data; a fusion unit 380 for displaying the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and pushing the response according to the control command and mouse position information used to implement the push. The push response result will be displayed on the screen 301.
[0166] According to some other embodiments of the present invention, the various units of the image superposition and fusion device 38 may also be merged with each other, or re-divided in different ways to similarly implement the entire function of the image superposition and fusion device 38 .
[0167] In addition, the front surround Figure 1b and 2a The various details of the cross-network secure push process described herein can be applied here, or can be applied here after appropriate adjustments. For the sake of simplicity, they are not repeated here.
[0168] Figure 5 A flowchart of a cross-network secure push method according to some embodiments of the present invention is shown. The method includes:
[0169] S1. Receive and analyze user input, determine a control command for controlling the interactive interface, a control command for implementing the plotting, and a control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the response result of the interactive interface, and output the drawn interactive interface to the screen overlay and fusion device through the one-way video transmission device;
[0170] S2 determines the control command for implementing the plotting, the mouse position information and the signal source display window information, and outputs the control command for implementing the plotting, the mouse position information and the signal source display window information to the screen overlay fusion device via a first unidirectional transmission path;
[0171] S3. According to the control command for controlling the signal source, the signal source is controlled to respond through the second unidirectional transmission path, and the signal source outputs the signal source response result to the picture superposition and fusion device through the third unidirectional transmission path.
[0172] Furthermore, the method may further include: the screen overlay and fusion device receiving an interactive interface, receiving a control command for implementing the push, mouse position information, and signal source display window information; displaying a signal source response result in the signal source display window on the interactive interface according to the signal source display window information; and pushing a response according to the control command for implementing the push and the mouse position information. The push response result may be output to the screen 100.
[0173] Figure 6 A flow chart of a cross-network secure push method according to some further embodiments of the present invention is shown. The method includes:
[0174] S11. Receive and analyze user input, determine a control command for controlling the interactive interface, a control command for implementing the plotting, and a control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, draw the interactive interface according to the response result of the interactive interface, and output the drawn interactive interface to the screen overlay and fusion device through the one-way video transmission device;
[0175] S12 determines the control command for implementing the plotting, the mouse position information and the signal source display window information, and outputs the control command for implementing the plotting, the mouse position information and the signal source display window information to the screen overlay fusion device via a first unidirectional transmission path;
[0176] S13. The control command for controlling the signal source is sent to the one-way control device through the control network switch. The one-way control device controls the signal source according to the control command, so that the signal source responds to the control of the one-way control device, and sends the response result unidirectionally to the video encoding device through the one-way transmission device. The video encoding device encodes the video stream data into a network stream signal and sends the video content in the form of the network stream signal to the picture overlay and fusion device via the video network switch.
[0177] Furthermore, the method may further include:
[0178] The image overlay and fusion device receives an interactive interface, receives a control command for implementing the push, mouse position information, and signal source display window information, and receives video content in the form of a network stream signal from a signal source of a video network switch, decodes the signal into a video stream data signal source response result, and displays the signal source response result in a signal source display window on the interactive interface according to the signal source display window information, and pushes a response according to the control command for implementing the push and the mouse position information. The push response result can be output to a screen.
[0179] In addition, the previous reference Figure 1b-4The cross-network secure push process or method involved in the cross-network secure push system described above also applies here. For example, according to some embodiments of the present invention, the method may further include determining an initial interactive interface corresponding to the input. For example, when multiple interactive interfaces are available for invocation, the interactive interface to be operated is determined based on a pre-stored correspondence between the input and the interactive interface; drawing the interactive interface includes drawing the initial interactive interface and also includes drawing the interactive interface after a real-time response to the control command. For the sake of simplicity, this is not further described here.
[0180] This application also proposes a device for secure cross-network push. According to some embodiments of the present invention, the device includes a memory, a processor, and a computer program stored in the memory, and when the processor executes the computer program, it performs the following steps:
[0181] Receiving and analyzing user input, determining a control command for controlling the interactive interface, a control command for implementing the plotting, and a control command for controlling the signal source, controlling the interactive interface to respond according to the control command for controlling the interactive interface, drawing the interactive interface according to the interactive interface response result, and outputting the drawn interactive interface through the one-way video transmission device (outputting it to the picture superposition and fusion device);
[0182] Outputting a control command for implementing the push, mouse position information, and signal source display window information (towards the image overlay and fusion device) through a first unidirectional transmission path;
[0183] According to the control command for controlling the signal source, the signal source is controlled to respond through the second unidirectional transmission path, and the signal source outputs the signal source response result to the image superposition and fusion device through the third unidirectional transmission path.
[0184] In addition, the previous reference Figure 1b The cross-network secure push process or method involved in the cross-network secure push system described in 4 is also applicable here, that is, it is also within the scope of protection of the present invention. For the sake of simplicity, it will not be repeated here.
[0185] Figure 7 An exemplary device 50 for cross-network secure push is shown, which includes a processor 51 , a memory 52 , and a bus 53 .
[0186] In some instances, the device may also include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, the processor 51, the memory 52, and the output port 503 are interconnected via a bus 53. The input device 501 and the output device 504 are connected to the bus 53 via the input port 502 and the output port 503, respectively, and are thereby connected to other components of the device. It should be noted that the output interface and input interface herein may also be represented by I / O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 via the input port 502. The processor 51 processes the input information based on computer-executable instructions stored in the memory 52 to generate output information, temporarily or permanently stores the output information in the memory 52, and then transmits the output information to the output device 504 via the output port 503. The output device 503 outputs the output information to the outside of the device.
[0187] The memory 52 includes a large capacity memory for data or instructions. By way of example and not limitation, the memory 52 may include an HDD, a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 52 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 52 may be inside or outside the device. In a specific embodiment, the memory 52 is a non-volatile solid-state memory. In a specific embodiment, the memory 52 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.
[0188] Bus 53 includes hardware, software or both for coupling the various components of the device to each other. By way of example and not limitation, bus 53 may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industry standard architecture (EISA) bus, a front side bus (FSB), a hypertransport (HT) interconnect, an industry standard architecture (ISA) bus, an infinite bandwidth interconnect, a low pin count (LPC) bus, a memory bus, a microchannel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable bus or a combination of two or more of these. Although the embodiments of the present invention describe and illustrate a specific bus, the present invention contemplates any suitable bus or interconnect.
[0189] The processor 51 receives and analyzes user input based on the computer program stored in the memory 52, determines the control command for controlling the interactive interface, the control command for implementing the mapping, and the control command for controlling the signal source, and controls the interactive interface to respond according to the control command for controlling the interactive interface, draws the interactive interface according to the response result of the interactive interface, and outputs the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device; outputs the control command for implementing the push, mouse position information and signal source display window information to the picture superposition and fusion device through the first one-way transmission path; controls the signal source to respond through the second one-way transmission path according to the control command for controlling the signal source, and enables the signal source to output the signal source response result to the picture superposition and fusion device through the third one-way transmission path.
[0190] In addition, the cross-network secure push process or method involved in the cross-network secure push system described with reference to the various figures above can also be included here as one of the execution steps of the processor, that is, it is also within the protection scope of the present invention. For the sake of simplicity, it will not be repeated here.
[0191] According to some further embodiments of the present invention, the computer program may be divided into one or more units in various ways, stored in the memory, and executed by the processor to accomplish the present invention. The one or more units may be a series of computer program instruction segments capable of accomplishing specific functions, the instruction segments being used to describe the execution process of the computer program in the device. The computer program may be divided into multiple units based on the functions of the various units in the various embodiments described above with reference to the various figures, or may include the various units described above with reference to the various figures. Figure 3 For the sake of simplicity, the various units in the various embodiments described are not repeated here.
[0192] The so-called processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the device, and various interfaces and lines are used to connect the various parts of the entire device. The device may be a computing device such as a desktop computer, a notebook, a PDA, and a cloud server, or a part thereof. The device may include, but is not limited to, a processor and a memory. Those skilled in the art will understand that the schematic diagram is merely an example of the device and does not constitute a limitation of the device.
[0193] The corresponding detailed descriptions made above with reference to the various figures are incorporated herein by reference and will not be repeated here.
[0194] The present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the following steps are implemented:
[0195] Receive and analyze user input, determine the control command for controlling the interactive interface, the control command for implementing the mapping, and the control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, draw the interactive interface according to the response result of the interactive interface, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device; output the control command for implementing the push, mouse position information and signal source display window information to the picture superposition and fusion device through the first one-way transmission path; control the signal source to respond through the second one-way transmission path according to the control command for controlling the signal source, and enable the signal source to output the signal source response result to the picture superposition and fusion device through the third one-way transmission path.
[0196] The computer program includes computer program code, which may be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium.
[0197] Through the above-mentioned embodiments of the present invention, an interactive terminal can implement various push operations on another cross-network interactive terminal, thereby improving the interaction efficiency. At the same time, it also ensures the security of the interaction process and avoids the flow of high-level information caused by the interaction process to low-level interactive devices, such as avoiding the content of a high-level signal source from flowing to the interactive interface and signal source control device or flowing to the low-level interactive terminal where the input generating device is located.
Claims
1. Cross-network secure push methods, including: Receiving and analyzing user input, determining a control command for controlling the interactive interface, a control command for implementing the push, and a control command for controlling the signal source, and controlling the interactive interface to respond according to the control command for controlling the interactive interface, and drawing the interactive interface according to the interactive interface response result, and outputting the drawn interactive interface to the screen superposition and fusion device through a one-way video transmission device; Outputting the control command for implementing the push, the mouse position information and the signal source display window information to the image superposition and fusion device through a first unidirectional transmission path; According to the control command for controlling the signal source, the signal source is controlled to respond through the second unidirectional transmission path, and the signal source outputs the signal source response result to the picture superposition and fusion device through the third unidirectional transmission path; The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and the image superposition and fusion device performs a push response according to the control command for implementing the push and the mouse position information; Cross-network push includes cross-network push mapping; The control command for implementing the push includes a cross-network plotting command; and the screen overlay fusion device performs a push response according to the control command for implementing the push and the mouse position information, including the screen overlay fusion device outputting a mouse pattern at the mouse position on the interactive interface, and performing plotting on the visual top layer according to the cross-network plotting command and the mouse position information; The cross-network push also includes a cross-network push pop-up window; the control command used to implement the push includes a cross-network pop-up window command; and the screen overlay and fusion device pushes a response according to the control command used to implement the push and the mouse position information, including the screen overlay and fusion device outputting a mouse pattern at the mouse position on the interactive interface, and implementing a pop-up window at the mouse position.
2. The method according to claim 1, comprising outputting the control command for implementing the push, the mouse position information and the signal source display window information to the screen overlay fusion device through one of the following methods 1), 2), 3) and 4): 1) Transmitting the control command for implementing the push, the mouse position information and the signal source display window information to the screen superposition and fusion device through a first unidirectional transmission device of one of the following a)-b): a) unidirectional optical fiber; b) One-way serial line; 2) transmitting the control command for implementing the push, the mouse position information and the signal source display window information to the image superposition and fusion device through the first network, the network-to-optical device and the unidirectional optical fiber in sequence; 3) The control command for implementing the push, the mouse position information and the signal source display window information are sequentially transmitted to the screen superposition and fusion device via the first network, the first unidirectional transmission device of one of the following c)-d) and the second network: c) unidirectional optical fiber; d) Combination of network-to-optical equipment, unidirectional optical fiber and optical-to-network equipment; 4) The control command for implementing the push, the mouse position information and the signal source display window information are sequentially transmitted to the screen superposition and fusion device through the first unidirectional transmission device and the second network of one of the following e)-f): e) unidirectional optical fiber; f) Combination of unidirectional optical fiber and optical switching network equipment.
3. The method according to claim 2, wherein the control command for controlling the signal source is used to control the signal source, and the signal source is controlled to respond through the second unidirectional transmission path, comprising: 1) Controlling the signal source via a second one-way transmission device of one of a) to d) below to respond: a) Unidirectional optical fiber; b) One-way serial line; c) Combination of unidirectional serial line, serial optical conversion equipment and unidirectional optical fiber; d) Combination of unidirectional optical fiber, optical-to-serial device and unidirectional serial port cable; 2) Controlling the signal source to respond sequentially through the first network and the second one-way transmission device of one of the following e)-h): e) Combination of network-to-serial equipment and one-way serial cable; f) Combination of network-to-optical equipment and unidirectional optical fiber; g) Combination of network-to-serial equipment, unidirectional serial cables, serial-to-optical equipment and unidirectional optical fibers; h) Combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment and unidirectional serial port line; 3) Control the signal source to respond via the first network, the second unidirectional transmission device of one of the following i)-m) and the third network where the signal source is located: i) unidirectional optical fiber; j) Combination of network-to-serial equipment, one-way serial cable and serial-to-network equipment; k) Combination of network-to-optical equipment, unidirectional optical fiber and optical-to-network equipment; l) Combination of network-to-serial equipment, unidirectional serial lines, serial-to-optical equipment, unidirectional optical fibers and optical-to-network equipment; m) Combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment, unidirectional serial line and serial-to-network equipment; 4) responding in sequence through the second unidirectional transmission device of one of the following n)-r) and the third network control signal source where the signal source is located: n) unidirectional optical fiber; o) Combination of unidirectional optical fiber, optical-to-serial equipment, unidirectional serial line and serial-to-network equipment; p) Combination of unidirectional optical fiber and optical switching network equipment; q) Combination of one-way serial line and serial-to-network equipment; r) Combination of unidirectional serial line, serial-to-optical equipment, unidirectional optical fiber, and optical-to-network equipment; 5) Control the signal source to respond through a one-way control device.
4. The method according to claim 2, wherein the controlling the signal source to respond through the second unidirectional transmission path comprises implementing the control through one of the following methods 1)-3): 1) The control command for controlling the signal source is transmitted to the control device through one of the following second unidirectional transmission devices a)-d), and the control device controls the signal source to respond: a) unidirectional optical fiber; b) One-way serial line; c) Combination of unidirectional serial line, serial optical conversion equipment and unidirectional optical fiber; d) Combination of unidirectional optical fiber, optical-to-serial device and unidirectional serial port cable; 2) transmitting the control command for controlling the signal source to the control device through the first network and the second unidirectional transmission device of one of the following e)-h) in sequence, and the control device controls the signal source to respond: e) Combination of network-to-serial equipment and one-way serial cable; f) Combination of network-to-optical equipment and unidirectional optical fiber; g) Combination of network-to-serial equipment, unidirectional serial cables, serial-to-optical equipment and unidirectional optical fibers; h) Combination of network-to-optical equipment, unidirectional optical fiber, optical-to-serial equipment and unidirectional serial port line; 3) transmitting the control command for controlling the signal source to the control device via the first network, and the control device controls the signal source to respond via the second unidirectional transmission device of one of the following i)-l): i) unidirectional optical fiber; j) One-way serial line; k) Combination of unidirectional serial line, serial optical conversion equipment and unidirectional optical fiber; l) Combination of unidirectional optical fiber, optical-to-serial converter and unidirectional serial cable.
5. The method according to claim 2, 3 or 4, comprising outputting the signal source response result to the image superposition and fusion device through a third unidirectional transmission path in one of the following ways 1) and 2): 1) The signal source transmits the signal source response result to the image superposition and fusion device through a third unidirectional transmission device of one of the following a)-b): a) unidirectional optical fiber; b) One-way video line; 2) The signal source transmits the signal source response result to the video encoding device through one of the following third unidirectional transmission devices c)-d), and the video encoding device encodes the signal source response result into a network stream signal, and sends the network stream signal to the image superposition and fusion device through the second network, and the image superposition and fusion device decodes the network stream signal into video stream data, and uses the video stream data as the signal source response result: c) unidirectional optical fiber; d) One-way video line.
6. The method according to claim 5, wherein: The first network is isolated from the second network; the second network is isolated from the third network; and the first network is isolated from the third network.
7. The method according to claim 1, wherein: The interactive interface and signal source control device transmits the control command, mouse position information and signal source display window information for implementing the push to other interactive interfaces and signal source control devices through the first cascade server. The other interactive interfaces and signal source control devices then transmit the received control command, mouse position information and signal source display window information for implementing the push to their respective corresponding screen overlay and fusion devices. The respective corresponding screen overlay and fusion devices display the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and push the response according to the control command and mouse position information for implementing the push.
8. The method according to claim 1, wherein: The picture superimposing and fusing device transmits the push response result picture to other multiple picture superimposing and fusing devices through the second cascade server.
9. Cross-network secure push system, including: An interactive interface and signal source control device, a first one-way transmission device, a one-way video transmission device, a picture superposition and fusion device, a second one-way transmission device and a third one-way transmission device; The interactive interface and signal source control device is used to receive and analyze user input, determine the control command for controlling the interactive interface, the control command for implementing the push and the control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device; The interactive interface and signal source control device is also used to output the control command for implementing the push, the mouse position information and the signal source display window information to the picture superposition and fusion device through the first one-way transmission device, and control the signal source through the second one-way transmission device so that it responds according to the control command for controlling the signal source and transmits the signal source response result to the picture superposition and fusion device through the third one-way transmission device; The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and the image superposition and fusion device performs a push response according to the control command for implementing the push and the mouse position information; Cross-network push includes cross-network push mapping; The control command for implementing the push includes a cross-network plotting command; and the screen overlay fusion device performs a push response according to the control command for implementing the push and the mouse position information, including the screen overlay fusion device outputting a mouse pattern at the mouse position on the interactive interface, and performing plotting on the visual top layer according to the cross-network plotting command and the mouse position information; The cross-network push also includes a cross-network push pop-up window; the control command used to implement the push includes a cross-network pop-up window command; and the screen overlay and fusion device pushes a response according to the control command used to implement the push and the mouse position information, including the screen overlay and fusion device outputting a mouse pattern at the mouse position on the interactive interface, and implementing a pop-up window at the mouse position.
10. Cross-network secure push system, including: Interactive interface and signal source control device, one-way video transmission device, first one-way transmission device, picture superposition and fusion device, one-way control equipment and second one-way transmission device; The interactive interface and signal source control device is used to receive and analyze user input, determine the control command for controlling the interactive interface, the control command for implementing the push and the control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device; The interactive interface and signal source control device is also used to determine the control command, mouse position information and signal source display window information used to implement the push, and output the control command, mouse position information and signal source display window information used to implement the push to the picture superposition and fusion device through the first unidirectional transmission device; The interactive interface and signal source control device are also used to send the control command for controlling the signal source to the one-way control device, and the one-way control device controls the signal source to respond according to the control command for controlling the signal source and transmit the signal source response result to the picture superposition and fusion device through the second one-way transmission device; The image superposition and fusion device displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and the image superposition and fusion device performs a push response according to the control command for implementing the push and the mouse position information; Cross-network push includes cross-network push mapping; The control command for implementing the push includes a cross-network plotting command; and the screen overlay fusion device performs a push response according to the control command for implementing the push and the mouse position information, including the screen overlay fusion device outputting a mouse pattern at the mouse position on the interactive interface, and performing plotting on the visual top layer according to the cross-network plotting command and the mouse position information; The cross-network push also includes a cross-network push pop-up window; the control command used to implement the push includes a cross-network pop-up window command; and the screen overlay and fusion device pushes a response according to the control command used to implement the push and the mouse position information, including the screen overlay and fusion device outputting a mouse pattern at the mouse position on the interactive interface, and implementing a pop-up window at the mouse position.
11. Cross-network secure push system, including: Interactive interface and signal source control device, one-way video transmission device, first one-way transmission device, picture superposition and fusion device, one-way control equipment, control network switch, video network switch, video encoding equipment and second one-way transmission device; The interactive interface and signal source control device is used to receive and analyze user input, determine the control command for controlling the interactive interface, the control command for implementing the push and the control command for controlling the signal source, and control the interactive interface to respond according to the control command for controlling the interactive interface, and draw the interactive interface according to the interactive interface response result, and output the drawn interactive interface to the picture superposition and fusion device through the one-way video transmission device; The interactive interface and signal source control device is also used to determine the control command, mouse position information and signal source display window information used to implement the push, and output them to the picture superposition and fusion device through the first unidirectional transmission device; The interactive interface and signal source control device also sends a control command for controlling the signal source to the control network switch, which then sends the control command to the unidirectional control device, and the unidirectional control device controls the signal source to respond according to the control command for controlling the signal source and outputs the response result to the video encoding device through the second unidirectional transmission device; The video encoding device is used to encode the signal source response result into a network stream signal and transmit the network stream signal to the video network switch, and then transmit it to the picture superposition and fusion device by the video network switch; The image superposition and fusion device decodes the network stream signal into video stream data, uses the video stream data as the signal source response result, displays the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and performs a push response according to the control command for implementing the push and the mouse position information; Cross-network push includes cross-network push mapping; The control command for implementing the push includes a cross-network plotting command; and the screen overlay fusion device performs a push response according to the control command for implementing the push and the mouse position information, including the screen overlay fusion device outputting a mouse pattern at the mouse position on the interactive interface, and performing plotting on the visual top layer according to the cross-network plotting command and the mouse position information; The cross-network push also includes a cross-network push pop-up window; the control command used to implement the push includes a cross-network pop-up window command; and the screen overlay and fusion device pushes a response according to the control command used to implement the push and the mouse position information, including the screen overlay and fusion device outputting a mouse pattern at the mouse position on the interactive interface, and implementing a pop-up window at the mouse position.
12. The system according to claim 9, 10 or 11, further comprising an input generating device for generating the user input; The input generating device includes a transparent touch device, and the transparent touch device is superimposed on the display device; or, The input generating device comprises an infrared light curtain type touch screen based on the display device.
13. The system according to claim 11 further includes a first cascade server and multiple interactive interfaces and signal source control devices, the first cascade server network connecting the multiple interactive interfaces and signal source control devices to cascade each interactive interface and signal source control device; and / or, the system further includes a second cascade server and multiple screen overlay and fusion devices, the second cascade server network connecting the multiple screen overlay and fusion devices to cascade each screen overlay and fusion device.
14. The system according to claim 13, wherein: The interactive interface and signal source control device can transmit the control command, mouse position information and signal source display window information for implementing the push to other interactive interfaces and signal source control devices through the first cascade server. The other interactive interfaces and signal source control devices then transmit the received control command, mouse position information and signal source display window information for implementing the push to their respective corresponding screen overlay and fusion devices. The respective corresponding screen overlay and fusion devices display the signal source response result in the signal source display window on the interactive interface according to the signal source display window information, and push the response according to the control command and mouse position information for implementing the push.
