System for multi-terminal display and control of signal sources

Abstract

The present invention relates to a system for multi-terminal display and control of a signal source, comprising a screen splitter, an interface acquisition box, a control center, an instruction forwarding processor, and two terminals; the screen splitter is connected to a graphics card of a signal source, and is used to receive a video interface and divide it into two parts, and output the first part to a first terminal through a video line, and output the second part to an interface acquisition box through a video line; the interface acquisition box encodes the second video interface into a network stream signal; the control center is used to connect to a second graphics card output end of the signal source through a video line to obtain the video interface output by the second graphics card; the control center also obtains the network stream signal of the interface acquisition box through a network, and outputs the network stream signal to the second terminal; the control center is also used to send a control instruction to the instruction forwarding processor through a network, and the instruction forwarding processor sends the control instruction to the signal source through a USB line. The present invention enables a control center to realize multi-terminal fast and safe sharing and control of a signal source.

Description

Technical Field

[0001] The present application relates to the technical field of signal control, and in particular to a system for performing multi-terminal display and control of a signal source. Background Art

[0002] In the prior art, access control to signal sources is either achieved through a network or by a user in front of the signal source directly inputting keyboard and mouse commands to the signal source. The former can easily lead to network leakage of signal source content, while the latter makes control over the signal source inflexible. Summary of the invention

[0003] In view of the defects or shortcomings in the above prior art, the present application proposes a system for multi-terminal display and control of a signal source, wherein the signal source includes a first signal source, the first signal source includes two graphics cards, and the system includes a first screen splitter, a first interface acquisition box, a control center, a command forwarding processor, a first terminal and a second terminal;

[0004] The first screen splitter is connected to the output terminal of the first graphics card of the first signal source, and is used to receive the video interface output by the first graphics card, and divide it into two parts, and output the first video interface to the first terminal through the video line, and output the second video interface to the first interface acquisition box through the video line;

[0005] The first interface capture box is used to receive the second video interface and encode it into a first network stream signal;

[0006] The control center is used to connect the second graphics card output terminal of the first signal source through a video line to obtain the video interface output by the second graphics card; the control center also obtains the first network stream signal of the first interface acquisition box through the network, and outputs the first network stream signal to the second terminal;

[0007] The control center is also used to receive control instructions input from the outside, and convert the control instructions into control instructions corresponding to the first signal source space, and send the converted control instructions to the instruction forwarding processor through the network;

[0008] The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the first signal source through the USB line;

[0009] The first terminal is used to receive the first video interface from the first screen splitter and output it for display;

[0010] The second terminal is used to receive the first network stream signal, and decode and display it.

[0011] According to some embodiments of the present invention, the signal source further includes a second signal source, the second signal source includes two graphics cards, and the system further includes a second screen splitter, a second interface acquisition box, a third terminal and a fourth terminal;

[0012] The second screen splitter is connected to the output terminal of the first graphics card of the second signal source, and is used to receive the video interface output by the first graphics card of the second signal source, and divide it into two parts, and output the first video interface to the third terminal through the video line, and output the second video interface to the second interface acquisition box through the video line;

[0013] The second interface acquisition box is used to receive the second video interface and encode it into a second network stream signal;

[0014] The control center is also used to connect to the second graphics card output terminal of the second signal source through a video line to obtain the video interface output by the second graphics card; the control center also obtains the second network stream signal of the second interface acquisition box through the network, and outputs the second network stream signal to the fourth terminal;

[0015] The control center is also used to receive control instructions input from the outside, and convert the control instructions into control instructions corresponding to the target signal source space corresponding to the control instructions, and send the converted control instructions to the instruction forwarding processor through the network;

[0016] The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the target signal source through the USB line;

[0017] The third terminal is used to receive the first video interface from the second screen splitter and output it for display;

[0018] The fourth terminal is used to receive the second network stream signal, and decode and display it.

[0019] According to some embodiments of the present invention, the control center also decodes the first network stream signal to obtain the second video interface, and converges all video interfaces according to an interface convergence method, and receives external input control instructions, determines the position of the control instruction according to the mouse action position and interface convergence method indicated by the control instruction, and converts the control instruction into a control instruction corresponding to the signal source space according to the action position, and sends the converted control instruction to the instruction forwarding processor through the network, the instruction forwarding processor receives the control instruction through the network, and sends the control instruction to the first signal source through the USB cable.

[0020] According to some embodiments of the present invention, the control center decodes each network stream signal to obtain the second video interface, and the control center also converges all video interfaces according to an interface convergence method, and receives external input control instructions, determines the position of the control instruction according to the mouse action position indicated by the control instruction and the interface convergence method, and determines the target signal source according to the action position, and converts the control instruction into a control instruction corresponding to the target signal source space, and sends the converted control instruction to the instruction forwarding processor through the network, the instruction forwarding processor receives the control instruction through the network, and sends the control instruction to the target signal source through the USB line.

[0021] According to some embodiments of the present invention, the dividing into two parts includes dividing into two identical parts or two different parts; and the video interface output by the second graphics card includes a video interface that is the same as or different from the first video interface.

[0022] According to some embodiments of the present invention, the video interface output by the second graphics card includes a video interface that is the same as or different from the second video interface.

[0023] According to some embodiments of the present invention, it also includes m fifth terminals, and the control center sends each network stream signal to each fifth terminal through the network or network cable, and each fifth terminal decodes and displays each network stream signal; and / or, it also includes n sixth terminals, and the control center decodes each network stream signal and sends it to each sixth terminal through each video cable, or sends the second video interface to each sixth terminal.

[0024] According to some embodiments of the present invention, the control center receives an input upper screen switching instruction, and according to the target terminal and target video interface corresponding to the upper screen switching instruction, outputs the target video interface to the target terminal through a video cable or sends the network stream signal corresponding to the target video interface to the target terminal through the network or network cable.

[0025] According to some embodiments of the present invention, the control center is used to receive input upper screen switching instructions. When the upper screen switching instructions instruct to send the video interface output by the second graphics card of each signal source to the fifth terminal via a network or a network cable, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the contents are the same, the network stream signal is sent to the fifth terminal.

[0026] According to some embodiments of the present invention, the control center is used to receive an input upper screen switching instruction. When the upper screen switching instruction indicates that each network stream signal is sent to a sixth terminal, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the contents are the same, the video interface output by the second graphics card is sent to the sixth terminal.

[0027] According to some embodiments of the present invention, the instruction forwarding processor includes an instruction service box, an instruction output box, and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and transmit the converted control instruction unidirectionally to the instruction output box, and the instruction output box sends the control instruction to the first signal source via a USB line.

[0028] According to some embodiments of the present invention, the instruction forwarding processor includes an instruction service box, an instruction output box, and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and transmit the converted control instruction unidirectionally to the instruction output box, and the instruction output box sends the control instruction via a USB line to the target signal source corresponding to the control instruction.

[0029] According to some embodiments of the present invention, the control center sets a counter value for each decoded image, and the counter value corresponds to the number of times the image needs to be played on each terminal; the control center monitors the acquisition of each image by each terminal, and when the image is acquired once by one of the terminals, the counter value corresponding to the image is reduced by 1; when the control center determines that the counter value is 0, the memory resources occupied by the image with a counter value of 0 are reclaimed.

[0030] Through the embodiments of the present invention, fast and secure sharing and control of multiple terminals of a signal source can be achieved in a control center. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The present invention will be exemplarily described below with reference to the accompanying drawings and in combination with embodiments. It should be noted that the embodiments and features in the embodiments in this application can be combined with each other without conflict. In addition, the described embodiments are only some embodiments of the present invention, not all embodiments.

[0032] Figure 1 A system topology diagram for performing multi-terminal display and control on a signal source according to some embodiments of the present invention is shown.

[0033] Figure 2 A system topology diagram for performing multi-terminal display and control of multiple signal sources according to still other embodiments of the present invention is shown.

[0034] Figure 3 A flow chart showing video stream decoding and related processes according to some embodiments of the present invention. DETAILED DESCRIPTION

[0035] In this application, all references to implementation through a network are intended to cover wired or wireless network connections implemented through necessary firmware or software such as switches and routers, as well as wired or wireless network connections implemented through some servers or other computers as intermediaries. In order to simplify the description and highlight the invention, this application sometimes omits the description of routers / switches when describing network connections. In this application, the networks involved may include Wi-Fi networks, Bluetooth networks, private area networks (PANs), local area networks (LANs), wide area networks (WANs), IEEE 802.1x, intranets, the Internet, extranets, and combinations thereof. The network may also include a digital cellular telephone network, which may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), CdmaOne, CDMA2000, Evolution-Data Optimized (EV-DO), Enhanced Data Rates for GSM Evolution (EDGE), Universal Mobile Telecommunications System (UMTS), Digital Enhanced Cordless Telecommunications (DECT), Digital AMPS (IS-136 / TDMA), Integrated Digital Enhanced Network (iDEN), WiMAX, LTE, LTE advanced, Mobile Broadband Wireless Access (MBWA), IEEE 802.20. The network may be public access, private, virtual private such as VPN.

[0036] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other without conflict.

[0037] Figure 1 A system topology diagram for performing multi-terminal display and control on a signal source according to some embodiments of the present invention is shown.

[0038] The signal source 11 includes two graphics cards, and the system includes a screen splitter (not shown), an instruction forwarding processor 12, a control center 13, an interface acquisition box 14, a terminal 1 and a terminal 2.

[0039] The screen splitter is connected to the first graphics card output end of the signal source 11, and is used to receive the video interface output by the first graphics card and divide it into two parts, and output the first video interface to the terminal 1 through the video line, and output the second video interface to the interface acquisition box 14 through the video line.

[0040] In this application, the video interface is just the content corresponding to a display screen, not corresponding to an underlying data file. For example, when we open a word, the screen displayed on the graphics card is called the video interface, and the word document itself is the underlying data.

[0041] The dividing into two parts includes dividing into two identical parts or two different parts, for example, two completely identical parts, or two complementary parts.

[0042] The interface acquisition box 14 is used to receive the second video interface and encode it into a network stream signal.

[0043] The control center 13 is connected to another graphics card output terminal of the signal source 11 via a video cable (such as an HDMI cable) to obtain a video interface output by the graphics card, and the interface output by the graphics card includes a video interface that is the same as or different from the aforementioned first video interface. According to some embodiments of the present invention, the video interface output by the graphics card includes a video interface that is the same as or different from the aforementioned second video interface.

[0044] The control center also obtains the network stream signal of the interface acquisition box 14 through the network (for example, the illustrated switch 16 or through an additional server), and outputs the network stream signal to the terminal 2, for example, outputs the network stream signal to the terminal 2 through a network cable, and the terminal 2 can be, for example, a network projector, which has the function of decoding and displaying the network stream signal. According to some embodiments of the present invention, the control center can also decode and display the network stream signal.

[0045] The control center is also used to receive external input control instructions (such as input from the keyboard and mouse 17 shown in the figure), and convert the control instructions into control instructions corresponding to the signal source 11 space, and send the converted control instructions to the instruction forwarding processor through the network.

[0046] The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the signal source 11 through the USB line; the signal source responds according to the control instruction. According to some embodiments of the present invention, the instruction forwarding processor may include an instruction service box, an instruction output box, and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and unidirectionally transmit the converted control instruction to the instruction output box, and the instruction output box sends the control instruction to the signal source through the USB line. The unidirectional transmission device can be, for example, a unidirectional serial port line, and the instruction service box converts the control instruction into a form suitable for transmission by the unidirectional serial port line, and unidirectionally transmits the converted control instruction to the instruction output box through the unidirectional serial port line.

[0047] According to some embodiments of the present invention, the control center can also converge all video interfaces according to an interface convergence method, for example, the video interface obtained from the second graphics card output terminal of the signal source 11 and the video interface obtained from the first interface acquisition box are converged, and each interface is displayed in a certain manner at different positions on the screen. When there is keyboard and mouse input, the control center receives the control instruction, determines the position of the control instruction according to the mouse action position indicated by the control instruction and the interface convergence method, and converts the control instruction into a control instruction corresponding to the signal source space according to the action position, and sends the converted control instruction to the instruction forwarding processor through the network, and the instruction forwarding processor receives the control instruction through the network and sends the control instruction to the signal source through the USB line.

[0048] Terminal 1 is used to receive the first video interface from the screen splitter and output it for display; Terminal 2 is used to receive the network stream signal and decode it for display. According to some embodiments of the present invention, the system may also include more terminals, and the control center decodes the network stream signal obtained through the network and sends it to each terminal through each video line.

[0049] Since the decoded image will occupy a large amount of space, in order to save resources, the present invention further proposes that the control center sets a counter value for each decoded image, and the counter value corresponds to the number of times the image needs to be played on each terminal, for example, how many terminals need the image; the control center monitors the acquisition of each image by each terminal, and when the image is acquired once by one of the terminals, the counter value corresponding to the image is reduced by 1; when the control center determines that the counter value is 0, the memory resources occupied by the image with the counter value of 0 are recycled. This will be further explained below.

[0050] Figure 2 A system topology diagram for performing multi-terminal display and control of two signal sources according to some embodiments of the present invention is shown.

[0051] and Figure 1 The difference is, Figure 2 Further comprising a signal source 22, the signal source 22 comprises two graphics cards, the system further comprises a second screen splitter (not shown), an interface acquisition box 15, a terminal 3 and a terminal 4;

[0052] The second screen splitter is connected to the first graphics card output end of the signal source 22, and is used to receive the video interface output by the first graphics card of the second signal source, and divide it into two parts, and output the first video interface to the terminal 3 through the video line, and output the second video interface to the interface acquisition box 15 through the video line.

[0053] The interface acquisition box 15 is used to receive the second video interface and encode it into a second network stream signal.

[0054] The control center is also used to connect the second graphics card output terminal of the signal source 22 through a video line to obtain the video interface output by the second graphics card; the control center also obtains the second network flow signal of the second interface acquisition box through the network (to distinguish the previous Figure 1 ), and output the second network stream signal to the terminal 4. According to some embodiments of the present invention, the control center may also decode and display the network stream signal.

[0055] The control center is also used to receive external input control instructions, and convert the control instructions into control instructions corresponding to the target signal source space corresponding to the control instructions, and send the converted control instructions to the instruction forwarding processor through the network.

[0056] The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the target signal source through the USB line.

[0057] Terminal 3 is used for receiving the first video interface from the second screen splitter and outputting it for display;

[0058] Terminal 4 is used to receive the second network stream signal, and decode and display it.

[0059] According to some embodiments of the present invention, the system may further include more terminals, and the control center sends each network stream signal to each terminal through the network or a network cable, and each terminal decodes and displays the network stream signal.

[0060] According to some embodiments of the present invention, the system may further include more terminals, and the control center decodes each network stream signal and sends it to each terminal through each video line.

[0061] According to some embodiments of the present invention, the control center also converges all video interfaces according to an interface convergence method, and receives external input control instructions, determines the position of the control instruction according to the mouse action position indicated by the control instruction and the interface convergence method, and determines the target signal source according to the action position, and converts the control instruction into a control instruction corresponding to the target signal source space, and sends the converted control instruction to the instruction forwarding processor through the network, the instruction forwarding processor receives the control instruction through the network, and sends the control instruction to the target signal source through the USB cable.

[0062] According to some embodiments of the present invention, the instruction forwarding processor includes an instruction service box, an instruction output box, and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and transmit the converted control instruction unidirectionally to the instruction output box, and the instruction output box sends the control instruction via a USB line to the target signal source corresponding to the control instruction.

[0063] For the above mentioned Figure 1 and Figure 2 In the described embodiment, the control center can also receive an input upper screen switching instruction, and according to the target terminal and target video interface corresponding to the upper screen switching instruction, output the target video interface to the target terminal through a video cable or send the network stream signal corresponding to the target video interface to the target terminal through a network or a network cable. For example, when the upper screen switching instruction indicates that the video interface of the signal source 1 output by the first graphics card to the interface acquisition box 14 is to be displayed on other network terminals (such as a network projector), the control center sends the network stream signal originally obtained from the interface acquisition box 14 to the target terminal (for example, through a network cable). For another example, when the upper screen switching instruction indicates that the video interface output by the second graphics card of the signal source 1 is to be displayed on other terminals connected to the control center via video cables, the control center sends the video interface directly to other terminals.

[0064] According to some further embodiments of the present invention, when the upper screen switching instruction indicates that the video interface output by the second graphics card of signal source 1 is to be displayed on other terminals connected to the control center via a network or a network cable, the control center compares the video interface corresponding to the network stream signal (output by the first graphics card through a screen splitter and captured by an interface capture box and then encoded) and the video interface output by the second graphics card, and when it is determined that the contents are the same (for example, a video interface range parameter can be added to the output content), the network stream signal is sent to the target terminal, thereby eliminating the need to encode the video interface output by the second graphics card of signal source 1.

[0065] The control center can also be used to receive input upper screen switching instructions. When the upper screen switching instructions instruct to send each network stream signal to a terminal connected to the control center via a video cable, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the content is the same, the video interface output by the second graphics card is sent to the sixth terminal, thereby avoiding decoding of the network stream signal.

[0066] Through the above method, fast on-screen display and switching of each signal source to each terminal can be achieved.

[0067] Since the above-mentioned embodiments of the present invention may involve many terminals, each terminal may want to play the same picture, so the control center will decode the same picture multiple times for different terminals to obtain. Since the decoded picture will occupy a large amount of space, in order to save resources, the present invention further proposes that the control center sets a counter value for each decoded image, and the counter value corresponds to the number of times the image needs to be played on each terminal, for example, how many terminals need the image; the control center monitors the acquisition of each image by each terminal, and when the image is acquired once by one of the terminals, the counter value corresponding to the image is reduced by 1; when the control center determines that the counter value is 0, the memory resources occupied by the image with the counter value of 0 are recovered.

[0068] Furthermore, the control center sets a counter value for each decoded image, including designing a data structure to bind a counter to the image data. After the image is decoded, the counter of the image is set to the number of times the image is needed, for example, how many terminals need the image.

[0069] According to some embodiments of the present invention, the existing terminal window for playing the image can be closed at any time or a new terminal can be opened to play the image. Therefore, the number of playbacks can be real-time and dynamic, and the counter value can also be real-time and dynamic. The counter value can be adjusted by real-time monitoring of the number of terminals that need to use the image.

[0070] The control center monitors the situation of each image being acquired by the terminal, and each time an image is acquired, the counter value corresponding to the image is reduced by 1. When it is determined that the counter value is 0, the memory resources occupied by the image with the counter value of 0 are recovered.

[0071] Reclaiming the memory resources occupied by the image whose counter value is 0 includes putting it in the modifiable queue.

[0072] When the counter value is 0, it means that no terminal will use this image. The memory resources occupied by the image with a counter value of 0 can be recovered and reused the next time the frame is decoded, thereby saving memory resources in real time.

[0073] This can avoid the large amount of computing resource waste and memory consumption that occurs when the same video is decoded or copied multiple times in the prior art, thereby greatly saving computing resources and memory resources.

[0074] Video stream decoding and related processes may include (such as Figure 3 shown):

[0075] S1, first initialize a fixed number of image instances into the available list;

[0076] S2, decode video frames;

[0077] S3, take an image object from the available list;

[0078] S4, storing the video frame data into the image object;

[0079] S5, set the counter value;

[0080] S6, determine whether the playback is finished; if yes, go to S7, if not, go to S1;

[0081] S7, end the decoding process.

[0082] The end of playing means that all terminals no longer need to play the image.

[0083] The fixed number of image instances can be determined based on empirical values, and is related to computer decoding and image playback speed, etc. The counter value is set to the number of times the image is needed, as described above.

[0084] The present application also proposes a method for performing multi-terminal control on a signal source based on the system of some embodiments of the present invention.

[0085] like Figure 1 As shown, the system includes a screen splitter (not shown), an instruction forwarding processor 12, a control center 13, an interface acquisition box 14, a terminal 1 and a terminal 2. The signal source 11 includes two graphics cards, the screen splitter is connected to the output end of the first graphics card of the signal source 11, receives the video interface output by the first graphics card, divides it into two parts, and outputs the first video interface to the terminal 1 through a video line, and outputs the second video interface to the interface acquisition box 14 through a video line. The interface acquisition box 14 receives the second video interface and encodes it into a network stream signal. The control center is connected to the output end of the second graphics card of the signal source through a video line to obtain the video interface output by the second graphics card; the control center also obtains the network stream signal of the interface acquisition box 14 through the network, and outputs the network stream signal to the terminal 2. Terminal 1 receives the first video interface from the screen splitter and outputs it for display; terminal 2 receives the first network stream signal, and decodes and displays it. According to some embodiments of the present invention, the control center can also decode and display the network stream signal.

[0086] The above components can be further referred to above Figure 1 When the user inputs a control instruction through keyboard and mouse operation at the control center, the system executes a method for multi-terminal control of a signal source, the method comprising:

[0087] S1. The control center receives the control instruction, converts the control instruction into a control instruction corresponding to the signal source space, and sends the converted control instruction to the instruction forwarding processor through the network;

[0088] According to some embodiments of the present invention, the control center also decodes the network stream signal to obtain the second video interface, and the control center also aggregates all video interfaces according to an interface aggregation method. In this case, the control center receives an external input control instruction, determines the position of the control instruction according to the mouse action position indicated by the control instruction and the interface aggregation method, and converts the control instruction into a control instruction corresponding to the signal source space according to the action position, and sends the converted control instruction to the instruction forwarding processor through the network.

[0089] S2. The instruction forwarding processor receives the control instruction through the network and sends the control instruction to the signal source via the USB line;

[0090] S3. The signal source responds according to the control instruction.

[0091] When the signal source responds according to the instruction, the parts related to the signal source displayed on each terminal will change accordingly.

[0092] The present application also proposes a method for performing multi-terminal control on two signal sources based on a system of other embodiments of the present invention.

[0093] like Figure 2 As shown, the system is relatively Figure 1 It further includes a signal source 22, which includes two graphics cards. The system also includes a second screen splitter (not shown), an interface acquisition box 15, a terminal 3 and a terminal 4; the second screen splitter is connected to the output terminal of the first graphics card of the signal source 22, receives the video interface output by the first graphics card of the second signal source, and divides it into two parts, and outputs the first video interface to the terminal 3 through a video line, and outputs the second video interface to the interface acquisition box 15 through a video line. The interface acquisition box 15 receives the second video interface and encodes it into a second network stream signal. The control center is connected to the output terminal of the second graphics card of the signal source 22 via a video line to obtain the video interface output by the second graphics card; the control center also obtains the second network stream signal of the second interface acquisition box through the network (to distinguish the previous Figure 1 The control center receives the first video interface from the second screen splitter and outputs it for display; the control center receives the second network stream signal and decodes and displays it. According to some embodiments of the present invention, the control center may also decode and display the second network stream signal.

[0094] The above components can be further referred to above Figure 2 When the user inputs a control instruction through keyboard and mouse operation at the control center, the system executes a method for multi-terminal control of two signal sources, the method comprising:

[0095] S21. The control center receives an external input control instruction, and converts the control instruction into a control instruction corresponding to a target signal source space corresponding to the control instruction, and sends the converted control instruction to the instruction forwarding processor via a network;

[0096] According to some embodiments of the present invention, the control center decodes each network stream signal to obtain the second video interface, and the control center also aggregates all video interfaces according to an interface aggregation method. In this case, an external input control instruction is received, and the position of the control instruction is determined according to the mouse action position and the interface aggregation method indicated by the control instruction, and the target signal source is determined according to the action position, and the control instruction is converted into a control instruction corresponding to the target signal source space, and the converted control instruction is sent to the instruction forwarding processor through the network.

[0097] S22. The instruction forwarding processor receives the control instruction through the network and sends the control instruction to the target signal source via the USB line;

[0098] S23. The target signal source responds according to the control instruction.

[0099] When the target signal source responds according to the instruction, the part related to the target signal source displayed on each terminal will change accordingly.

[0100] For the above method embodiment, the control center can also receive an input upper screen switching instruction, and according to the target terminal and target video interface corresponding to the upper screen switching instruction, output the target video interface to the target terminal through a video cable or send the network stream signal corresponding to the target video interface to the target terminal through a network or a network cable. For example, when the upper screen switching instruction indicates that the video interface of the signal source 1 output by the first graphics card to the interface acquisition box 14 is to be displayed on other network terminals (such as a network projector), the control center sends the network stream signal originally obtained from the interface acquisition box 14 to the target terminal (for example, through a network cable). For another example, when the upper screen switching instruction indicates that the video interface output by the second graphics card of the signal source 1 is to be displayed on other terminals connected to the control center via video cables, the control center sends the video interface directly to other terminals.

[0101] According to some further embodiments of the present invention, when the upper screen switching instruction indicates that the video interface output by the second graphics card of signal source 1 is to be displayed on other terminals connected to the control center via a network or a network cable, the control center compares the video interface corresponding to the network stream signal (output by the first graphics card through a screen splitter and captured by an interface capture box and then encoded) and the video interface output by the second graphics card, and when it is determined that the contents are the same (for example, a video interface range parameter can be added to the output content), the network stream signal is sent to the target terminal, thereby eliminating the need to encode the video interface output by the second graphics card of signal source 1.

[0102] The control center can also be used to receive input upper screen switching instructions. When the upper screen switching instructions indicate that each network stream signal is sent to the sixth terminal, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the content is the same, the video interface output by the second graphics card is sent to the sixth terminal, thereby avoiding decoding of the network stream signal.

[0103] Through the above method, rapid on-screen display and switching of each signal to each terminal can be achieved.

[0104] Since the above-mentioned embodiments of the present invention may involve many terminals, each terminal may want to play the same picture, so the control center will decode the same picture multiple times for different terminals to obtain. Since the decoded picture will occupy a large amount of space, in order to save resources, the present invention further proposes that the control center sets a counter value for each decoded image, and the counter value corresponds to the number of times the image needs to be played on each terminal, for example, how many terminals need the image; the control center monitors the acquisition of each image by each terminal, and when the image is acquired once by one of the terminals, the counter value corresponding to the image is reduced by 1; when the control center determines that the counter value is 0, the memory resources occupied by the image with the counter value of 0 are recovered. This has been specifically described above and will not be repeated here.

[0105] Previous reference Figure 1-3 The corresponding detailed description is incorporated herein by reference and will not be repeated here.

[0106] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A system for multi-terminal display and control of a signal source, wherein: The signal source includes a first signal source, the first signal source includes two graphics cards, and the system includes a first screen splitter, a first interface acquisition box, a control center, an instruction forwarding processor, a first terminal and a second terminal; The first screen splitter is connected to the output terminal of the first graphics card of the first signal source, and is used to receive the video interface output by the first graphics card, and divide it into two parts, and output the first video interface to the first terminal through the video line, and output the second video interface to the first interface acquisition box through the video line; The first interface capture box is used to receive the second video interface and encode it into a first network stream signal; The control center is used to connect the second graphics card output terminal of the first signal source through a video line to obtain the video interface output by the second graphics card; the control center also obtains the first network stream signal of the first interface acquisition box through the network, and outputs the first network stream signal to the second terminal; The control center is also used to receive control instructions input from the outside, and convert the control instructions into control instructions corresponding to the first signal source space, and send the converted control instructions to the instruction forwarding processor through the network; The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the first signal source through the USB line; The first terminal is used to receive the first video interface from the first screen splitter and output it for display; The second terminal is used to receive the first network stream signal, and decode and display it; The control center also decodes the first network stream signal to obtain the second video interface, and aggregates all video interfaces according to an interface aggregation method, and receives external input control instructions, determines the position of the control instruction according to the mouse action position and interface aggregation method indicated by the control instruction, and converts the control instruction into a control instruction corresponding to the signal source space according to the action position, and sends the converted control instruction to the instruction forwarding processor through the network, the instruction forwarding processor receives the control instruction through the network, and sends the control instruction to the first signal source through the USB cable.

2. The system according to claim 1, wherein the signal source further comprises a second signal source, the second signal source comprises two graphics cards, and the system further comprises a second screen splitter, a second interface acquisition box, a third terminal and a fourth terminal; The second screen splitter is connected to the output terminal of the first graphics card of the second signal source, and is used to receive the video interface output by the first graphics card of the second signal source, and divide it into two parts, and output the first video interface to the third terminal through the video line, and output the second video interface to the second interface acquisition box through the video line; The second interface acquisition box is used to receive the second video interface and encode it into a second network stream signal; The control center is also used to connect to the second graphics card output terminal of the second signal source through a video cable to obtain the video interface output by the second graphics card; the control center also obtains the second network stream signal of the second interface acquisition box through the network, and outputs the second network stream signal to the fourth terminal; The control center is also used to receive control instructions input from the outside, and convert the control instructions into control instructions corresponding to the target signal source space corresponding to the control instructions, and send the converted control instructions to the instruction forwarding processor through the network; The instruction forwarding processor is used to receive the control instruction through the network, and send the control instruction to the target signal source through the USB line; The third terminal is used to receive the first video interface from the second screen splitter and output it for display; The fourth terminal is used to receive the second network stream signal, and decode and display it.

3. According to the system of claim 2, the control center decodes each network stream signal to obtain the second video interface, and the control center also converges all video interfaces according to an interface convergence method, and receives external input control instructions, determines the position of the control instruction according to the mouse action position indicated by the control instruction and the interface convergence method, and determines the target signal source according to the action position, and converts the control instruction into a control instruction corresponding to the target signal source space, and sends the converted control instruction to the instruction forwarding processor through the network, the instruction forwarding processor receives the control instruction through the network, and sends the control instruction to the target signal source through the USB cable.

4. According to the system of claim 1 or 2, the dividing into two parts includes dividing into two identical parts or two different parts; the video interface output by the second graphics card includes a video interface that is the same as or different from the first video interface.

5. The system according to claim 1 or 2, wherein the video interface output by the second graphics card comprises a video interface that is the same as or different from the second video interface.

6. The system according to claim 1 or 2 further includes m fifth terminals, and the control center sends each network stream signal to each fifth terminal through the network or network cable, and each fifth terminal decodes and displays each network stream signal; and / or, further includes n sixth terminals, and the control center decodes each network stream signal and sends it to each sixth terminal through each video cable, or sends the second video interface to each sixth terminal.

7. According to the system described in claim 1 or 2, the control center receives the input upper screen switching instruction, and according to the target terminal and target video interface corresponding to the upper screen switching instruction, outputs the target video interface to the target terminal through the video cable or sends the network stream signal corresponding to the target video interface to the target terminal through the network or network cable.

8. According to the system of claim 6, the control center is used to receive an input upper screen switching instruction. When the upper screen switching instruction indicates that the video interface output by the second graphics card of each signal source is sent to the fifth terminal through the network or network cable, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the contents are the same, the network stream signal is sent to the fifth terminal.

9. According to the system of claim 6, the control center is used to receive an input upper screen switching instruction. When the upper screen switching instruction indicates that each network stream signal is sent to the sixth terminal, the control center compares the video interface corresponding to the network stream signal and the video interface output by the second graphics card. When it is determined that the contents are the same, the video interface output by the second graphics card is sent to the sixth terminal.

10. According to the system of claim 1, the instruction forwarding processor includes an instruction service box, an instruction output box and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and unidirectionally transmit the converted control instruction to the instruction output box, and the instruction output box sends the control instruction to the first signal source via a USB line.

11. According to the system of claim 2, the instruction forwarding processor includes an instruction service box, an instruction output box and a unidirectional transmission device connected between the instruction service box and the instruction output box; the instruction service box is used to receive the control instruction and convert it into a form suitable for transmission by the unidirectional transmission device, and unidirectionally transmit the converted control instruction to the instruction output box, and the instruction output box sends the control instruction to the target signal source corresponding to the control instruction via a USB line.

12. According to the system of claim 6, the control center sets a counter value for each decoded image, and the counter value corresponds to the number of times the image needs to be played on each terminal; the control center monitors the acquisition of each image by each terminal, and when the image is acquired once by one of the terminals, the counter value corresponding to the image is reduced by 1; when the control center determines that the counter value is 0, the memory resources occupied by the image with a counter value of 0 are recovered.

Images