Track-combining display system supporting multi-window independent touch control and working method of track-combining display system

Abstract

The invention discloses a track combining display system supporting multi-window independent touch control and a working method of the track combining display system, and belongs to the technical field of man-machine interaction. The system comprises a key control module, a mainboard, a display screen, a touch screen and a touch control module. The input end of the mainboard is connected with the key control module and the computers and receives a window mode switching instruction and an original video signal, the output end of the mainboard is connected with the display screen and the touch control module, corresponding video signals are selected according to the instruction and spliced into a target window picture according to a preset rule, and the display screen is driven to independently display in different areas. And the touch control module dynamically divides the touch screen into independent touch partitions aligned with display picture pixels according to the touch partition configuration instruction, analyzes the partition to which the touch event belongs, and transmits the touch data to the associated computer through the corresponding communication link. And the computer updates the video signal and transmits the video signal back to the mainboard to drive the display screen to update the corresponding window content in real time. According to the invention, multi-window synchronous independent touch control is supported, and efficient multi-task interaction in a complex scene is realized.

Description

Technical Field

[0001] The present invention relates to a parallel display system supporting multi-window independent touch and a working method thereof, belonging to the technical field of human-computer interaction. Background Art

[0002] With the rapid development of information technology, users are placing higher demands on the multitasking capabilities and interactivity of display devices. While existing dual-panel displays can display multiple windows on a single screen, they typically only support single-window interaction via touch, limiting user experience and efficiency. Therefore, there is an urgent need to develop a dual-panel display system and operating method that can support touch operation of multiple windows in multi-window mode. Summary of the Invention

[0003] The purpose of the present invention is to provide a parallel display system and a working method thereof that support independent touch of multiple windows, aiming to break through the limitations of existing parallel displays in touch operations and realize simultaneous touch operations of multiple windows, thereby enabling more efficient multi-tasking and information interaction.

[0004] In order to solve the above technical problems, the present invention is implemented by adopting the following technical solutions: In one aspect, the present invention provides a parallel display system supporting multi-window independent touch control, which includes: a key control module, a main board, a display screen, a touch screen, and a touch control module; The signal input end of the mainboard is respectively connected to the key control module and multiple computers; the key control module is used to send the user-triggered window mode switching instruction to the mainboard; the computer is used to output the original video input signal to the mainboard; The signal output terminal of the mainboard is respectively connected to the display screen and the touch control module; the mainboard selects the original video input signal of the corresponding computer according to the window mode switching instruction and splices it into the target window image according to the preset layout rules, thereby driving the display screen to independently display the target window image in different areas; the mainboard sends the touch zone configuration instruction corresponding to the current target window image of the display screen to the touch control module, and the touch zone configuration instruction includes the boundary coordinates of each touch zone and the independent communication link bound to each touch zone; The touch control module is in bidirectional communication with the touch screen, and is used to dynamically divide the touch screen into independent touch zones aligned with the pixels of the current target window image of the display screen according to the touch zone configuration instructions, and is used to receive touch data generated by touch events on the touch screen, and parse the touch zone to which the touch event belongs based on the boundary coordinates, and then send the touch data based on the parsed touch zone to the corresponding computer via a corresponding independent communication link; When the computer receives touch data, it updates the original video input signal according to the touch data and transmits the updated video input signal to the motherboard. The motherboard drives the display to update the display in the window of the corresponding touch partition, realizing a real-time linkage closed loop between touch operation and display screen.

[0005] Optionally, the touch data includes: touch coordinate data, touch force data, touch area data, multi-touch data and timestamp data.

[0006] Optionally, the touch coordinate data is a two-dimensional coordinate position corresponding to a user's touch operation on the touch screen surface, and is used to determine a touch zone to which the touch event belongs.

[0007] Optionally, the independent communication link is a USB independent communication link.

[0008] Optionally, if the window mode switching instruction triggered by the user is a full-screen single-window mode switching instruction: According to the full-screen single-window mode switching instruction, the motherboard selects the original video input signal of a computer from the currently connected multiple computers, and splices it into a full-screen single-window image according to the preset layout rules, and then drives the display to independently display the full-screen single-window image in the entire area; The mainboard also sends a touch partition configuration instruction corresponding to the current full-screen single-window image of the display screen to the touch control module, instructing the touch control module to configure the touch screen into an independent touch partition aligned with the pixels of the current full-screen single-window image of the display screen, and to bind the independent touch partition to the corresponding selected computer through an independent communication link; The selected computer realizes a real-time closed-loop linkage between touch operation and display screen; other computers are temporarily disconnected from the interactive link until the window mode is switched again.

[0009] Optionally, if the window mode switching instruction triggered by the user is a two-split screen multi-window mode switching instruction: According to the two-split-screen multi-window mode switching instruction, the motherboard selects the original video input signals of two computers from the currently connected multiple computers, and splices them into a two-split-screen multi-window image according to the preset layout rules, and then drives the display to display the two-split-screen multi-window image independently in different areas; The motherboard also sends a touch partition configuration instruction corresponding to the current two-split screen multi-window image on the display screen to the touch control module, instructing the touch control module to configure the touch screen into two independent touch partitions aligned with the pixels of the current two-split screen multi-window image on the display screen, and to bind the two independent touch partitions to the corresponding selected computers through independent communication links. The selected computers realize a real-time closed-loop linkage between touch operation and display screen; other computers are temporarily disconnected from the interactive link until the window mode is switched again.

[0010] Optionally, the two-split screen multi-window picture includes: a left-right two-split screen multi-window picture, a top-bottom two-split screen multi-window picture and a picture-in-picture two-split screen multi-window picture.

[0011] Optionally, the left and right split-screen multi-window picture is set so that the two windows on the display screen evenly occupy the left and right areas of the display screen respectively; the top and bottom split-screen multi-window picture is set so that the two windows on the display screen evenly occupy the upper and lower areas of the display screen respectively; the picture-in-picture split-screen multi-window picture is set so that the main window on the display screen occupies the full screen area of the display screen, and the secondary window is superimposed on a corner area of the display screen.

[0012] Optionally, if the window mode switching instruction triggered by the user is a three-screen multi-window mode switching instruction: According to the three-screen multi-window mode switching instruction, the motherboard selects the original video input signals of three computers from the currently connected computers, and splices them into a three-screen multi-window image according to the preset layout rules, and then drives the display to display the three-screen multi-window image independently in different areas; The motherboard also sends a touch zone configuration instruction corresponding to the current three-part multi-window image on the display screen to the touch control module, instructing the touch control module to configure the touch screen into three independent touch zones aligned with the pixels of the current three-part multi-window image on the display screen, and to bind the three independent touch zones to the corresponding selected computers through independent communication links. The selected computers realize a real-time closed-loop linkage between touch operation and display screen; other computers are temporarily disconnected from the interactive link until the window mode is switched again.

[0013] Optionally, the three-part screen multi-window picture includes: a left-two-right split screen multi-window picture and a left-one-right-two split screen multi-window picture.

[0014] Optionally, the two-left-one-right split-screen multi-window image is set as follows: the three windows on the display screen are first arranged in a two-left-one-right manner to evenly occupy the left and right areas of the display screen in the horizontal direction, and the two windows in the left area then evenly occupy the upper and lower areas of the left area in the vertical direction; In the "Left-one-right-two" split-screen multi-window setting, the three windows on the display are evenly spaced horizontally on the left and right areas of the display. The two windows in the right area then evenly space the upper and lower areas of the right area vertically. Optionally, if the window mode switching instruction triggered by the user is a four-screen multi-window mode switching instruction: According to the four-split screen multi-window mode switching instruction, the motherboard selects the original video input signals of four computers from the currently connected multiple computers, and splices them into a four-split screen multi-window image according to the preset layout rules, and then drives the display to display the four-split screen multi-window image independently in different areas; The motherboard also sends a touch partition configuration instruction corresponding to the current four-split screen multi-window image of the display to the touch control module, instructing the touch control module to configure the touch screen into four independent touch partitions aligned with the pixels of the current four-split screen multi-window image of the display, and to bind the four independent touch partitions to the corresponding selected computers to complete independent communication links; The selected computers realize a real-time closed-loop linkage between touch operation and display screen; other computers are temporarily disconnected from the interactive link until the window mode is switched again.

[0015] Optionally, the four-split screen multi-window picture includes: a 2×2 grid-shaped split screen multi-window picture.

[0016] Optionally, the 2×2 grid-shaped split-screen multi-window image is set so that four windows on the display screen evenly occupy the entire screen area.

[0017] In a second aspect, the present invention further provides a working method applicable to the multi-window independent touch-supporting parallel display system described in the first aspect, comprising: After a user triggers a window mode switching command via the key control module, the key control module sends the window mode switching command to the motherboard, and at least one computer outputs an original video input signal to the motherboard; the motherboard selects the original video signal of the corresponding computer according to the window mode switching command and splices it into a target window image according to a preset layout rule, thereby driving the display screen to independently display the target window image in different areas; The mainboard sends a touch zone configuration instruction corresponding to the current target window image of the display screen to the touch control module. The touch zone configuration instruction includes the boundary coordinates of each touch zone and the independent communication link bound to each touch zone. The touch control module dynamically divides the touch screen into independent touch zones aligned with the pixels of the current target window image of the display screen according to the touch zone configuration instruction. The touch control module receives touch data generated by touch events on the touch screen, and parses the touch partition to which the touch event belongs based on the boundary coordinates, and then sends the touch data to the corresponding computer through the corresponding independent communication link based on the analyzed touch partition; when the computer receives the touch data, it updates the original video input signal according to the touch data, and transmits the updated video input signal to the main board, which drives the display screen to update the display in the window of the corresponding touch partition, realizing a real-time linkage closed loop between touch operation and display screen.

[0018] Compared with the prior art, the present invention has the following beneficial effects: The present invention breaks through the single-window touch limitation of traditional parallel displays and supports independent touch operations of multiple windows in multi-window mode. Users can manipulate the contents of different windows in parallel, significantly improving the efficiency of multi-tasking parallel processing. At the same time, the present invention also ensures that the touch data of each window is accurately transmitted to the corresponding computer by dynamically dividing independent touch partitions aligned at the pixel level and binding independent communication links. In conjunction with the real-time video signal update mechanism, a closed-loop system that links touch operations with display images is constructed, significantly enhancing the information interaction capability between users and display systems. In addition, the present invention provides a variety of window mode switching instructions, including full-screen single-window mode, two-split-screen multi-window mode, three-screen multi-window mode and four-screen multi-window mode, etc. These modes can be flexibly switched according to user needs, thereby effectively meeting the user's multi-tasking processing needs in different scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 FIG2 is a schematic diagram showing the overall framework of the parallel display system supporting multi-window independent touch control according to the present invention; Figure 2 FIG2 is a schematic diagram showing the touch partition and link allocation in the full screen state according to an embodiment of the present invention; Figure 3 FIG2 is a schematic diagram showing touch partitions and link allocation in a two-screen state according to another embodiment of the present invention; Figure 4 FIG3 is a schematic diagram showing the touch partitions and link allocation in the three-part screen state according to the third embodiment of the present invention; Figure 5 FIG2 is a schematic diagram showing the touch partitions and link allocation in the four-split screen state according to the fourth embodiment of the present invention. DETAILED DESCRIPTION

[0020] The present invention will be further described below in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solutions of the present invention and are not intended to limit the scope of protection of the present invention.

[0021] Example 1 refer to Figure 1 This embodiment provides a parallel display system that supports multi-window independent touch, which includes: a key control module, a main board, a display screen, a touch screen and a touch control module.

[0022] The motherboard's signal input terminals are connected to the key control module and multiple computers. The key control module is used to send user-triggered window mode switching commands to the motherboard. Specifically, different window modes can be set by key operation of the OSD menu options. The computers are used to output the original video input signal to the motherboard.

[0023] The motherboard's signal output terminals are connected to the display and touch control module. Based on the window mode switching command, the motherboard selects the computer's original video input signal and stitches it into a target window according to preset layout rules. This in turn drives the display to display the target window independently in separate areas. The motherboard sends touch zone configuration instructions corresponding to the display's current target window to the touch control module. These instructions include the boundary coordinates of each touch zone and the independent communication link associated with each touch zone. The independent communication link can be a USB communication link.

[0024] The touch control module is connected to the touch screen in a two-way communication manner, and is used to dynamically divide the touch screen into independent touch partitions aligned with the pixels of the current target window image of the display screen according to the touch partition configuration instructions, and to receive touch data generated by touch events on the touch screen, and to parse the touch partition to which the touch event belongs according to the boundary coordinates, and then send the touch data based on the analyzed touch partition to the corresponding computer through the corresponding independent communication link.

[0025] It is worth noting that the aforementioned touch data includes, but is not limited to, touch coordinate data, touch force data, touch area data, multi-touch data, and timestamp data. In practical applications, a multi-dimensional touch data collection and analysis mechanism enables highly accurate human-computer interaction responses. Specifically, touch coordinate data, serving as a fundamental interaction parameter, captures the (X, Y) coordinates of the user's touch point on the screen in real time to precisely locate the touch zone to which the action target belongs, providing a spatial reference for all interactive behaviors. Touch force data quantifies the user's press intensity through the pressure sensing layer. On touchscreens that support force sensing, this data can be mapped into continuous control parameters, such as dynamically adjusting pen thickness or the trigger threshold of pressure-sensitive buttons in drawing applications, achieving a nonlinear mapping between force feedback intensity and action results. Touch area data detects the geometric dimensions of the contact area to assist in distinguishing input intent. For example, when a large contact area is detected, the system can identify a palm error and automatically block the operation, or recognize special gestures such as knuckle tapping to trigger shortcut functions, enhancing input tolerance. Multi-touch data uses a multi-touch trajectory tracking algorithm to simultaneously analyze the displacement vectors and relative positional relationships of each touch point. This supports real-time computation of compound gestures like pinch-to-zoom and three-finger rotation, ensuring high accuracy in gesture recognition for multi-tasking scenarios (e.g., zooming in multiple map windows or annotating multiple document regions). Timestamp data is used to construct a time series model of touch point motion by attaching a timing tag to each touch event. This model, combined with coordinate offsets, calculates dynamic features such as sliding velocity and acceleration. This allows for complex gestures such as sliding trajectory direction, double-click interval duration, and long-press duration threshold to be analyzed. Finally, a machine learning model converts the raw data into standardized system commands (e.g., swiping to turn pages, double-clicking to confirm, and long-pressing to invoke a menu).

[0026] In addition, the touch screen of this embodiment can be used with a specific laptop. This laptop with a touch screen function not only retains the advantages of a traditional keyboard and mouse, but also introduces the convenience and intuitiveness of smartphones and tablets, making daily computing tasks more efficient and interesting. The details are as follows: At the basic level, a single-finger click simulates the left mouse button to launch a file or program, a double-click continues the efficient opening logic of the desktop, and swiping breaks through the limitations of the physical scroll wheel, enabling stepless page scrolling and dynamic content loading through continuous finger movement. In the window management phase, dragging the window title bar and the edge zoom function map physical space operations to fingertip gestures, allowing users to complete window positioning and scale adjustment with one hand, combined with direct touch minimize / maximize / close buttons.

[0027] The introduction of multi-touch gestures further expands the interactive dimension: two-finger zooming achieves continuous, infinite zooming of images / documents by calculating the rate of change in the distance between the two fingers in real time. Combined with the circular motion vector analysis of the two-finger rotate gesture, the spatial angle of the object can be precisely controlled in 3D modeling or image editing scenarios. The left and right swipe gesture for turning pages in reading scenarios uses the horizontal displacement threshold of the touch points to achieve intelligent page turning in e-books / slides. In the field of text editing, the interactive design of long-pressing to trigger text selection and dragging a marker significantly improves the efficiency of accurately selecting large sections of text. The touch-based transformation of the context menu allows high-frequency operations such as cut / copy / paste to be completed with a simple single-finger hover-click process. The handwriting input function uses the pressure-sensing technology of electromagnetic pens or capacitive pens to achieve a natural mapping of handwriting thickness and transparency on the device. Some software also uses deep learning algorithms to convert handwriting into vector text in real time.

[0028] In terms of vertical application adaptation, drawing and design applications leverage deep collaboration with digital pen hardware to replicate the side-edge and pause effects of traditional brushes in tools like Photoshop, using tilt sensing to simulate brushstroke direction. In the gaming sector, multi-touch mapping of virtual joysticks and skill buttons enables quick, touch-based triggering of skill combos in games, reducing response latency compared to traditional keyboard operations. In educational settings, interactive whiteboards utilize multi-touch to enable simultaneous annotation by multiple users, integrating gesture recognition technology to automatically identify and identify symbols. System-level interaction innovations are also reflected in the edge swipe feature of the quick settings panel. Swiping inward from the right edge triggers the control center, enabling slider-style adjustments for parameters like Wi-Fi, Bluetooth, and screen brightness. Personalization features utilize a dynamic color rendering engine, allowing users to adjust hue parameters by dragging directly on the screen. This deep integration of hardware capabilities and software algorithms ultimately creates a touch-based interaction paradigm that covers all scenarios, including office, creative, and entertainment. Compared to traditional input devices, this reduces the learning curve for users while significantly improving the efficiency of complex operations.

[0029] When the computer receives touch data, it updates the original video input signal according to the touch data and transmits the updated video input signal to the motherboard. The motherboard drives the display to update the display in the window of the corresponding touch partition, realizing a real-time linkage closed loop between touch operation and display screen.

[0030] The specific implementation process of this embodiment in actual application is as follows: First, the system establishes raw video signal transmission channels with multiple external computers through the mainboard. Simultaneously, the mainboard establishes a control command transmission channel with the touch control module, and a bidirectional touch data channel is established between the touch control module and the touch screen, completing the initialization of the communication link. When the user triggers a window mode switch command through the key control module, the mainboard selects the raw video signal of the corresponding computer according to the window mode switch command. After synchronization processing and format conversion, the relevant raw video signals are spliced into the target window image according to preset layout rules. Based on the spliced target window image, the mainboard divides the physical display area of the display into multiple independent windows with pixel-level precision and drives the display to display the screen content of the corresponding computer in each window area. Simultaneously, the mainboard sends a touch zone configuration command corresponding to the current target window image on the display to the touch control module. This command contains the boundary coordinates of each touch zone and the independent communication link associated with each touch zone. Based on this touch zone configuration command, the touch control module dynamically divides the touch screen into independent touch zones aligned with the pixels of the current target window image on the display and loads the corresponding communication link for each zone to establish a logical mapping relationship with the target computer.

[0031] During the touch interaction phase, the touch screen collects touch data generated by touch events on the touch screen in real time, and analyzes the touch partition to which the touch event belongs based on the boundary coordinates. Then, based on the analyzed touch partition, the touch data is sent to the corresponding computer via the corresponding communication link. The computer updates the video output content based on the received touch data, and the motherboard obtains the updated video stream in real time, while driving the display screen to perform a local refresh display in the window area corresponding to the touch partition. During this process, the system can not only dynamically reconstruct the display layout and touch partition configuration according to the newly received window mode instructions, maintaining pixel-level synchronization alignment between the touch partition and the display window, but also ensure that multi-channel touch data does not interfere with each other through isolated transmission of independent communication links, ultimately realizing a real-time linkage closed loop of touch operation, screen update and visual feedback.

[0032] Example 2 Based on Example 1, this example focuses on the application scenario of the full-screen single-window mode and implements it in detail as follows: refer to Figure 2, this embodiment presents four full-screen single-window images under the full-screen single-window mode switching instruction, corresponding to numbers 1 to 4 respectively. When the user triggers the full-screen single-window mode switching instruction through a physical button or touch panel, the system first identifies the instruction parameters through the mode parsing unit on the mainboard. For example, if the user selects the "number 1" mode, the system automatically locks computer 1 among the four currently connected computers as the only signal source. At this time, the mainboard sends display parameters to computer 1, guiding it to output the corresponding video signal, and at the same time cuts off the link handshake signal with computers 2-4, so that it enters standby mode. The video processing unit built into the mainboard processes the received single-channel video stream, and finally transmits the uncompressed original picture to the display screen through the interface to realize full-screen full-area point-to-point display.

[0033] During the synchronous touch configuration process, the motherboard sends a touch zone configuration command corresponding to the display's current full-screen, single-window image to the touch control module, instructing it to configure the touch screen as an independent touch zone aligned with the pixels of the current full-screen, single-window image. The touch control module then activates its touch zone engine, setting the entire touchscreen's conductive layer as a unified sensing area and loading a coordinate mapping algorithm specific to Computer 1. When a user touches any location on the touchscreen, the raw coordinates captured by the capacitive sensor array are directly transmitted to Computer 1 via the USB1 link, eliminating the need for zone determination. For example, in an engineering design scenario, when a user performs a touch zoom operation on the AutoCAD interface, Computer 1's GPU immediately renders the updated vector graphics and transmits the image back to the motherboard via an interface in real time. The motherboard uses dynamic zone refresh technology to locally update only the display areas where pixels have changed. Only when the user switches back to multi-window mode does the system reestablish the full signal link and refresh the image.

[0034] Example 3 Based on Example 1, this example focuses on the application scenario of the two-split screen multi-window mode and implements it in detail as follows: refer to Figure 3 This embodiment presents three types of two-split-screen multi-window screens corresponding to the two-split-screen multi-window mode switching instruction, namely, the left-right two-split-screen multi-window screen, the top-bottom two-split-screen multi-window screen, and the picture-in-picture two-split-screen multi-window screen, and the corresponding numbers are set to 5 to 7. Among them, the left-right two-split-screen multi-window screen is set so that the two windows on the display screen occupy the left and right areas of the display screen respectively. The top-bottom two-split-screen multi-window screen is set so that the two windows on the display screen occupy the top and bottom areas of the display screen respectively; the picture-in-picture two-split-screen multi-window screen is set so that the main window on the display screen occupies the full screen area of the display screen, and the secondary window is superimposed on a corner area of the display screen.

[0035] When the user triggers the two-split-screen multi-window mode switching command through the physical button or touch panel (for example, select the left and right split-screen mode, corresponding to the number "5" mode), the motherboard identifies the command parameters through the mode parsing unit and selects Computer 1 and Computer 2 as the signal source from the four currently connected computers. At this time, the motherboard sends specific resolution parameters to Computer 1 and Computer 2 respectively, guiding the two computers to output video signals adapted to the split-screen layout, and suspends the link communication with Computer 3 and Computer 4. The video processing unit built into the motherboard adopts a pixel-level stitching algorithm to horizontally merge the signal of Computer 1 with the same resolution signal of Computer 2 into a composite picture, and transmits it to the display through the interface, and independently displays the original video stream in the left and right areas.

[0036] During the synchronous touch configuration process, the motherboard sends a touch partition configuration command to the touch control module, including the coordinate parameters for the left and right split screens and USB channel binding information (left area is bound to USB1, right area is bound to USB2). The touch control module immediately reconfigures its sensing layer logic and loads a dynamic coordinate mapping engine onto the touchscreen surface. When the user touches the left half of the screen, the raw coordinates captured by the capacitive sensor array are determined to belong to the left partition, and the touch data is then transmitted to Computer 1 via USB1. If the touch point is in the right partition, the touch data is sent to Computer 2 via USB2.

[0037] When the user switches to Picture-in-Picture mode, the system automatically sets the primary screen (e.g., Computer 1) to full-screen, and superimposes the secondary screen (e.g., Computer 2) in the upper left corner. The touchscreen generates a full-area touch zone for the primary screen and a sub-touch zone for the secondary screen. A dynamic weighting algorithm ensures touch priority in the overlapping areas. The video signals of other inactive computers remain in standby mode until the mode is switched again and they re-join the composite image.

[0038] Example 4 Based on Example 1, this example focuses on the application scenario of the three-screen multi-window mode and implements it in detail as follows: refer to Figure 3 , this embodiment presents two types of three-part multi-window screens under the three-part multi-window mode switching instruction, namely the left-two-right-one split-screen multi-window screen and the left-one-right-two split-screen multi-window screen, corresponding to numbers 8 and 9 respectively. Among them, the left-two-right-one split-screen multi-window screen is set as follows: the three windows on the display screen are first evenly occupied in the horizontal direction of the left and right areas of the display screen in the arrangement of left-two-right-one, and the two windows in the left area then evenly occupy the upper and lower areas of the left area in the vertical direction. The left-one-right-two split-screen multi-window screen is set as follows: the three windows on the display screen are first evenly occupied in the horizontal direction of the left and right areas of the display screen in the arrangement of left-one-right-two, and the two windows in the right area then evenly occupy the upper and lower areas of the right area in the vertical direction.

[0039] When the user triggers the three-screen multi-window mode switching command through the physical button or touch panel (for example, select the left-two-right-one split-screen mode numbered "8"), the motherboard identifies the command parameters through the mode parsing unit and selects Computer 1, Computer 2, and Computer 3 as the signal source from the four currently connected computers. At this time, the motherboard sends specific resolution parameters to Computer 1 and Computer 2 respectively, and sends specific resolution parameters to Computer 3, guiding the three computers to output video signals adapted to the split-screen layout, while suspending the link communication with Computer 4. The video processing unit built into the motherboard adopts a multi-level splicing algorithm. First, the signals of Computer 1 and Computer 2 are synthesized vertically into the left area picture, and then spliced with the signal of Computer 3 in the horizontal direction to form a total synthesized picture, which is transmitted to the display through the interface, and the original video stream is independently displayed in the upper and lower partitions of the left area and the right area.

[0040] During synchronous touch configuration, the motherboard sends coordinate parameters and USB channel binding information to the touch control module for three touch zones: the upper left zone (bound to USB1), the lower left zone (bound to USB2), and the entire right zone (bound to USB3). The touch control module activates the composite zone engine and loads dynamic coordinate mapping logic onto the touchscreen surface. When a user touches the upper left zone, the coordinates captured by the capacitive sensor are identified using an algorithm to determine the zone to which they belong. The coordinates are then scaled to the display range of Computer 1 and the touch data is transmitted to Computer 1 via USB1. If the touch point is in the right zone, the coordinates are converted to relative coordinates for Computer 3 and sent to Computer 3 via USB3.

[0041] When the user switches to the "9" split-screen mode (left-one, right-two), the system automatically adjusts the layout: Computer 1's output occupies the left half of the screen, while Computers 2 and 3's output signals appear in the upper and lower right half. The touchscreen then creates a full-area touch zone on the left (bound to USB 1) and two upper and lower touch zones on the right (bound to USB 2 and USB 3, respectively). Prioritization of the touch event queue ensures parallel processing of multi-channel data. The inactive Computer 4 video signal remains frozen until it rejoins the composite image when the mode is switched.

[0042] Example 5 Based on Example 1, this embodiment focuses on the application scenario of the four-split screen multi-window mode and implements it in detail as follows: refer to Figure 2 This embodiment presents a four-split-screen multi-window image under a four-split-screen multi-window mode switching instruction, specifically a 2×2 grid-shaped multi-window image. The 2×2 grid-shaped multi-window image is configured such that the four windows on the display screen evenly occupy the entire screen area, with each window corresponding to a quarter of the screen's display space.

[0043] When the user triggers the four-split screen multi-window mode switch command through the physical button or touch panel (for example, selecting the grid split screen mode numbered "10"), the motherboard identifies the command parameters through the mode parsing unit and selects Computer 1, Computer 2, Computer 3, and Computer 4 from the four currently connected computers as the signal source. At this time, the motherboard sends specific resolution parameters to each of the four computers, guiding each computer to output a video signal adapted to the quarter-screen layout. The motherboard's built-in video processing unit uses four-channel parallel processing technology to precisely align the upper left area signal of Computer 1, the upper right area signal of Computer 2, the lower left area signal of Computer 3, and the lower right area signal of Computer 4 through a four-quadrant pixel synchronization algorithm. The signals are spliced into a composite image and transmitted to the display through the interface, independently displaying the original video stream in the four quadrant partitions.

[0044] During synchronized touch configuration, the motherboard sends coordinate parameters and USB channel binding information for four touch zones to the touch control module: the upper left zone (bound to USB1), the upper right zone (bound to USB2), the lower left zone (bound to USB3), and the lower right zone (bound to USB4). The touch control module activates the grid partitioning engine, generating a crisscross pattern of transparent zone boundaries on the touchscreen surface and implementing multi-level coordinate mapping logic. When a user touches any sub-zone, the raw coordinates captured by the capacitive sensor array are determined by an algorithm to determine which zone they belong to. For example, if the touch point is in the upper right zone, the coordinates are converted to relative coordinates of Computer 2, and the touch data is transmitted to Computer 2 via USB2. If the touch point is in the lower left zone, the coordinates are converted to relative coordinates of Computer 3, and the touch data is transmitted to Computer 3 via USB3. All four computers maintain real-time video signal transmission, and touch data is completely isolated via independent communication links to ensure non-interference during multitasking.

[0045] Example 6 Based on the same technical concept, this embodiment provides a working method for a multi-window independent touch-enabled parallel display system applicable to any one of Embodiments 1 to 5, which includes the following steps: First, the user triggers a windowed mode switch command through the key control module. This can be done by pressing a physical button or through another input device (such as a remote control or voice control, depending on the system configuration). After receiving the user's action, the key control module sends the windowed mode switch command to the motherboard. At the same time, it ensures that multiple computers can output the original video input signals to the motherboard. These signals are the source of the content for each window to be displayed on the display.

[0046] Upon receiving a window mode switch command, the motherboard selects the corresponding computer's original video input signal based on the command content and splices it into the target window image according to preset layout rules. The target window image can be a single window image on the entire screen, a two-split multi-window image, a three-split multi-window image, or a four-split multi-window image. During this process, the motherboard ensures that each window image is accurately and clearly segmented and drives the display to independently display the computer image corresponding to each window in different areas. This allows users to view multiple different window contents on the display simultaneously.

[0047] Next, the motherboard sends a touch zone configuration command corresponding to the current target window to the touch control module. This command contains the boundary coordinates of each touch zone and the independent communication link associated with each touch zone. It tells the touch control module how to dynamically divide the touch screen into independent touch zones aligned with the pixels of the current target window on the display. After receiving the command, the touch control module divides the touch screen according to the command content, ensuring that each touch zone corresponds to a window on the display.

[0048] When a user performs a touch operation on the touchscreen, the touch control module receives the touch data and resolves the specific touch zone to which the touch belongs based on the previously received boundary coordinates. Through this analysis, the system can determine which window the user's touch operation was performed on. The touch control module then sends the touch data to the corresponding computer via a corresponding independent communication link. This allows the relevant computer to receive information about the user's touch operation in each corresponding touch zone.

[0049] After receiving the touch data, the computer updates the original video input signal based on the user's actions. This update process may include zooming, panning, rotating, and other operations, depending on the user's touch operation and the computer's application logic. The details are not detailed here. The updated video input signal is then transmitted back to the motherboard. Upon receiving the signal, the motherboard drives the display to update the display in the window corresponding to the touch zone. This allows the user to see their touch operations reflected and displayed in real time on the display.

[0050] During this operation, the system demonstrated a high degree of flexibility and stability: it was able to dynamically adjust the display layout and touch zone configuration in real time based on newly received window mode instructions, ensuring precise synchronization and alignment of the touch zones and the display window at the pixel level. At the same time, the system effectively ensured that multi-channel touch data did not interfere with each other through the isolated transmission mechanism of independent communication links, thereby successfully achieving a real-time linkage closed loop between touch operations, screen updates, and visual feedback. Overall, this real-time linkage mechanism not only enhances the user's interactive experience, but also significantly improves work efficiency and convenience.

[0051] In the description of this disclosure / application, it should be understood that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood broadly. For example, they can refer to fixed, removable, or integral connections; mechanical or electrical connections; direct or indirect connections through an intermediary; and internal communication between two components. Those skilled in the art will understand the specific meanings of these terms in this disclosure / application based on specific circumstances.

[0052] The above description is only a preferred embodiment of the present disclosure / application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present disclosure / application, and these improvements and modifications should also be regarded as the scope of protection of the present disclosure / application.

Claims

1. A multi-window independent touch-control and parallel display system, characterized in that: include: Key control module, main board, display screen, touch screen and touch control module; The signal input end of the mainboard is respectively connected to the key control module and multiple computers; the key control module is used to send the user-triggered window mode switching instruction to the mainboard; the computer is used to output the original video input signal to the mainboard; The signal output terminal of the mainboard is respectively connected to the display screen and the touch control module for communication; The motherboard selects the original video input signal of the corresponding computer according to the window mode switching instruction and splices it into the target window screen according to the preset layout rules, thereby driving the display screen to independently display the target window screen in different areas. The motherboard sends the touch zone configuration instruction corresponding to the current target window screen of the display screen to the touch control module. The touch zone configuration instruction includes the boundary coordinates of each touch zone and the independent communication link bound to each touch zone. The touch control module is in bidirectional communication with the touch screen, and is used to dynamically divide the touch screen into independent touch zones aligned with the pixels of the current target window image of the display screen according to the touch zone configuration instructions, and is used to receive touch data generated by touch events on the touch screen, and parse the touch zone to which the touch event belongs based on the boundary coordinates, and then send the touch data based on the parsed touch zone to the corresponding computer via a corresponding independent communication link; When the computer receives touch data, it updates the original video input signal according to the touch data and transmits the updated video input signal to the motherboard. The motherboard drives the display to update the display in the window of the corresponding touch partition, realizing a real-time linkage closed loop between touch operation and display screen.

2. The multi-window independent touch-enabled parallel display system according to claim 1, wherein: Touch data includes: touch coordinate data, touch force data, touch area data, multi-touch data and timestamp data; The touch coordinate data is a two-dimensional coordinate position corresponding to a user's touch operation on the touch screen surface, and is used to determine the touch zone to which the touch event belongs.

3. The multi-window independent touch-control capable parallel display system according to claim 1, wherein: The independent communication link is a USB independent communication link.

4. The multi-window independent touch-control capable parallel display system according to claim 1, wherein: If the window mode switching command triggered by the user is a full-screen single-window mode switching command: According to the full-screen single-window mode switching instruction, the motherboard selects the original video input signal of a computer from the currently connected multiple computers, and splices it into a full-screen single-window image according to the preset layout rules, and then drives the display to independently display the full-screen single-window image in the entire area; The mainboard also sends a touch partition configuration instruction corresponding to the current full-screen single-window image of the display screen to the touch control module, instructing the touch control module to configure the touch screen into an independent touch partition aligned with the pixels of the current full-screen single-window image of the display screen, and to bind the independent touch partition to the corresponding selected computer through an independent communication link; The selected computer realizes the real-time linkage closed loop between touch operation and display screen; Other computers are temporarily disconnected from the interactive link until the window mode is switched again.

5. The multi-window independent touch-control capable parallel display system according to claim 1, wherein: If the window mode switching command triggered by the user is a two-split screen multi-window mode switching command: According to the two-split-screen multi-window mode switching instruction, the motherboard selects the original video input signals of two computers from the currently connected multiple computers, and splices them into a two-split-screen multi-window image according to the preset layout rules, and then drives the display to display the two-split-screen multi-window image independently in different areas; The motherboard also sends a touch partition configuration instruction corresponding to the current two-split screen multi-window image on the display screen to the touch control module, instructing the touch control module to configure the touch screen into two independent touch partitions aligned with the pixels of the current two-split screen multi-window image on the display screen, and to bind the two independent touch partitions to the corresponding selected computers through independent communication links. The selected computers realize the real-time linkage closed loop between touch operation and display screen; Other computers are temporarily disconnected from the interactive link until the window mode is switched again.

6. The multi-window independent touch-control capable parallel display system according to claim 5, wherein: Two-screen multi-window images include: left-right two-screen multi-window images, top-bottom two-screen multi-window images, and picture-in-picture two-screen multi-window images; Among them, the left and right split-screen multi-window picture is set as the two windows on the display screen evenly occupy the left and right areas of the display screen respectively; the top and bottom split-screen multi-window picture is set as the two windows on the display screen evenly occupy the upper and lower areas of the display screen respectively; the picture-in-picture split-screen multi-window picture is set as the main window on the display screen occupies the full screen area of the display screen, and the secondary window is superimposed on a corner area of the display screen.

7. The multi-window independent touch-control capable parallel display system according to claim 1, wherein: If the window mode switching command triggered by the user is a three-screen multi-window mode switching command: According to the three-screen multi-window mode switching instruction, the motherboard selects the original video input signals of three computers from the currently connected computers, and splices them into a three-screen multi-window image according to the preset layout rules, and then drives the display to display the three-screen multi-window image independently in different areas; The motherboard also sends a touch zone configuration instruction corresponding to the current three-part multi-window image on the display screen to the touch control module, instructing the touch control module to configure the touch screen into three independent touch zones aligned with the pixels of the current three-part multi-window image on the display screen, and to bind the three independent touch zones to the corresponding selected computers through independent communication links. The selected computers realize the real-time linkage closed loop between touch operation and display screen; Other computers are temporarily disconnected from the interactive link until the window mode is switched again.

8. The multi-window independent touch-control capable parallel display system according to claim 7, wherein: The three-part screen multi-window picture includes: a left-two-right-one split screen multi-window picture and a left-one-right-two split screen multi-window picture; The two-left-one-right split-screen multi-window setting is that the three windows on the display are first arranged in a two-left-one-right pattern, evenly occupying the left and right areas of the display in the horizontal direction. The two windows in the left area then evenly occupy the upper and lower areas of the left area in the vertical direction. The left-one-right-two split-screen multi-window image setting is that the three windows on the display are first arranged in a left-one-right-two manner to evenly occupy the left and right areas of the display in the horizontal direction, and the two windows in the right area are then evenly occupied in the upper and lower areas of the right area in the vertical direction.

9. The multi-window independent touch-control capable parallel display system according to claim 1, wherein: If the window mode switching command triggered by the user is a four-screen multi-window mode switching command: According to the four-split screen multi-window mode switching instruction, the motherboard selects the original video input signals of four computers from the currently connected multiple computers, and splices them into a four-split screen multi-window image according to the preset layout rules, and then drives the display to display the four-split screen multi-window image independently in different areas; The motherboard also sends a touch partition configuration instruction corresponding to the current four-split screen multi-window image of the display to the touch control module, instructing the touch control module to configure the touch screen into four independent touch partitions aligned with the pixels of the current four-split screen multi-window image of the display, and to bind the four independent touch partitions to the corresponding selected computers to complete independent communication links; The selected computers realize the real-time linkage closed loop between touch operation and display screen; Other computers are temporarily disconnected from the interactive link until the window mode is switched again; Among them, the four-split screen multi-window picture includes: a 2×2 grid split screen multi-window picture; a 2×2 grid split screen multi-window picture is set so that the four windows on the display screen evenly occupy the entire screen area.

10. A working method applicable to the multi-window independent touch-supporting parallel display system according to any one of claims 1 to 9, characterized in that: include: After a user triggers a window mode switching command via the key control module, the key control module sends the window mode switching command to the motherboard, and at least one computer outputs an original video input signal to the motherboard; the motherboard selects the original video signal of the corresponding computer according to the window mode switching command and splices it into a target window image according to a preset layout rule, thereby driving the display screen to independently display the target window image in different areas; The mainboard sends a touch zone configuration instruction corresponding to the current target window image of the display screen to the touch control module. The touch zone configuration instruction includes the boundary coordinates of each touch zone and the independent communication link bound to each touch zone; The touch control module dynamically divides the touch screen into independent touch partitions aligned with the pixels of the current target window image of the display screen according to the touch partition configuration instruction; The touch control module receives touch data generated by touch events on the touch screen, analyzes the touch zone to which the touch event belongs based on the boundary coordinates, and then sends the touch data based on the analyzed touch zone to the corresponding computer through a corresponding independent communication link; When the computer receives touch data, it updates the original video input signal according to the touch data and transmits the updated video input signal to the motherboard. The motherboard drives the display to update the display in the window of the corresponding touch partition, realizing a real-time linkage closed loop between touch operation and display screen.

Images