A multi-screen display system, method and device

Abstract

The present invention provides a multi-screen display system, method and device. The system includes a server configuration component, a management-end configuration component, a screen component and a control-end component. The method includes: starting the server configuration component to establish initial connections with the management-end configuration component, the screen component and the control-end component; recording the connection relationships between each component; an administrator logging in to the configuration program through the management-end configuration component; the screen component connecting to the server configuration component through an application program to download the current configuration information, and the screen component performing screen area division according to the downloaded configuration information to determine how the video streams will be displayed on each screen, as well as the partitions and priorities of each screen; the control-end component receiving two video streams from the main application and determining how to display these streams on the screen according to the configuration of the management end. The device includes: a server, a management end, a screen and a control end. The present invention realizes a flexible, efficient and scalable multimedia display platform.

Description

Technical Field

[0001] The present invention relates to the technical field of multi-screen display control, and particularly relates to a multi-screen display system, method and device. Background Art

[0002] Screens, such as TVs and LEDs, are convenient and feature-rich. They are often used as content display devices in conference settings, which improves the transmission efficiency of conference content to a certain extent. However, since conference venues are usually large, multiple screens are often connected to avoid the problem that users may have difficulty seeing the content on the screen, especially text, when the distance between the user and the screen is far. Generally, there are two ways to place multiple screens: front-to-back and parallel. Another way is to make multiple screens display the same content, with one screen defined as the main screen and the others as secondary screens. This mode is the replication mode, which can be achieved through corresponding hardware or software. The replication mode of displaying content is only applicable to the scenario where the screens are placed front-to-back. If the screens are placed in parallel, it cannot solve the problem that users cannot see clearly. Because if users cannot see the content on the screen due to the distance, adding another screen at the same position to display the same content still cannot solve the problem of unclear content caused by the distance.

[0003] Prior art one, application number: CN202410854824.9 discloses a control method, device, equipment and computer storage medium for multi-screen display, including: determining multiple currently connected displays; when receiving a switching request for multi-screen display, invoking the multi-screen display interface of the system-level display service through inter-process communication; modifying the binding relationship between each of the multiple currently connected displays and each of the multiple display windows of the application by executing the display switching strategy of the multi-screen display interface; updating the display configuration of the display re-bound to the display window according to the modified binding relationship; rendering the interface content to the display with the updated display configuration according to the requirements of multi-screen same display or multi-screen different display to achieve the switching between multi-screen same display and multi-screen different display. Although it can reduce system resource consumption and enhance the operation convenience and satisfaction of users. However, the function is relatively simple, only realizing the switching of screens, and not realizing the combined display between multiple screens, resulting in limited improvement in the display effect.

[0004] Prior Art Two, Application Number: CN 202410532912.7 discloses a method and system for quickly correcting the output of multi-screen displays for security, including: obtaining the output serial number of each display on the software interface, where the output serial number of each display on the software interface represents the virtual coordinates of the display on the software interface; on the multi-screen display software interface, displaying the output serial number of each display on the software interface for each display; obtaining the output serial number of each display corresponding to the physical screen wall, where the output serial number of each display corresponding to the physical screen wall represents the position coordinates of the display on the physical screen wall; on the multi-screen display software interface, marking the output serial number of each display corresponding to the physical screen wall for each display; according to the marked output serial number of each display corresponding to the physical screen wall, using the API to adjust the virtual coordinates of each display to obtain the adjusted multi-screen display software interface. Although it can quickly correct the consistency between the physical position of the display and the software interface. However, this solution focuses on display output and does not involve the control of multi-screen displays, resulting in poor actual application effects.

[0005] Prior Art Three, Application Number: CN 202410981321.8 discloses a multi-screen display control method, system, device, product, storage medium, and vehicle, including the following steps: obtaining a target display object, where the display interface of the target display object is part or all of the first user interface, and the first user interface is displayed on the first screen; determining a second user interface according to the target display object; controlling at least one second screen to display the second user interface. Although it can directly determine the image corresponding to the current frame based on the image corresponding to the target display object on the current master display screen, and directly send the determined corresponding image to the secondary display screen for display, without the need to re-run the application program to re-render when displaying the corresponding content on the secondary display screen, saving hardware resources and improving device performance. In addition, when determining the corresponding image according to the current frame, the image can also be adjusted to make the display effect on the secondary display screen better. However, it does not achieve the control of the same content on different display screens, resulting in the display effect being the same as that of a single display screen, and the device performance is not effectively improved.

[0006] Currently, Prior Art One, Prior Art Two, and Prior Art Three have problems that the multi-screen control method cannot achieve combined display, and the distance does not match the display effect. Therefore, the present invention provides a multi-screen display system, method, and device, where multiple display screens are virtually regarded as one display screen, solving the problem of poor display effect caused by distance. Summary of the Invention

[0007] To solve the above technical problems, the present invention provides a multi-screen display system, including:

[0008] The server configuration component, connected to the management - end configuration component and the screen component, is responsible for recording the connection relationships among the management - end configuration component, the screen component, and the control - end component; the administrator logs in to the configuration program through the management - end configuration component, registers the first device of the management - end configuration component, the second device of the screen component, and the third device of the control - end component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships.

[0009] The management - end configuration component is responsible for using the H5 page of the server configuration component as the management interface. The management interface is the interface for the administrator to operate the configuration program by logging in to different configuration management - ends.

[0010] The screen component is responsible for downloading configuration information from the server configuration component by running an application program; during the operation of the application program, it performs screen - area division, obtains video streams, and realizes the playback of video streams on different screens.

[0011] The control - end component, connected to the screen component, is responsible for real - time controlling the interactive display of the second device of the screen component, receiving two distributed video streams, and realizing the video - stream display on different second devices.

[0012] Optionally, the server configuration component includes:

[0013] The first information storage module is responsible for displaying all available device types, which are divided into the first device, the second device, and the third device; registering the first device, inputting device information, including the unique identifier, type, and connection status of each device. The device information is immediately sent to the server configuration component for structured storage.

[0014] The second information storage module is responsible for registering the second device, inputting the unique identifier and network information. The server configuration component automatically records the connection relationship, generates the mapping relationship among the first device, the second device, and the third device; configures the relationships among the first device, the second device, and the third device, and establishes a linkage association relationship.

[0015] The device relationship confirmation module is responsible for updating the connection map after receiving the configuration information of the connection association relationship, reflecting the real - time relationships among various devices, and storing them in the database in a structured manner; after the configuration of each device is completed, when the screen component starts, it actively downloads the latest configuration information from the server configuration component. The downloaded information includes the status, connection relationship, and video - stream parameters of all devices.

[0016] Optionally, the device relationship confirmation module includes:

[0017] The program trigger sub-module is responsible for generating a connection configuration message after the administrator configures components on the management side to complete the registration and association settings between devices. The configuration message contains the specific relationships among the first device, the second device, and the third device. The configuration message is transmitted through the network channel to the server configuration component to trigger the process program for updating the graph.

[0018] The information splitting sub-module is responsible for parsing the configuration message after the server configuration component receives this connection configuration message, identifying the unique identifiers of each device and the association relationships between them. The server configuration component splits the data of the configuration message into information such as device type, identifier, and connection status according to the predefined format.

[0019] The information confirmation sub-module is responsible for searching for the currently existing connection graph in the stored database. The currently existing connection graph is constructed by the device relationship confirmation module and contains the connection information between all existing devices. Compare the newly received connection configuration message with the existing connection graph to determine new devices added, updated existing device relationships, or deleted associated information.

[0020] The update operation sub-module is responsible for performing update operations such as adding new devices, modifying existing connections, removing invalid connections, and constructing structured storage according to the comparison results.

[0021] Optionally, the screen component includes:

[0022] The main display module is responsible for downloading the configuration message from the server configuration component to construct the main application program; running the main application program to divide the virtual screen into windows.

[0023] The video channel module is responsible for receiving the video stream of the main display of the main screen and uploading it to the video server, and at the same time, the secondary screen pulls a new video stream from the video server.

[0024] The secondary display module is responsible for downloading the configuration message from the server configuration component to construct the secondary application program; running the secondary application program to obtain the video stream sent from the main screen and display it.

[0025] Optionally, the main display module includes:

[0026] The signal acquisition sub-module is responsible for obtaining real-time configuration information and input signals from the main display module, including the content types to be displayed, as well as the priorities and update frequencies of each content; recording the characteristics of each input source.

[0027] The dynamic adjustment sub-module is responsible for dividing the virtual areas of the main screen and the secondary screen into several functional blocks. The size and position of each functional block are dynamically adjusted according to the importance of the input signal. The dividing lines between windows use dynamic separation identifiers. It self-checks the content and size of each window and adjusts according to the actual display effect.

[0028] The icon addition sub-module is responsible for allocating specific content areas on each window, dynamically adjusting the size and position of each window according to operation habits and data update frequencies. After the window division is completed, information icons are displayed at the corners of each window. If the content of a certain window requires the user's attention, the icon blinks. It also allows the user to feedback on the window display effect through the right-click menu or touch gestures. For multimedia content, an intelligent processing mechanism is built, introducing compression and encoding to ensure smooth switching of video streams between windows.

[0029] Optionally, the dynamic adjustment sub-module includes:

[0030] The grid division unit is responsible for, after receiving each input signal, assigning a weight value to each signal; using visual analysis to convert the correlation and urgency of different inputs into dynamic scores; creating a geometric grid basis on the virtual screen and dividing it into several functional blocks. In the initial state, the functional blocks evenly distribute space at the same ratio.

[0031] The window adjustment unit is responsible for, when a high-priority signal enters, enabling the stretching and shrinking algorithm, that is, the high-priority window will absorb space from the surrounding area, and the low-priority windows in the corresponding positions will shrink proportionally.

[0032] The visual reconstruction unit is responsible for the visual reconstruction algorithm. The size and position of all functional blocks are adjusted so that there is a symmetrical relationship and spacing between each window.

[0033] Optionally, the secondary display module includes:

[0034] The bitrate adjustment sub-module is responsible for, after the secondary screen starts the application, establishing a connection with the main screen, receiving the video stream according to the streaming media protocol specified in the configuration file; dynamically adjusting the bitrate through adaptive bitrate.

[0035] The information feedback sub-module is responsible for implementing the logic of user controls, updating the playback state with key callbacks during playback, and collaborating with the main screen to display user experience feedback information.

[0036] The parameter adjustment sub-module is responsible for overlaying text information or icons on the video, processing the display content, displaying the main screen notification information at the edge of the secondary screen, and obtaining multi-task content. The secondary screen collects the playback state, sends the data back to the main screen for performance analysis, and the main screen adjusts the parameters of the video stream according to the feedback information.

[0037] Optionally, the control terminal component includes:

[0038] A connection establishment module, responsible for establishing a connection with the server configuration component, maintaining real-time communication with the management terminal configuration component and the screen component; obtaining device information through the server configuration component, including the status of the main screen and the secondary screen, the parameters of the current video stream, and the connection relationship;

[0039] A picture layout module, responsible for receiving two video streams distributed by the main application, and receiving these two video streams through streaming media negotiation according to the configuration information; adopting the layout of large pictures and small pictures, and selecting to preview two video streams full screen or simultaneously;

[0040] An additional function module, responsible for selecting to view the video stream of any path through the control terminal interface, or viewing two video streams simultaneously; quickly adjusting the display mode of the video stream on one interface, such as switching, zooming, etc.; when the user needs to write, after selecting the screen to be edited, automatically switch to only display the target video stream, capture the writing trajectory, and form a signaling for each data point of the writing trajectory;

[0041] A task control module, responsible for sending the writing trajectory information through the signaling trajectory channel, and sending the writing trajectory data to the main screen and the secondary screen in a broadcast manner through the signaling trajectory channel. The main screen and the secondary screen will draw according to the received trajectory information; after the user completes the task, end the control of writing and the video stream, and may save the user's configuration and writing content to the server.

[0042] A multi-screen display method provided by the present invention includes the following steps:

[0043] Start the server configuration component, establish an initial connection with the management terminal configuration component, the screen component, and the control terminal component; record the connection relationship between each component, including device tags, device types, and the interconnection status between them; the administrator logs in to the configuration program through the management terminal configuration component and operates using the H5 management interface; according to actual needs, determine the association relationship between the first device, the second device, and the third device through configuration operations;

[0044] The screen component is connected to the server configuration component through the application program, downloads the current configuration information, including the device list, video stream parameters, and their association relationship; the screen component performs screen area division according to the downloaded configuration information, determines how the video stream will be displayed on each screen, and the partition and priority of each screen;

[0045] The control terminal component receives two video streams from the main application and determines how to display these streams on the screen according to the configuration of the management terminal; the control terminal component monitors the status of the video stream in real time to ensure a smooth playback experience; the control terminal component controls the display content in real time.

[0046] A multi-screen display device provided by the present invention includes: a server, a management terminal, a screen, and a control terminal;

[0047] The server is connected to the management terminal and the screen, and records the connection relationships among the management terminal configuration, the screen, and the control terminal; the administrator logs in to the configuration program through the management terminal, registers the first device of the management terminal, the second device of the screen component, and the third device of the control terminal component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships; the management terminal is responsible for using the H5 page of the server as the management interface, and the management interface is the interface for the administrator to operate by logging in to the configuration program through different configured management terminals; the screen component is responsible for downloading configuration information from the server by running an application program; during the operation of the application program, it performs screen area division, obtains video streams, and realizes the playback of video streams on different screens; the control terminal component is connected to the screen component, and controls the interactive display of the second device of the screen component in real time, receives two distributed video streams, and realizes the video stream display of different second devices.

[0048] The server configuration component of the present invention records the connection relationships among the management terminal configuration component, the screen component, and the control terminal component, and understands the topological structure and data flow direction among the devices; provides a centralized configuration management, enabling the relationships among the devices to be organized and maintained in a framework. Significance: It provides a secure and reliable device connection management mechanism. Through the connection relationships, it is convenient for the administrator to perform subsequent operations and maintenance. At the same time, it also enhances the scalability and manageability of the system, and ensures the flexibility of multi-screen display. The management terminal configuration component provides a management interface through the H5 page, allowing the administrator to easily log in and perform configuration operations; supports the administrator to register the first device, the second device, and the third device, and configure the relationships among them. Significance: The management terminal configuration component makes the configuration operation simple and intuitive. Its flexibility allows the administrator to access the system from different devices (such as computers, tablets, mobile phones), facilitating the management work and improving the operation efficiency. The screen component downloads relevant configuration information from the server configuration component, and executes the application program for the display of the screen; performs the division of the screen area in the application program, can receive and display multiple video stream contents, and realizes the split-screen display of video streams. Significance: By effectively managing video stream contents, it can use multiple screens to display different information; the ability of area division and video stream playback enables the system to achieve diverse information display modes, meet the requirements of different scenarios, and thus enhance the user experience and interaction. The control terminal component can receive and process multiple video streams, ensuring different contents are displayed on different devices. Significance: The control terminal component provides the ability of dynamic interaction. Through real-time control and data distribution, it can effectively coordinate the display contents among different devices; dynamic management enables the multi-screen display system to respond to immediate needs, improve the flexibility of the application, and meet the requirements of real-time information display.

[0049] Other features and advantages of the present invention will be set forth in the following description, and in part will be obvious from the description, or may be learned by practice of the present invention. The objectives and other advantages of the present invention may be realized and attained by the structure particularly pointed out in the written description and the drawings.

[0050] The technical solution of the present invention will be further described in detail below with reference to the drawings and embodiments. Description of the Drawings

[0051] The drawings are used to provide a further understanding of the present invention, and constitute a part of the description. Together with the embodiments of the present invention, they are used to explain the present invention, and do not constitute a limitation to the present invention. In the drawings:

[0052] Figure 1 is a block diagram of the multi-screen display system in Embodiment 1 of the present invention;

[0053] Figure 2 is a schematic diagram of the multi-screen display system in Embodiment 1 of the present invention;

[0054] Figure 3 is a block diagram of the server configuration components in Embodiment 2 of the present invention;

[0055] Figure 4 is a block diagram of the device relationship confirmation module in Embodiment 3 of the present invention;

[0056] Figure 5 is a block diagram of the screen components in Embodiment 4 of the present invention;

[0057] Figure 6 is a schematic diagram of being divided into two windows in Embodiment 4 of the present invention;

[0058] Figure 7 is a schematic diagram of being divided into three windows in Embodiment 4 of the present invention Figure 1 ;

[0059] Figure 8 is a schematic diagram of being divided into three windows in Embodiment 4 of the present invention Figure 2 ;

[0060] Figure 9 is a schematic diagram of being divided into one window in Embodiment 4 of the present invention;

[0061] Figure 10 is a schematic diagram of multiple screens in Embodiment 4 of the present invention Figure 1 ;

[0062] Figure 11 is a schematic diagram of multiple screens in Embodiment 4 of the present invention Figure 2 ;

[0063] Figure 12It is the video transmission route diagram in Embodiment 4 of the present invention;

[0064] Figure 13 It is the schematic diagram of the signaling track in Embodiment 8 of the present invention;

[0065] Figure 14 It is the schematic diagram of the scenario where the screen is separated from the application in Embodiment 8 of the present invention;

[0066] Figure 15 It is the schematic diagram of the tablet where the writing device acts as the control end in Embodiment 8 of the present invention;

[0067] Figure 16 It is the schematic diagram of the one-to-many transmission mode in Embodiment 8 of the present invention;

[0068] Figure 17 It is the block diagram of the multi-screen display system in Embodiment 10 of the present invention;

[0069] Figure 18 It is the block diagram of the multi-screen display device in Embodiment 11 of the present invention. Detailed implementation manners

[0070] The following describes the preferred embodiments of the present invention with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not used to limit the present invention.

[0071] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. The singular forms "a", "the" and "said" used in the embodiments of the present application are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0072] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are only examples of devices and methods consistent with some aspects of the present application. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and do not have to be used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific circumstances.

[0073] Embodiment 1: As Figure 1 shown, the embodiment of the present invention provides a multi-screen display system, including:

[0074] The server configuration component, connected to the management - end configuration component and the screen component, is responsible for recording the connection relationships among the management - end configuration component, the screen component, and the control - end component; the administrator logs in to the configuration program through the management - end configuration component, registers the first device of the management - end configuration component, the second device of the screen component, and the third device of the control - end component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships;

[0075] Among them, the first device includes computers, tablets, mobile phones, etc.; the second device includes smart TVs, etc.; the third device includes tablets, computers, mobile phones, etc.;

[0076] The management - end configuration component is responsible for using the H5 page of the server configuration component as the management interface, and the management interface is the interface for the administrator to operate by logging in to the configuration program through different configuration management - ends;

[0077] The screen component is responsible for downloading configuration information from the server configuration component by running an application program; during the operation of the application program, it performs screen - area division, obtains video streams, and realizes the playback of video streams on different screens;

[0078] The control - end component, connected to the screen component, is responsible for real - time controlling the interactive display of the second device of the screen component, receiving two distributed video streams, and realizing the video - stream display on different second devices.

[0079] The working principle and beneficial effects of the above technical solution are as follows: The server configuration component in this embodiment is connected to the management-end configuration component and the screen component, and records the connection relationships among the management-end configuration component, the screen component, and the control-end component; The administrator logs in to the configuration program through the management-end configuration component, registers the first device of the management-end configuration component, the second device of the screen component, and the third device of the control-end component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships; Among them, the first device includes computers, tablets, mobile phones, etc.; The second device includes smart TVs, etc.; The third device includes tablets, computers, mobile phones, etc.; The management-end configuration component uses the H5 page of the server configuration component as the management interface, and the management interface is the interface for the administrator to operate by logging in to the configuration program through different configuration management ends; The screen component downloads the configuration information from the server configuration component by running the application program; During the operation of the application program, the screen area is divided, the video stream is obtained, and the video stream is played on different screens; The control-end component is connected to the screen component, and controls the interactive display of the second device of the screen component in real time, receives the two distributed video streams, and realizes the video stream display on different second devices. The server configuration component of the above solution records the connection relationships among the management-end configuration component, the screen component, and the control-end component, and understands the topological structure and data flow direction among the devices; It provides a centralized configuration management, enabling the relationships among the devices to be organized and maintained in a framework. Significance: It provides a secure and reliable device connection management mechanism. Through the connection relationships, it is convenient for the administrator to perform subsequent operations and maintenance. At the same time, it also enhances the scalability and manageability of the system, and ensures the flexibility of multi-screen display. The management-end configuration component provides a management interface through the H5 page, allowing the administrator to easily log in and perform configuration operations; It supports the administrator to register the first device, the second device, and the third device, and configure the relationships among them. Significance: The management-end configuration component makes the configuration operation simple and intuitive. Its flexibility allows the administrator to access the system from different devices (such as computers, tablets, mobile phones), facilitating the management work and improving the operation efficiency. The screen component downloads the relevant configuration information from the server configuration component and executes the application program for the screen display; In the application program, the screen area is divided, and it can receive and display multiple video stream contents, realizing the split-screen display of the video stream. Significance: By effectively managing the video stream contents, different information can be displayed using multiple screens; The ability of area division and video stream playback enables the system to achieve diverse information display modes, meeting the requirements of different scenarios, thereby enhancing the user experience and interactivity. The control-end component can receive and process multiple video streams, ensuring different contents are displayed on different devices. Significance: The control-end component provides the ability of dynamic interaction. Through real-time control and data distribution, it can effectively coordinate the display contents among different devices; The dynamic management enables the multi-screen display system to respond to immediate needs, improving the flexibility of the application, and meeting the requirements of real-time information display (for the specific principle, please refer to the appendixFigure 2 ).

[0080] In summary, this embodiment realizes a flexible, efficient, and scalable multimedia display platform; each component ensures the rapid and accurate transmission of information. The administrator can flexibly configure and manage the relationships between different devices. The screen can efficiently display content, while the control end ensures real-time and precise interaction; not only improving the user experience and enhancing the adaptability of the system, but also being widely applicable to multiple scenarios such as meetings, education, and advertising.

[0081] Embodiment 2: As Figure 3 shown, based on Embodiment 1, the server configuration component provided by the embodiment of the present invention includes:

[0082] The first information storage module is responsible for displaying all available device types, which are divided into the first device, the second device, and the third device; registering the first device and inputting device information, including the unique identifier, type, and connection status of each device. The device information is immediately sent to the server configuration component for structured storage;

[0083] The second information storage module is responsible for registering the second device, inputting the unique identifier and network information. The server configuration component automatically records the connection relationship and generates the mapping relationship between the first device, the second device, and the third device; configuring the relationship between the first device, the second device, and the third device to establish a linkage association relationship;

[0084] The device relationship confirmation module is responsible for updating the connection graph to reflect the real-time relationship between each device after receiving the configuration information of the connection association relationship, and storing it in the database in a structured manner; after the configuration of each device is completed, when the screen component starts, it actively downloads the latest configuration information from the server configuration component. The downloaded information includes the status, connection relationship, and video stream parameters of all devices.

[0085] The working principle and beneficial effects of the above technical solution are as follows: The first information storage module of this embodiment displays all available device types, which are divided into the first device, the second device, and the third device; register the first device and input device information, including the unique identifier, type, and connection status of each device. The device information is immediately sent to the server configuration component for structured storage; the second information storage module registers the second device and inputs the unique identifier and network information. The server configuration component automatically records the connection relationship and generates the mapping relationship between the first device, the second device, and the third device; configure the relationship between the first device, the second device, and the third device to establish a linkage association relationship; after receiving the configuration information of the connection association relationship, the device relationship confirmation module updates the connection map to reflect the real-time relationship between each device and stores it in the database in a structured manner; after the configuration of each device is completed, when the screen component starts, it actively downloads the latest configuration information from the server configuration component. The downloaded information includes the status, connection relationship, and video stream parameters of all devices. The first information storage module of the above solution can efficiently manage and store all available device types, allowing the administrator to input the unique identifier, type, and connection status of the device through a user-friendly interface; once the device information is entered, the module can immediately store this information in the database in a structured manner, ensuring the real-time and accuracy of the data. The achieved significance is: through the centralized management of all device information, the monitoring and management process of the device is simplified, which helps the administrator quickly locate and modify the device status; the administrator can view the available devices in real time, improving the efficiency and transparency of device management. The second information storage module supports the registration of the second device and can receive the unique identifier and network information; according to the registration situation among the first device, the second device, and the third device, it automatically generates the mapping relationship to ensure that the connection logic between each device is clearly recorded. The achieved significance is: the automated recording process reduces the possibility of human errors, ensuring the integrity and consistency of the connections between devices; as the number of devices increases, this module can easily adapt to the access of new devices, ensuring the scalability of the system. After receiving the connection and association configuration information, the device relationship confirmation module can update the connection map between devices in real time to reflect the dynamic relationship between the current devices; the relationship between devices is stored in the database in a structured manner, ensuring the efficiency of subsequent queries and management. The achieved significance is: the administrator can clearly understand the interaction between devices, providing data support for troubleshooting and performance optimization; the dynamically updated connection relationship encourages cooperation among components, ensuring that all relevant devices can respond in a timely manner according to the latest configuration.

[0086] In summary, the server configuration component of this embodiment realizes the effective management of device information, the automatic recording and dynamic update of connection relationships. The information structured storage and real-time update mechanism of each module greatly reduces the risks of data inconsistency and system failures; administrators can quickly respond to changes in device status and adjustments to business requirements, providing a flexible device management solution; the visualization of integrated device information and status enables administrators to manage the multi-screen display system with higher efficiency, enhancing the overall user experience. They not only play important functions individually in the multi-screen display system but also improve the overall performance of the system through collaboration, ensuring the efficient connection and management of devices.

[0087] Embodiment 3: As Figure 4 shown, based on Embodiment 2, the device relationship confirmation module provided by the embodiment of the present invention includes:

[0088] A program trigger sub-module, which is responsible for generating a connection configuration information after the administrator completes the registration and association settings between devices in the management-end configuration component. The configuration information includes the specific relationships among the first device, the second device, and the third device. The configuration information is transmitted to the server configuration component through a network channel to trigger the process program for graph update;

[0089] An information splitting sub-module, which is responsible for parsing the configuration information after the server configuration component receives this connection configuration information, identifying the unique identifiers of each device and the association relationships therebetween; the server configuration component splits the data of the configuration information into information such as device type, identifier, and connection status according to a predefined format;

[0090] An information confirmation sub-module, which is responsible for finding the currently existing connection graph in the stored database. The currently existing connection graph is constructed by the device relationship confirmation module and includes the connection information among all existing devices; comparing the newly received connection configuration information with the existing connection graph to determine new devices, update existing device relationships, or delete associated information;

[0091] An update operation sub-module, which is responsible for performing update operations such as adding new devices, modifying existing connections, removing invalid connections, and constructing structured storage according to the comparison results;

[0092] Among them, adding new devices: If the new first device or second device does not exist in the existing graph, the component will add it to the connection graph, establish a preliminary connection relationship, and record the status and connection information of the device;

[0093] Modifying existing connections: If a certain device in the new configuration information already exists in the connection graph but its connection status or relationship has changed, the component will update the device status and connection relationship according to the new configuration information;

[0094] Remove invalid connections: If the connection relationships of certain devices are no longer included in the new configuration information, the connections of these devices will be deleted from the connection map to ensure that it reflects the actual device status;

[0095] Build structured storage: When all update operations are completed, the server configuration component will store the new connection map in the database in a structured form, including the latest status, connection relationships of all devices, and the hierarchical structure of each device.

[0096] The working principle and beneficial effects of the above technical solution are as follows: After the program trigger sub-module administrator in this embodiment configures components at the management end to complete the registration and association settings between devices, a connection configuration information is generated. The configuration information includes the specific relationships among the first device, the second device, and the third device. The configuration information is transmitted to the server configuration component through the network channel to trigger the process program for map update; after receiving this connection configuration information, the information splitting sub-module of the server configuration component parses the configuration information, identifies the unique identifiers of each device, and the association relationships between them; the server configuration component splits the data of the configuration information into information such as device type, identifier, and connection status according to the predefined format; the information confirmation sub-module searches for the currently existing connection map in the stored database. The currently existing connection map is constructed by the device relationship confirmation module and contains the connection information among all existing devices; compares the newly received connection configuration information with the existing connection map to determine new devices, update existing device relationships, or delete associated information; the update operation sub-module performs update operations of adding new devices, modifying existing connections, removing invalid connections, and constructing a structured storage according to the comparison result. After the administrator of the program trigger sub-module in the above solution completes the device registration and association settings, it can automatically generate a connection configuration information and transmit it to the server configuration component through the network to trigger the subsequent map update process; realizes the update of device relationships by automatically collecting and transmitting information without manual intervention. The achieved significance: Automatically generating and triggering configuration information reduces the delay of manual operations and improves the response speed of the system; the real-time transmission of configuration information enables the connection relationships between devices to be updated in a timely manner, ensuring the accuracy and consistency of the system state. The information splitting sub-module can parse the received connection configuration information, identify the unique identifiers and association relationships of each device, and split out the necessary information according to the predefined format; converts the received data into a machine-readable structured form for subsequent system processing. The achieved significance: Through standardized information parsing, it is ensured that the system can understand and process the latest configuration information, thus avoiding information confusion or misunderstanding. The information confirmation sub-module searches for the currently existing connection map in the database and compares the new connection configuration information with it to identify new, modified, or deleted connection relationships; can identify changes in the connection status to help the system understand the actual connection situation between devices. The achieved significance: Through comparison and confirmation, it is ensured that the connection map can timely reflect the real device status, preventing misoperations caused by outdated or inaccurate information; can quickly respond to changes in device connections, ensuring that the system can flexibly adapt to various scenarios. The update operation sub-module is responsible for performing operations of adding new devices, modifying existing connections, removing invalid connections according to the comparison result, and finally constructing a structured data storage; after completing all updates, it can ensure that the latest state of the connection map is stored in the database in a structured form.Achieved Significance: By dynamically updating the connection relationship, it ensures that the system can adapt to new business requirements and improves the flexibility of device management; structured storage makes subsequent queries and data analysis more efficient, ensuring that the system is conducive to providing accurate information support in the data-driven decision-making process.

[0097] In summary, from the generation of connection configuration information to the update processing of data in this embodiment, the entire process is highly automated, ensuring timeliness; through information parsing, comparison, and confirmation, it can reflect the real state with accurate information, making the information between modules consistent; the rapid access of new devices and the dynamic update of status make the system highly flexible and able to adapt to changing requirements; it optimizes the management process of device connection and status, improves the work efficiency of administrators, and reduces the error rate. The device relationship confirmation module effectively maintains the stability and efficiency of the multi-screen display system and is the key to ensuring the normal operation of the overall system functions.

[0098] Embodiment 4: As Figure 5 shown, based on Embodiment 1, the screen component provided by the embodiment of the present invention includes:

[0099] The main display module is responsible for downloading configuration information from the server configuration component, constructing the main application program; running the main application program, and dividing the virtual screen into windows;

[0100] The video channel module is responsible for receiving the video stream of the main display main screen and uploading it to the video server, and at the same time, the secondary screen pulls a new video stream from the video server;

[0101] The secondary display module is responsible for downloading configuration information from the server configuration component, constructing the secondary application program; running the secondary application program, obtaining the video stream sent from the main screen, and displaying it.

[0102] The working principle and beneficial effects of the above technical solution are as follows: The main display module of this embodiment downloads configuration information from the server configuration component to build the main application program; runs the main application program to divide the virtual screen into windows; the video channel module receives the video stream of the main display main screen and uploads it to the video server, while the secondary screen pulls a new video stream from the video server; the secondary display module downloads configuration information from the server configuration component to build the secondary application program; runs the secondary application program, obtains the video stream sent from the main screen, and displays it. The main display module of the above solution downloads the latest configuration information from the server configuration component, which includes device configuration, screen splitting settings, video source selection, etc.; according to the downloaded configuration information, it dynamically generates and loads the main application program, including specified window division, interface layout, and functional logic, etc.; it realizes the division of the virtual screen area and displays different application windows according to the configuration requirements. The achieved significance is that by dynamically downloading configurations and building application programs in real time, the main display module can adapt to various display requirements and meet different business scenarios; the window division function allows users to monitor multiple video streams or applications simultaneously, realizing the efficient processing of multiple tasks and enhancing the overall operation convenience and flexibility. The video channel module receives the real-time video stream from the main display module and uploads it to the video server to ensure the instant transmission of data; the secondary screen pulls a new video stream from the video server to support the simultaneous display of different or the same video content on multiple screens. The achieved significance is to ensure the rapid reception and transmission of video streams, enabling each screen to display content synchronously and adapt to rapidly changing display requirements; by sharing the video server, the video channel module realizes the seamless connection between the main and secondary screens, enhancing the interconnection of the multi-screen display system and improving the efficiency of multi-user collaboration. The secondary display module downloads its own configuration information from the server configuration component to ensure its consistency with the overall system settings; according to the obtained configuration information, the secondary display module builds and runs the secondary application program, which can receive the video stream from the main display module; decodes and renders the received video stream to ensure the display quality on the secondary screen. The achieved significance is that the design of the secondary display module enables the secondary screen to run its own application program independently while closely collaborating with the main screen, which is conducive to realizing more complex application scenarios (such as meetings, multimedia exhibitions, etc.); by receiving the video stream from the main display module, it maximally utilizes the display capabilities of the secondary screen to realize the release and display of different contents, enhancing the audience's sense of participation and the diversification of information acquisition (for the principle, please refer to Appendix Figure 6 -Appendix Figure 12 )

[0103] In summary, this embodiment not only achieves specific technical effects but also realizes the efficiency and flexibility of the overall system through collaborative work. The overall significance includes: the effective coordination of the main display module and the secondary display module, which is more efficient in resource allocation and management, and important information and content are simultaneously displayed on different screens; the design of the multi-screen display system enables different screens to communicate information in real time, enhancing the operation convenience of users in various application scenarios; whether it is the real-time transmission of video streams or the flexible division of interfaces, it greatly improves the user experience in the system, making the system more adaptable and usable; it provides a flexible architecture foundation, enabling quick response and improvement when new requirements emerge in the future; it can be found that the design of the screen components is not only of great significance at the technical level but also greatly improves the actual user experience.

[0104] Embodiment 5: On the basis of Embodiment 4, the main display module provided by the embodiment of the present invention includes:

[0105] A signal acquisition sub-module, responsible for obtaining real-time configuration information and input signals from the main display module, including the type of content to be displayed (such as video stream, document, or web page), as well as the priority and update frequency of each piece of content; recording the characteristics of each input source, including resolution, frame rate, and data format;

[0106] A dynamic adjustment sub-module, responsible for dividing the virtual areas of the main screen and the secondary screen into several functional blocks, and the size and position of each functional block are dynamically adjusted according to the importance of the input signal; the dividing lines between windows use dynamic separation identifiers; self-check the content and size of each window and adjust according to the actual display effect;

[0107] An icon addition sub-module, responsible for allocating specific content areas on each window, dynamically adjusting the size and position of each window according to operation habits and data update frequency; after the window division is completed, display information icons at the corners of each window; if the content of a certain window requires user attention, the icon blinks; also allow users to feedback the window display effect through the right-click menu or touch gestures; for multimedia content, build an intelligent processing mechanism, introduce compression and encoding, and ensure the smooth switching of video streams between windows.

[0108] The working principle and beneficial effects of the above technical solution are as follows: The signal acquisition sub-module of this embodiment obtains real-time configuration information and input signals from the main display module, including the content types to be displayed (such as video streams, documents, or web pages), as well as the priority and update frequency of each content; records the characteristics of each input source, including resolution, frame rate, and data format; the dynamic adjustment sub-module divides the virtual areas of the main screen and the secondary screen into several functional blocks, and the size and position of each functional block are dynamically adjusted according to the importance of the input signal; the dividing lines between windows use dynamic separation identifiers; self-checks the content and size of each window and adjusts according to the actual display effect; the icon addition sub-module allocates specific content areas on each window, and dynamically adjusts the size and position of each window according to the operation habit and data update frequency; after the window division is completed, information icons are displayed at the corners of each window; if the content of a certain window requires the user's attention, the icon blinks; it also allows the user to feedback the window display effect through the right-click menu or touch gestures; for multimedia content, an intelligent processing mechanism is built, introducing compression and encoding to ensure smooth switching of video streams between windows. The signal acquisition sub-module of the above solution obtains real-time configuration information and signals from different input sources, including video streams, documents, and web pages, etc., and records their characteristics (such as resolution, frame rate, and data format); by analyzing the priority and update frequency of the input signal, the display content priority order is dynamically adjusted. Significance achieved: Real-time monitoring of input signals to avoid affecting the user experience due to information delay; by recording and analyzing signal characteristics, the system can make more efficient decisions in resource allocation to ensure the best display effect. The dynamic adjustment sub-module divides the main screen and the secondary screen into several functional blocks, and dynamically adjusts the size and position of each window according to the relative importance of the input signal; the dividing lines between windows use dynamic effects, making the distinction between different contents more intuitive. Significance achieved: Users can quickly identify important content and adapt to different display requirements, providing a clearer and more intuitive information display; the dynamic adjustment function enables the system to flexibly respond to changing display requirements and adapt to various business scenarios. The icon addition sub-module adds information icons at the corners of each window, enabling users to quickly capture relevant information, providing a blinking prompt function, and the ability for users to feedback the display effect through the right-click menu or touch gestures. Significance achieved: Users can actively participate in the management of windows, enhancing the overall satisfaction of their usage experience; the dynamically displayed icons effectively guide users to notice the information that needs to be paid attention to immediately, ensuring that users do not miss important data. The intelligent processing mechanism (for multimedia content) introduces compression and encoding technologies to ensure smooth switching of video streams between windows, reducing latency and stuttering phenomena. Significance achieved: While maintaining high image quality in multimedia content display, ensuring rapid and seamless switching, enhancing the overall viewing experience; through the intelligent processing mechanism, the system can achieve the best streaming media processing effect with limited resources, reducing the system burden.

[0109] In summary, this embodiment realizes multiple optimizations of the main display module, ensuring the intelligent, flexible, and user-friendly display of information in a multi-screen environment. It not only improves the user experience but also enhances the adaptability and efficiency of the system, enabling it to support complex business scenarios and meet users' needs for diverse information display and interactivity. It promotes the efficiency and visualization of information processing and enhances the intelligent level of the system.

[0110] Embodiment 6: Based on Embodiment 5, the dynamic adjustment sub-module provided by the embodiment of the present invention includes:

[0111] A grid division unit, which is responsible for, after receiving each input signal, assigning a weight value to each signal; using visual analysis to convert the correlation and urgency of different inputs into a dynamic score; creating a geometric grid basis on the virtual screen and dividing it into several functional blocks. In the initial state, the functional blocks evenly distribute space at the same ratio;

[0112]

[0113] Among them, represents the weight value of the input signal i , represents the type importance score (encoded value) of the input signal, represents the feedback value based on user interaction (such as the number of views), represents the real-time update frequency of the input signal (such as the number of updates per minute), represents the total value normalization constant, ensuring that the sum of all weight values is 1;

[0114] Through visual analysis, the formula for converting the correlation and urgency of different input signals into a dynamic score is:

[0115]

[0116] Among them, represents the input signal i , represents the user interaction weight, reflecting the degree of importance the user attaches to this input signal, represents the content importance weight, indicating the classification importance of the input signal type (such as monitoring, data stream, etc.), represents the category score of the input signal, represents the real-time weight, measuring the urgency of the input signal update, represents the update frequency of the input signal;

[0117] Creating a geometric grid on the virtual screen and evenly distributing the initial space is described by the following formula:

[0118]

[0119] Among them, represents the initial area of the functional block j of represents the total display area (total area of the main screen), represents the number of current functional blocks;

[0120] The window adjustment unit is responsible for enabling the stretching and shrinking algorithm when a high-priority signal enters, that is, the high-priority window will absorb space from the surrounding area, and the low-priority window at the corresponding position will shrink proportionally;

[0121] Enable the stretching and shrinking algorithm to adjust the space allocation of the window as follows:

[0122]

[0123] Among them, represents the functional block j in the new area after adjustment, represents the functional block j of the dynamic score, evaluated according to the priority, represents the coefficient (adjustable parameter) controlling the stretching amplitude, represents the functional block j the proportion of the total area, used to limit the stretching effect;

[0124] For the shrinking of low-priority windows, use:

[0125]

[0126] Among them, represents the functional block k in the new area after adjustment, represents the functional block k of the dynamic score (relatively low), represents the coefficient controlling the shrinking amplitude;

[0127] The visual reconstruction unit is responsible for the visual reconstruction algorithm, and the sizes and positions of all functional blocks are adjusted so that there is a symmetrical relationship and spacing between each window;

[0128]

[0129] Among them, represents the functional block i and the functional block j the distance or separation difference between, 、 represents the coordinates (x, y) of the center point of the functional block, 、 Represents a functional block i With the functional block j The current area of A weighting factor used to adjust the influence of area on distance.

[0130] The working principle and beneficial effects of the above technical solution are as follows: After receiving each input signal, the grid division unit of this embodiment assigns a weight value to each signal; uses visual analysis to convert the correlation and urgency of different inputs into a dynamic score; creates a geometric grid basis on the virtual screen and divides it into several functional blocks. In the initial state, the functional blocks evenly distribute space at the same ratio; when a high-priority signal enters, the window adjustment unit enables the stretching and shrinking algorithm, that is, the high-priority window will absorb space from the surrounding area, and the low-priority window at the corresponding position will shrink proportionally; the visual reconstruction unit uses the visual reconstruction algorithm, and the size and position of all functional blocks are adjusted so that a symmetric relationship and spacing are maintained between each window. The grid division unit of the above solution assigns weights to each input signal, forms a reliable evaluation criterion by comprehensively considering the importance of the signal, user feedback, and real-time update frequency; uses visual analysis to convert the correlation and urgency of different input signals into a dynamic score to support subsequent space allocation and display adjustment. The achieved significance is that by assigning weights to signals, the system can prioritize the processing of more important information to improve the user's attention and response speed to important signals; supports the existence of multiple input signal types and quickly adapts according to real-time data and user behavior, enhancing the intelligence of the system. The window adjustment unit enables the high-priority window to absorb space from the surrounding area and dynamically adjusts the window size to meet the needs of different priority signals; the high-priority window expands, and the display area is increased through the stretching algorithm; the low-priority window shrinks to maintain the harmony of the overall display interface. The achieved significance is that it can automatically adjust the display space of each functional block according to the signal priority and the user's focus, thus providing a better user experience; by adjusting the display area of the window as needed, it effectively avoids information congestion and enables the user to obtain key content more clearly and efficiently. When a high-priority signal comes in, the visual reconstruction unit ensures that the size and position of all functional blocks are adjusted through the visual reconstruction algorithm so that they maintain symmetry and appropriate spacing with each other; by calculating the distance or separation difference of the center points of the functional blocks, it ensures the aesthetic feeling of the interface and the clarity of information. The achieved significance is that the user can obtain a better visual experience during information display, the presentation of information is more logical and systematic, helping the user to identify and process information more effectively; by maintaining the symmetric relationship and appropriate spacing between functional blocks, it helps to improve the aesthetic degree of the interface and enhance the professionalism and usability of the system.

[0131] In summary, the dynamic adjustment sub-module of this embodiment not only realizes the flexible processing of different input signals and the optimization of visual display, but also enhances the intelligent response ability and user experience of the system. From the acquisition of information flow, priority assessment to the final adjustment of display layout, the whole process is centered around the needs of users, aiming to provide users with an efficient and intuitive information processing and display experience. It can be widely applied to scenarios such as monitoring systems, data stream display platforms, real-time reporting tools, etc. to meet the requirements of fast-paced information exchange and decision-making.

[0132] Embodiment 7: On the basis of Embodiment 4, the secondary display module provided by the embodiment of the present invention includes:

[0133] The bitrate adjustment sub-module is responsible for establishing a connection with the main screen after the application is launched on the secondary screen, receiving the video stream according to the specified streaming media protocol in the configuration file; dynamically adjusting the bitrate through adaptive bitrate.

[0134] The information feedback sub-module is responsible for implementing the logic of user controls (such as play, pause, fast forward, playback, etc.), updating the play state during the playback process through key callbacks, and collaborating with the main screen to display user experience feedback information.

[0135] The parameter adjustment sub-module is responsible for superimposing text information or icons on the video, processing the display content, displaying the main screen notification information at the edge of the secondary screen, and obtaining multi-task content; the secondary screen collects the play state, sends the data back to the main screen for performance analysis, and according to the feedback information, the main screen adjusts the parameters of the video stream.

[0136] The working principle and beneficial effects of the above technical solution are as follows: After the application is launched, the sub-screen of the bitrate adjustment sub-module in this embodiment establishes a connection with the main screen, receives the video stream according to the specified streaming media protocol in the configuration file, and dynamically adjusts the bitrate through adaptive bitrate. The information feedback sub-module implements the logic of user controls (such as play, pause, fast forward, playback, etc.), updates the play state through key callbacks during playback, and collaborates with the main screen to display user experience feedback information. The parameter adjustment sub-module superimposes text information or icons on the video, processes the display content, displays the main screen notification information at the edge of the sub-screen, and obtains multi-task content. The sub-screen collects the play state, sends the data back to the main screen for performance analysis, and according to the feedback information, the main screen adjusts the parameters of the video stream. The bitrate adjustment sub-module of the above solution monitors and analyzes the video stream in real time, automatically adjusts the bitrate of the video according to network conditions (such as bandwidth, latency) and video content complexity; by selecting the appropriate bitrate and clarity, it ensures smooth playback without excessive buffering or stuttering; according to the specified streaming media protocol (such as HLS or DASH) in the configuration file, the module can adapt to different requirements and flexibly switch video streams of different qualities. The achieved significance is that by reducing the buffering time and playback interruptions, users can enjoy a smoother video viewing experience. When the network condition is poor, reducing the bitrate allows users to continue watching instead of completely interrupting; dynamically adjusting the bitrate enables reasonable utilization of bandwidth resources. Especially in an environment with large bandwidth fluctuations, the system can utilize the optimal traffic configuration to improve the overall transmission efficiency. The information feedback sub-module implements the logic of basic player controls such as play, pause, fast forward, and playback, monitors all user interactions, and can timely feedback the user's control intention for video playback; through key callback mechanisms (such as onPlay, onPause, onTimeUpdate), it continuously updates the player state during playback and generates user experience feedback information such as play progress and timing. The achieved significance is that the efficient user control logic ensures that users can interact with the sub-screen smoothly, improving the operability and convenience of video playback; by working in collaboration with the main screen, the system timely feeds back information to the main screen when the play state changes, ensuring that the main screen can display the information synchronously, thus enhancing the overall coordination feeling of the system. The parameter adjustment sub-module superimposes real-time information (such as play state, notifications, etc.) on the video in the form of text or icons, and efficiently displays the information using the graphics drawing functions of Canvas or HTML; by displaying the main screen notification information at the edge, the sub-screen supports users to obtain other important content while playing the video, enhancing the multi-tasking ability.Significance achieved: Users can obtain important information, such as message notifications or dynamic content on the main screen, without switching interfaces during video viewing, improving information accessibility; The secondary screen continuously collects playback status (such as the number of pauses, playback time, etc.) and sends the collected data back to the main screen for performance analysis. Based on this, the main screen can make parameter adjustments based on actual usage conditions to optimize the overall video stream effect.

[0137] In summary, the secondary display module of this embodiment achieves excellent performance and flexibility in real-time video stream playback. Bitrate adjustment ensures a smooth playback experience, information feedback enhances user operability, and parameter adjustment provides information visualization and interactivity. It can not only adapt to different network conditions and user needs, but also dynamically optimize resource allocation and user experience, thus maintaining high efficiency and high-quality visual experience during video playback.

[0138] Embodiment 8: Based on Embodiment 1, the control end component provided by the embodiment of the present invention includes:

[0139] A connection establishment module, responsible for establishing a connection with the server configuration component and maintaining real-time communication with the management end configuration component and the screen component; obtaining device information through the server configuration component, including the status of the main screen and the secondary screen, the parameters of the current video stream, and the connection relationship;

[0140] A picture layout module, responsible for receiving two video streams distributed by the main application, receiving these two video streams through streaming media negotiation according to the configuration information; adopting a layout of large pictures and small pictures, and selecting full screen (single video stream) or previewing two video streams simultaneously;

[0141] An additional function module, responsible for selecting to view the video stream of any path or view two video streams simultaneously through the control end interface; quickly adjusting the display mode of the video stream on one interface, such as switching, zooming, etc.; when the user needs to write, after selecting the screen to be edited, automatically switch to only display the target video stream, capture the writing trajectory, and form a signaling for each data point of the writing trajectory;

[0142] A task control module, responsible for sending the writing trajectory information through the signaling trajectory channel, sending the writing trajectory data to the main screen and the secondary screen in a broadcast manner through the signaling trajectory channel, and the main screen and the secondary screen will draw according to the received trajectory information; after the user completes the task, end the control of writing and the video stream, and may save the user's configuration and writing content to the server (refer to the appendix Figure 13 )

[0143] The working principle and beneficial effects of the above technical solution are as follows: The connection establishment module in this embodiment establishes a connection with the server configuration component and maintains real-time communication with the management-end configuration component and the screen component; obtains device information through the server configuration component, including the status of the main screen and the secondary screen, the parameters of the current video stream, and the connection relationship; the picture layout module receives two video streams distributed by the main application, and according to the configuration information, receives these two video streams through streaming media negotiation; adopts the layout of large pictures and small pictures, and selects full screen (single video stream) or preview two video streams simultaneously; the additional function module selects to view the video stream of any path through the control-end interface, or view two video streams simultaneously; quickly adjusts the display mode of the video stream on one interface, such as switching, zooming, etc.; when the user needs to write, after selecting the screen to be edited, it automatically switches to only display the target video stream, captures the writing trajectory, and forms a signaling for each data point of the writing trajectory; the task control module sends the writing trajectory information through the signaling trajectory channel and broadcasts the writing trajectory data to the main screen and the secondary screen through the signaling trajectory channel, and the main screen and the secondary screen will draw according to the received trajectory information; after the user completes the task, the control of writing and the video stream is ended, and the user's configuration and writing content may be saved to the server. The connection establishment module of the above solution establishes a stable connection with the server configuration component to ensure real-time communication between the management-end configuration component and the screen component; it can pull the status information of the main screen and the secondary screen, the current video stream parameters, and the connection relationship in real time. The achieved significance: By establishing a stable connection, it ensures smooth data interaction between various components, reduces the occurrence of delays or packet losses, and enhances the reliability of the system; obtaining device information in real time enables the control end to quickly respond to environmental changes and user needs. For example, when the screen status changes or the video stream parameters are adjusted, corresponding adjustments can be made quickly. The picture layout module accesses and processes two video streams according to the configuration from the main application, and uses streaming media negotiation technology to optimize the decoding method to achieve clear and stable video display; supports flexible switching of display modes, including full-screen playback (single video stream) and picture-in-picture (preview two video streams simultaneously) layout methods. The achieved significance: Through the layout of large pictures and small pictures, users can obtain the best viewing angle and experience in different scenarios, adapting to different usage requirements (such as meetings, presentations, etc.); users can easily select the content they want to view on the interface, improving the interaction efficiency and user satisfaction. The additional function module can select to view the video stream of any path or display two video streams simultaneously, adapting to the diverse viewing needs of users; users can conveniently adjust the display mode of the video stream, such as switching, zooming, and arrangement methods, enhancing the flexibility of operation.Significance achieved: Provide diverse functions, enabling users to flexibly handle different application scenarios (such as teaching, live streaming, demonstration, etc.) during use, greatly enhancing the practicality of the system; when users need to write or focus on a certain video stream, they can quickly switch views, effectively saving operation time, achieving seamless connection and efficient workflow. The task control module captures the trajectory data written by the user and broadcasts the data to the main screen and the secondary screen through the signaling trajectory channel to ensure multi-screen synchronous performance; after the user completes writing and video stream control, the task is automatically ended, and the writing content and user configuration status can be saved to the server. Significance achieved: The writing content is synchronized to the main screen and the secondary screen in real time through the signaling trajectory channel to ensure the consistency and real-time nature of information, improving the effect of multi-device collaborative work; the configuration and writing content after task completion can be saved for future reference and optimization, supporting the continuous iteration and improvement of the system, and providing an important data basis for management and analysis.

[0144] In summary, the control end component of this embodiment realizes complex tasks such as operation control, video stream management, and interaction functions. It provides a solid foundation for the efficient operation of the multi-screen display system. Users can operate in a unified and intuitive interface, making the management and use of the multi-screen system more simple, natural, and efficient.

[0145] Embodiment 9: As Figure 14 shown, on the basis of Embodiment 1, for the scenario of separating the screen and the application provided by the embodiment of the present invention, if the screen device itself is only a display device, additional devices are required to run the aforementioned main application and secondary application, and the device is a set-top box. The configuration server is connected to the configuration management end, the main application, and the secondary application. The main application is connected to the main screen through HDMI, and the secondary application is connected to the secondary screen through HDMI. The main application on the main screen sends the video stream to the secondary application for display on the secondary screen; the video stream control and signaling trajectory of the main application and the secondary application are controlled through the control end.

[0146] In the application in the education scenario, the following several modes can be constructed, where the screen is the interface of the display application itself, playing videos, displaying pictures, and opening web pages in the browser, etc.; the blackboard means that the main application displays a background of a specified color on the window corresponding to the screen, and no other content is presented. The color can be black, white, etc., but from the actual effect, the dark green looks better.

[0147] Screen + screen, independent content; Screen + screen, copy content, suitable for large classrooms with a wide width; Screen + blackboard, suitable for displaying questions and answering them on the spot in the blackboard area; Blackboard + screen, equivalent to the previous one, just in a different position; Blackboard + blackboard, independent content, essentially an extremely long blackboard, suitable for scenarios with a large amount of blackboard writing; Blackboard + blackboard, copy content, suitable for classrooms with a wide width.

[0148] As Figure 15 shown, the writing device is a tablet acting as a control terminal, or it can also be a touch screen; if the screen supports touch writing, the trajectory information of the writing can be collected and distributed through the signaling trajectory channel, and at this time, the transmission of the trajectory information.

[0149] As Figure 16 shown, multicast or a server is actually adopted to implement the one-to-many transmission mode, where the channel can be multicast or through a server; all devices can send and receive.

[0150] Embodiment 10: As Figure 17 shown, based on Embodiments 1 - 8, the multi-screen display method provided by the embodiment of the present invention includes the following steps:

[0151] S100: Start the server configuration component, establish an initial connection with the management-end configuration component, the screen component, and the control-end component; record the connection relationships between each component, including device tags, device types, and the interconnection status between them; the administrator logs in to the configuration program through the management-end configuration component and operates using the H5 management interface; according to actual requirements, determine the association relationships between the first device, the second device, and the third device through configuration operations;

[0152] S200: The screen component connects to the server configuration component through the application program and downloads the current configuration information, including the device list, video stream parameters, and their association relationships; the screen component performs screen area division according to the downloaded configuration information to determine how the video stream will be displayed on each screen, as well as the partitions and priorities of each screen;

[0153] S300: The control-end component receives two video streams from the main application and determines how to display these streams on the screen according to the configuration of the management end; the control-end component monitors the status of the video stream in real time to ensure a smooth playback experience; the control-end component controls the display content in real time, including the selection of the displayed content (such as full screen or side-by-side display), or adjustments (such as zooming, switching, etc.).

[0154] The working principle and beneficial effects of the above technical solution are as follows: In this embodiment, the server configuration component is first started to establish an initial connection with the management-end configuration component, the screen component, and the control-end component; the connection relationships between each component are recorded, including device tags, device types, and their mutual connection status; the administrator logs in to the configuration program through the management-end configuration component and operates using the H5 management interface; according to actual requirements, the association relationships between the first device, the second device, and the third device are determined through configuration operations; secondly, the screen component is connected to the server configuration component through the application program to download the current configuration information, including the device list, video stream parameters, and their association relationships; the screen component performs screen area division according to the downloaded configuration information to determine how the video stream will be displayed on each screen, as well as the partition and priority of each screen; finally, the control-end component receives two video streams from the main application and determines how to display these streams on the screen according to the configuration of the management end; the control-end component monitors the status of the video stream in real time to ensure a smooth playback experience; the control-end component controls the displayed content in real time, including the selection of the displayed content (such as full-screen or side-by-side display), or adjustment (such as zooming, switching, etc.). Step S100 of the above solution starts the server configuration component to establish an initial connection with the management-end configuration component, the screen component, and the control-end component, ensuring that the three main components can communicate with each other; records the connection relationships between each component in real time, including device tags, device types, and their respective connection status, forming a dynamic device network diagram; provides an H5 management interface for the administrator to access through the management end to complete device registration and connection relationship configuration. The achieved significance: By recording the connection relationships in detail, the administrator can clearly understand the status of each component in the system and their connection conditions, providing a basis for subsequent fault troubleshooting and optimization; allows the administrator to flexibly configure the association relationships between the first device (such as a computer, tablet, mobile phone), the second device (such as a smart TV), and the third device (such as a tablet, mobile phone, etc.) according to requirements, so as to better adapt to different application scenarios; the H5 management interface of the management end provides a friendly user experience, simplifies the device configuration process, improves management efficiency, and ensures that the system can be started smoothly. Step S200 is the connection between the screen component and the server configuration component. The screen component downloads the current configuration information, including the device list, video stream parameters, and their association relationships, through the connection with the server configuration component; the screen component performs screen area division according to the downloaded configuration information to clarify the display method, priority, and partition, etc. of the video stream on each screen. The achieved significance: By obtaining real-time configuration information, the screen component can quickly respond to changes, ensuring the accuracy and timeliness of the displayed content; dividing the screen area according to the configuration information can achieve reasonable resource allocation, ensuring that the video stream is reasonably displayed on different screens and improving the viewing experience; the dynamic configuration information download and area division process enables the system to quickly adapt to different usage scenarios, allowing the administrator to adjust the display layout in real time without restarting the system.Step S300: Video stream processing of the control end component. The control end component receives two video streams from the main application and decides how to display these streams on the screen (full screen or side by side, etc.) according to the configuration of the management end; monitors the video stream status in real time to ensure smooth content playback and no delay in the user experience; supports the user to select and adjust the displayed content in real time on the control end, including changing the display mode (zooming, switching, etc.). Significance achieved: Through smooth video stream playback and control capabilities, users can enjoy a highly interactive multi-screen display experience, meeting the needs of multiple scenarios (such as meetings, teaching, etc.); the real-time adjustment function of the control end enables users to flexibly respond to different display requirements, enhancing the diversity of content and improving the adaptability of the system; by detecting the video stream status and taking appropriate countermeasures, the control end component can maintain the stability and reliability of the system, providing users with a continuous and seamless viewing experience.

[0155] In summary, this embodiment ensures that every link of the entire multi-screen display system, from connection establishment, configuration information acquisition to video stream display, can proceed smoothly. It not only achieves the goal of multi-screen collaborative display but also provides important guarantees in multiple aspects such as user experience, real-time management, and system stability. This process lays a solid foundation for future possible expansion and maintenance, ensuring that the system can quickly adapt to various changes and requirements in daily use.

[0156] Embodiment 11: As Figure 18 shown, based on Embodiment 1 and Embodiment 10, the multi-screen display device provided by the embodiment of the present invention includes: a server, a management end, a screen, and a control end;

[0157] The server is connected to the management end and the screen, and records the connection relationships among the management end configuration, the screen, and the control end; the administrator logs in to the configuration program through the management end, registers the first device of the management end, the second device of the screen component, and the third device of the control end component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships; the management end is responsible for using the H5 page of the server as the management interface, and the management interface is the interface for the administrator to operate by logging in to the configuration program through different configured management ends; the screen component is responsible for downloading configuration information from the server by running the application program; during the operation of the application program, it performs screen area division, obtains video streams, and realizes the playback of video streams on different screens; the control end component is connected to the screen component, controls the interactive display of the second device of the screen component in real time, receives the two distributed video streams, and realizes the video stream display of different second devices.

[0158] The working principle and beneficial effects of the above technical solution are as follows: When the device is started in this embodiment, the server establishes connections with the management terminal and the screen component, and records the connection relationships therebetween, including the identifiers, types, and interconnection statuses of the devices; the administrator logs in to the management terminal and configures the information of different devices and their association relationships through the management interface of the H5 page; the administrator registers the first device (such as a computer, tablet, mobile phone), the second device (such as a smart TV), and the third device (such as a tablet, computer, mobile phone, etc.) through the configuration program of the management terminal; after the registration is completed, the association relationships between different devices are determined according to the administrator's configuration. The screen component establishes a connection with the server by running the application program, and downloads the current configuration information, including the device status, video stream parameters, and their association relationships; after downloading the configuration information, the screen component performs screen area division, and distributes the video streams to different screen areas according to the set priorities and display rules; the control terminal receives two video streams from the main application and determines how to display these streams on the screen according to the configuration of the management terminal; the control terminal monitors the status of the video streams in real time to ensure a smooth playback experience; the control terminal can also perform various display content adjustments, including switching view modes (such as full screen, split screen, etc.) and real-time zooming, to meet the needs of users. The control terminal controls the display content of the screen component in real time, and updates the display effect of the video streams according to the user's input and operations; the user can interact with the display content through the control terminal, and the feedback can be immediately sent to all relevant screens.

[0159] In this embodiment, through centralized management and clear recording of component connection relationships, the administrator can effectively manage multiple devices and their relationships, simplifying the operation process; to support multiple devices, it can flexibly handle different application scenarios, enhancing the flexibility and convenience of management; the real-time processing and control of video streams, as well as the reasonable division of screen areas, can provide a better visual experience for users, enabling users to obtain the optimal viewing method in different scenarios; the real-time monitoring of video stream status and interactive control enable the display content to be dynamically adjusted to meet diverse business needs; the design of the control terminal ensures the stability of video streams, reduces latency, improves the continuity and smoothness of playback, and enhances the overall stability of the system; through the cooperation of the configuration program and the management terminal, the system can monitor and update the configuration information at any time, enhancing the ability to handle unexpected problems; this multi-screen display device is designed to be easily expandable, supporting the addition of new devices or adjustment of existing configurations in the future, facilitating subsequent maintenance and upgrades; through the unified management and recording of data, it is convenient to analyze the system operation status, providing data support for subsequent optimization and improvement. It can process multiple video streams simultaneously, support the interaction of different users, achieve multi-screen collaboration, promote team communication and information sharing, and is especially suitable for scenarios such as meetings, training, and demonstrations.

[0160] Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of equivalent technologies of the present invention, the present invention also intends to include these modifications and variations.

Claims

1. A multi-screen display system, characterized in that, Including: A server configuration component, connected to the management - end configuration component and the screen component, responsible for recording the connection relationships among the management - end configuration component, the screen component, and the control - end component; The administrator logs in to the configuration program through the management - end configuration component, registers the first device of the management - end configuration component, the second device of the screen component, and the third device of the control - end component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships; The first device includes computers, tablets, and mobile phones; The second device includes smart TVs; The third device includes tablets, computers, and mobile phones. The management - end configuration component is responsible for using the H5 page of the server configuration component as the management interface, and the management interface is the interface for the administrator to operate the configuration program by logging in through different configuration management - ends. The screen component is responsible for downloading configuration information from the server configuration component by running an application program; During the operation of the application program, it performs screen - area division, obtains video streams, and realizes the playback of video streams on different screens. The control - end component, connected to the screen component, is responsible for real - time controlling the interactive display of the second device of the screen component, receiving two distributed video streams, and realizing the video - stream display on different second devices. The screen component includes: The main display module is responsible for downloading configuration information from the server configuration component, constructing the main application program; Running the main application program and dividing the virtual screen into windows. The main display module includes: The signal acquisition sub - module is responsible for obtaining real - time configuration information and input signals from the main display module, including the content types to be displayed, as well as the priorities and update frequencies of each content; Recording the characteristics of each input source. The dynamic adjustment sub - module is responsible for dividing the virtual areas of the main screen and the secondary screen into several functional blocks, and the size and position of each functional block are dynamically adjusted according to the importance of the input signals. The dividing lines between windows use dynamic separation identifiers; Self - check the content and size of each window and adjust according to the actual display effect. The icon - adding sub - module is responsible for allocating specific content areas on each window, dynamically adjusting the size and position of each window according to operation habits and data update frequencies; After the window division is completed, display information icons at the corners of each window; If the content of a certain window requires the user's attention, the icon blinks; It also allows the user to feedback the window display effect through the right - click menu or touch gestures.

2. The multi-screen display system according to claim 1, characterized in that, The server configuration component includes: The first information storage module is responsible for displaying all available device types, divided into the first device, the second device, and the third device; Registering the first device, inputting device information, including the unique identifier, type, and connection status of each device, and the device information is immediately sent to the server configuration component for structured storage. The second information storage module is responsible for registering the second device, inputting the unique identifier and network information, and the server configuration component automatically records the connection relationship, generates the mapping relationship among the first device, the second device, and the third device; Configuring the relationships among the first device, the second device, and the third device, and establishing a linked association relationship. The device relationship confirmation module is responsible for updating the connection map after receiving the configuration information of the connection association relationship, reflecting the real-time relationship between each device, and storing it in the database in a structured manner; after the configuration of each device is completed, when the screen component starts, it actively downloads the latest configuration information from the server configuration component, and the downloaded information includes the status of all devices, the connection relationship, and the parameters of the video stream.

3. The multi-screen display system according to claim 2, wherein The device relationship confirmation module includes: The program trigger sub-module is responsible for generating a connection configuration information after the administrator completes the registration and association settings between devices in the management end configuration component. The configuration information includes the specific relationship between the first device, the second device, and the third device. The configuration information is transmitted to the server configuration component through the network channel to trigger the flow program for map update; The information splitting sub-module is responsible for parsing the configuration information after the server configuration component receives this connection configuration information, identifying the unique identifiers of each device and the association relationship between them; The server configuration component splits the data of the configuration information into device type, identifier, and connection status information according to the predefined format; The information confirmation sub-module is responsible for finding the currently existing connection map in the stored database. The currently existing connection map is constructed by the device relationship confirmation module and includes the connection information between all existing devices; comparing the newly received connection configuration information with the existing connection map to determine new devices, update the relationship of existing devices, or delete associated information; The update operation sub-module is responsible for performing update operations such as adding new devices, modifying existing connections, removing invalid connections, and constructing structured storage according to the comparison results.

4. The multi-screen display system according to claim 1, characterized in that, The screen component includes: The video channel module is responsible for receiving the video stream of the main display main screen and uploading it to the video server, and at the same time, the secondary screen pulls a new video stream from the video server; The secondary display module is responsible for downloading configuration information from the server configuration component, constructing a secondary application program; running the secondary application program, obtaining the video stream sent from the main screen, and displaying it.

5. The multi-screen display system according to claim 1, wherein, The dynamic adjustment sub-module includes: The grid division unit is responsible for assigning a weight value to each signal after receiving each input signal; using visual analysis to convert the correlation and urgency of different inputs into a dynamic score; creating a geometric grid basis on the virtual screen and dividing it into several functional blocks. In the initial state, the functional blocks evenly distribute space at the same ratio; The window adjustment unit is responsible for enabling the stretching and shrinking algorithm when a high-priority signal enters, that is, the high-priority window will absorb space from the surrounding area, and the low-priority window at the corresponding position will shrink proportionally; The visual reconstruction unit is responsible for the visual reconstruction algorithm, and the size and position of all functional blocks are adjusted so that there is a symmetric relationship and spacing between each window.

6. The multi-screen display system according to claim 4, characterized in that, The secondary display module includes: The bit rate adjustment sub-module is responsible for the secondary screen to establish a connection with the main screen after the application starts, receive the video stream according to the streaming media protocol specified in the configuration file; dynamically adjust the bit rate through adaptive bit rate; An information feedback sub-module, responsible for implementing the logic of user controls, updating the playback state through key callbacks during playback, and collaborating with the main screen to display user experience feedback information; A parameter adjustment sub-module, responsible for overlaying text information or icons on the video, processing the display content, displaying main screen notifications at the edge of the secondary screen, and obtaining multitask content; The secondary screen collects the playback state, sends the data back to the main screen for performance analysis, and the main screen adjusts the parameters of the video stream according to the feedback information.

7. The multi-screen display system according to claim 1, wherein The control end component includes: A connection establishment module, responsible for establishing a connection with the server configuration component, maintaining real-time communication with the management end configuration component and the screen component; obtaining device information through the server configuration component, including the status of the main screen and the secondary screen, the parameters of the current video stream, and the connection relationship; A picture layout module, responsible for receiving two video streams distributed by the main application, receiving these two video streams through streaming media negotiation according to the configuration information; adopting the layout of large pictures and small pictures, and selecting to preview two video streams full screen or simultaneously; An additional function module, responsible for selecting to view the video stream of any path or view two video streams simultaneously through the control end interface; quickly adjusting the display mode of the video stream on one interface; when the user needs to write, after selecting the screen to be edited, automatically switch to only display the target video stream, capture the writing trajectory, and form signaling for each data point of the writing trajectory; A task control module, responsible for sending the writing trajectory information through the signaling trajectory channel, sending the writing trajectory data to the main screen and the secondary screen in a broadcast manner through the signaling trajectory channel, and the main screen and the secondary screen will draw according to the received trajectory information; After the user completes the task, end the control of writing and the video stream, and may save the user's configuration and writing content to the server.

8. A multi-screen display method, characterized in that, It includes the following steps: Start the server configuration component. The server configuration component is connected to the management end configuration component and the screen component, and is responsible for recording the connection relationship between the management end configuration component, the screen component, and the control end component; the administrator logs in to the configuration program through the management end configuration component, registers the first device of the management end configuration component, the second device of the screen component, and the third device of the control end component, and configures the association relationship between the first device, the second device, and the third device according to the connection relationship; the first device includes a computer, a tablet, and a mobile phone; the second device includes a smart TV; the third device includes a tablet, a computer, and a mobile phone; the management end configuration component uses the H5 page of the server configuration component as the management interface, and the management interface is the interface for the administrator to operate the configuration program by logging in to the configuration program through different configuration management ends; The screen component is connected to the server configuration component through the application program, downloads the current configuration information from the server configuration component, and during the operation of the application program, performs screen area division, obtains the video stream, and realizes the playback of the video stream on different screens; The control end component is connected to the screen component, and controls the interactive display of the second device of the screen component in real time, receives the two distributed video streams, and realizes the display of the video streams of different second devices; The screen component includes: The main display module is responsible for downloading configuration information from the server configuration component, constructing the main application program; running the main application program and dividing the virtual screen into windows; The main display module includes: The signal acquisition sub-module is responsible for obtaining real-time configuration information and input signals from the main display module, including the content types to be displayed, as well as the priorities and update frequencies of each piece of content; recording the characteristics of each input source, including resolution, frame rate, and data format; The dynamic adjustment sub-module is responsible for dividing the virtual areas of the main screen and the secondary screen into several functional blocks, and the size and position of each functional block are dynamically adjusted according to the importance of the input signal; The dividing lines between each window adopt dynamic separation identifiers; self-check the content and size of each window and make adjustments according to the actual display effect; The icon addition sub-module is responsible for allocating specific content areas on each window, dynamically adjusting the size and position of each window according to the operation habits and data update frequencies; after the window division is completed, display information icons at the corners of each window; if the content of a certain window requires the user's attention, the icon blinks; it also allows the user to feedback on the window display effect through the right-click menu or touch gestures.

9. A multi-screen display device, characterized in that, It includes: server, management terminal, screen, and control terminal; The server is connected to the management terminal and the screen, and records the connection relationships among the management terminal configuration, the screen, and the control terminal; the administrator logs in to the configuration program through the management terminal, registers the first device of the management terminal, the second device of the screen component, and the third device of the control terminal component, and configures the association relationships among the first device, the second device, and the third device according to the connection relationships; the management terminal is responsible for using the server's H5 page as the management interface, and the management interface is the interface for the administrator to operate by logging in to the configuration program through different configured management terminals; The screen component is responsible for downloading configuration information from the server by running the application program; during the operation of the application program, it performs screen area division, obtains the video stream, and realizes the playback of the video stream on different screens; the control terminal component is connected to the screen component, and controls the interactive display of the second device of the screen component in real time, receives the two distributed video streams, and realizes the display of the video streams of different second devices; The first device includes a computer, a tablet, and a mobile phone; the second device includes a smart TV; the third device includes a tablet, a computer, and a mobile phone; The screen component includes: The main display module is responsible for downloading configuration information from the server configuration component, constructing the main application program; running the main application program and dividing the virtual screen into windows; The main display module includes: The signal acquisition sub-module is responsible for obtaining real-time configuration information and input signals from the main display module, including the content types to be displayed, as well as the priorities and update frequencies of each piece of content; recording the characteristics of each input source; The dynamic adjustment sub-module is responsible for dividing the virtual areas of the main screen and the secondary screen into several functional blocks, and the size and position of each functional block are dynamically adjusted according to the importance of the input signal; The dividing lines between each window adopt dynamic separation identifiers; self-check the content and size of each window and make adjustments according to the actual display effect; The icon addition sub-module is responsible for allocating specific content areas on each window, dynamically adjusting the size and position of each window according to operating habits and data update frequencies; after the window division is completed, information icons are displayed at the corners of each window; if the content of a certain window requires the user's attention, the icon blinks; it also allows the user to feedback on the window display effect through the right-click menu or touch gestures.

Images