Multi-screen display method and device, host, storage medium and program product

Abstract

The invention discloses a multi-screen display method and device, a host, a storage medium and a program product, and relates to the technical field of data processing, and the application comprises the following steps: monitoring a rendering operation of a front-end page through a message monitor; rendering display data according to the rendering operation to obtain rendered data; and the rendered data is sent to each display device, and each display device carries out display based on the rendered data. According to the method and the device, the rendering operation is intensively processed through the host, and then the rendered data is displayed by the display equipment, so that a user can perform the rendering operation on a front-end page without directly performing complex operation on a large screen, the operation difficulty of the user on a multi-screen system is reduced, and the user experience is improved. And the convenience of operating the multi-screen system by the user is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a multi-screen display method, device, host, storage medium and program product. Background Art

[0002] With the continuous advancement of technology, screen size and resolution are constantly increasing, and the screen size and resolution of multi-screen display systems are also increasing. When users use multi-screen display systems, they mainly operate the screen display content through mouse or touch screen interaction. However, the mouse and touch screen interaction methods mainly rely on the user's close-range operation. When the screen size increases to a certain extent or the user needs to watch from a distance, this operation method requires the user to move significantly in front of the screen, affecting the convenience of operating the multi-screen system.

[0003] The above data are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above data are prior art.

[0004] Invention data

[0005] The main purpose of the present application is to provide a multi-screen display method, device, host, storage medium and program product, aiming to solve the technical problem of low operational convenience of a multi-screen display system.

[0006] To achieve the above object, the present application proposes a multi-screen display method, which is applied to a host, the host is communicatively connected with a plurality of display devices, and the multi-screen display method includes:

[0007] Monitor the rendering operation of the front-end page through the message listener;

[0008] Rendering the display data according to the rendering operation to obtain rendered data;

[0009] The rendered data is sent to each of the display devices, wherein each of the display devices performs display based on the rendered data.

[0010] In one embodiment, the host includes a plurality of sub-hosts, any of the sub-hosts is connected to one of the display devices, and the display devices connected to the sub-hosts are different;

[0011] The step of rendering the display data according to the rendering operation to obtain rendered data comprises:

[0012] For any target sub-host among the sub-hosts, detecting whether the display data of the target sub-host matches the operation object of the rendering operation;

[0013] If the display data of the target sub-host matches the operation object, the display data of the target sub-host is rendered according to the rendering operation to obtain rendered data.

[0014] In one embodiment, before the step of sending the rendered data to each of the display devices, the method further includes:

[0015] Splitting the rendered data based on the device splicing mode of each of the display devices to obtain a plurality of target data;

[0016] Determine a display matching relationship between each of the target data and each of the display devices, wherein a set of the display matching relationships includes one of the target data and one of the display devices, and a position of the target data in the display matching relationship in the rendered data is consistent with a position of the display device in the display matching relationship in the plurality of display devices;

[0017] The step of sending the rendered content to each of the display devices comprises:

[0018] The target data are respectively sent to the display devices according to the display matching relationship.

[0019] In one embodiment, before the step of sending the rendered data to each of the display devices, the method further includes:

[0020] For any target device in each of the display devices, obtaining network connection data between the target device and the host;

[0021] Performing feature extraction on the network connection data to obtain a plurality of network connection feature values, performing feature extraction on the rendered data to obtain a plurality of data feature values, and performing feature fusion on the plurality of network connection feature values ​​and the plurality of data feature values ​​to obtain a target feature vector;

[0022] Inputting the target feature vector into a preset delay prediction model to obtain the transmission delay duration of the target device;

[0023] The step of sending the rendered data to each of the display devices comprises:

[0024] Generate a transmission timestamp, and send the transmission delay duration, the transmission timestamp and the rendered data to the target device, wherein the target device determines a theoretical receiving time based on the transmission delay duration and the transmission timestamp, and displays the rendered data if the actual receiving time is greater than or equal to the theoretical receiving time.

[0025] In one embodiment, the step of performing feature fusion on the multiple network connection feature values ​​and the multiple data feature values ​​to obtain a target feature vector includes:

[0026] Normalizing the multiple network connection feature values ​​to obtain multiple normalized network features, and performing vector encoding on the multiple normalized network features to obtain a network feature vector;

[0027] Normalizing the multiple data feature values ​​to obtain multiple normalized data features, and performing vector encoding on the multiple normalized data features to obtain data feature vectors;

[0028] The target feature vector is obtained by performing weighted summation processing on the network feature vector and the data feature vector through a preset weight group.

[0029] In one embodiment, the host includes a plurality of computing nodes;

[0030] The step of rendering the display data according to the rendering operation to obtain rendered data comprises:

[0031] Splitting the display data into multiple sub-data according to the number of the computing nodes;

[0032] Sending each of the sub-data to each of the computing nodes respectively, wherein one computing node corresponds to one of the sub-data, and each of the computing nodes corresponds to different sub-data;

[0033] The computing nodes perform data rendering on the received sub-data according to the rendering operation to obtain a plurality of rendered sub-data, and the rendered sub-data are spliced ​​to obtain rendered data.

[0034] In addition, to achieve the above-mentioned purpose, the present application also proposes a multi-screen display device, which is applied to a host, and the multi-screen display device includes:

[0035] The monitoring module is used to monitor the rendering operation of the front-end page through the message listener;

[0036] A rendering module, used for rendering the display data according to the rendering operation to obtain rendered data;

[0037] A sending module is used to send the rendered data to each of the display devices, wherein each of the display devices performs display based on the rendered data.

[0038] In addition, to achieve the above objectives, the present application also proposes a host, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the multi-screen display method as described above.

[0039] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the multi-screen display method described above are implemented.

[0040] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the multi-screen display method described above are implemented.

[0041] In the present application, the host monitors the rendering operation of the front-end page through a message listener; renders the display data according to the rendering operation to obtain rendered data; and sends the rendered data to each of the display devices, wherein each of the display devices performs display based on the rendered data.

[0042] This application centrally processes rendering operations through the host, and then the display device displays the rendered data, so that users can perform rendering operations on the front-end page without having to perform complex operations directly on the large screen, thereby reducing the difficulty of users operating the multi-screen system and improving the convenience of users operating the multi-screen system.

[0043] Furthermore, compared to rendering the display data based on user operations by a user-end device equipped with a front-end page and then sending it to a display device for display, the present application performs rendering processing through the host, which reduces the space requirements and device computing requirements for the user-end device and improves the convenience of users operating the multi-screen system. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0046] Figure 1 A flowchart of the first embodiment of the multi-screen display method of the present application is provided;

[0047] Figure 2 A flowchart diagram of the second embodiment of the multi-screen display method of the present application;

[0048] Figure 3 A system architecture diagram of a multi-screen display method provided in one embodiment of the present application;

[0049] Figure 4 This is a schematic diagram of the module structure of the multi-screen display device according to an embodiment of the present application;

[0050] Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the multi-screen display method in the embodiment of the present application.

[0051] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0052] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0053] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0054] The main solution of the embodiment of the present application is: the host monitors the rendering operation of the front-end page through a message listener; renders the display data according to the rendering operation to obtain rendered data; sends the rendered data to each of the display devices, wherein each of the display devices displays based on the rendered data.

[0055] In this embodiment, for the convenience of description, the host is used as the execution subject for explanation below.

[0056] With the continuous advancement of technology, screen size and resolution are constantly increasing, and the screen size and resolution of multi-screen display systems are also increasing. When users use multi-screen display systems, they mainly operate the screen display content through mouse or touch screen interaction. However, the mouse and touch screen interaction methods mainly rely on the user's close-range operation. When the screen size increases to a certain extent or the user needs to watch from a distance, this operation method requires the user to move significantly in front of the screen, affecting the convenience of operating the multi-screen system.

[0057] The present application provides a solution, in which a host centrally processes rendering operations, and then a display device displays the rendered data, so that users can perform rendering operations on the front-end page without having to perform complex operations directly on the large screen, thereby reducing the difficulty of users operating the multi-screen system and improving the convenience of users operating the multi-screen system.

[0058] Furthermore, compared to rendering the display data based on user operations by a user-end device equipped with a front-end page and then sending it to a display device for display, the present application performs rendering processing through the host, which reduces the space requirements and device computing requirements for the user-end device and improves the convenience of users operating the multi-screen system.

[0059] It should be noted that the execution subject of this embodiment can be a host with data processing, network communication and program running functions, and the host is communicatively connected with multiple display devices. This embodiment and the following embodiments are described below.

[0060] Based on this, the embodiment of the present application provides a multi-screen display method, referring to Figure 1 , Figure 1 This is a flowchart diagram of the first embodiment of the multi-screen display method of the present application.

[0061] In this embodiment, the multi-screen display method includes steps S10 to S30:

[0062] Step S10, monitoring the rendering operation of the front-end page through a message listener;

[0063] In this embodiment, the multi-screen display system may include a front-end page, a message listener, a host and a display device. The front-end page is an interface for users to interact with the system, which is usually constructed using technologies such as HTML, CSS and JavaScript. The front-end page is responsible for receiving user input (such as clicking, dragging, inputting text, etc.) and converting these operations into rendering operation instructions. The message listener is a device connected to the host for communication or a component deployed on the host, which is responsible for listening to the rendering operation instructions from the front-end page. The message listener can be an independent program or service, or it can be integrated in a certain part of the host operating system, and can use a network communication protocol (such as TCP / IP) to receive the instructions sent by the front-end page. The host processes the rendering operation instructions sent by the front-end page, and renders the display data based on the instructions through the built-in rendering engine. The display device is a terminal for users to watch content, which can be various types of large-screen displays, projectors, etc. The display device is connected to the host through a specific communication protocol (such as HDMI, DP, wireless projection, etc.) to receive the rendered data and display it.

[0064] The message listener captures and records all rendering operations that occur on the front-end page in real time. Rendering operation refers to the process of updating or redrawing the page content on the front-end page according to the user's operation or the system's instructions, including but not limited to the addition, deletion, movement, style change, etc. of elements. Rendering operations can be triggered by user operations, such as clicking a button, dragging an element, etc.; they can also be triggered by system instructions, such as timer-triggered content updates. It is understandable that the message listener can capture the rendering operations of the front-end page in real time, ensuring that the system can respond and process these operations quickly, accurately obtain user intent and page status, and provide a reliable basis for subsequent rendering.

[0065] Step S20, rendering the display data according to the rendering operation to obtain rendered data;

[0066] Display data refers to information or content displayed to the user on a display device, and can be multimedia content such as text, images, and videos. Display data can be pre-stored in the host or from local storage on the user side, and there is no limitation here.

[0067] According to the rendering operation, the stored display data is rendered accordingly, including but not limited to graphics processing, layout adjustment, color correction and other operations, and the original display data is converted into rendered data that meets the requirements of the front-end page through Xu Naran's operation. It can be understood that through unified rendering processing, the system makes the content on different display devices consistent and accurate.

[0068] Step S30: sending the rendered data to each of the display devices, wherein each of the display devices performs display based on the rendered data.

[0069] The rendered data is sent to each display device via a network or other communication method, and the display is displayed according to the received rendered data. It can be understood that the instant transmission and display of the rendered data ensures that the user can see the operation results immediately, which enhances the immediacy and feedback of the interaction.

[0070] In a feasible implementation manner, the host includes a plurality of computing nodes; the step S20: the step of rendering the display data according to the rendering operation to obtain rendered data, comprises:

[0071] Step S201, splitting the display data into multiple sub-data according to the number of the computing nodes;

[0072] A computing node is a hardware device or virtual machine that performs computing tasks in a computing cluster or distributed computing system. In this implementation, a computing node can be a physical hardware device or a virtual machine, and there is no limitation here. Each computing node usually includes a processor, memory and storage devices, and necessary network interfaces for communicating with other nodes and transmitting data. By working together, computing nodes can efficiently process large-scale data sets and complex computing tasks.

[0073] In order to improve rendering efficiency, the display data is split into multiple sub-data and assigned to different computing nodes for processing, which can achieve parallel computing and thus shorten the rendering time. Specifically, the host splits the original display data into multiple smaller sub-data according to the number of computing nodes, each of which contains a part of the original data, and each computing node can independently process a sub-data, thereby achieving parallel rendering. It can be understood that by reasonably allocating tasks, the processing power of the computing nodes can be efficiently utilized to avoid wasting computing resources. In addition, parallel rendering can significantly shorten the rendering time and improve rendering efficiency.

[0074] Step S202, sending each of the sub-data to each of the computing nodes respectively, wherein one computing node corresponds to one sub-data, and each computing node corresponds to different sub-data;

[0075] The split sub-data are sent to the corresponding computing nodes through the network. Each computing node receives a sub-data that matches its processing capability and prepares for rendering.

[0076] Step S203 : Rendering the received sub-data according to the rendering operation by each of the computing nodes to obtain a plurality of rendered sub-data, and splicing the rendered sub-data to obtain rendered data.

[0077] Each computing node performs rendering processing based on the sub-data and rendering operations it receives. The rendering processing may include applying rendering techniques such as textures, lighting effects, and shadows to generate the final rendered sub-data. Then, all the rendered sub-data are spliced ​​together to form complete rendered data. It is understandable that each computing node performs rendering processing independently, which can reduce the accumulation of errors in the rendering process and improve rendering accuracy.

[0078] In this embodiment, the host monitors the rendering operation of the front-end page through a message listener; renders the display data according to the rendering operation to obtain rendered data; and sends the rendered data to each of the display devices, wherein each of the display devices displays based on the rendered data.

[0079] In this embodiment, the host centrally processes the rendering operation, and then the display device displays the rendered data, so that the user can perform rendering operations on the front-end page without having to perform complex operations directly on the large screen, thereby reducing the difficulty of users operating the multi-screen system and improving the convenience of users operating the multi-screen system.

[0080] Furthermore, compared to rendering the display data based on user operations by a user-end device equipped with a front-end page and then sending it to a display device for display, the rendering process is performed by the host in this embodiment, which reduces the space requirements and device computing requirements for the user-end device and improves the convenience of users operating the multi-screen system.

[0081] Based on the first embodiment of the present application, in the second embodiment of the present application, the data that is the same or similar to the above-mentioned embodiment 1 can refer to the above introduction, and will not be repeated later. Figure 2 , the host includes a plurality of sub-hosts, any of the sub-hosts is connected to one display device, and the display devices connected to the sub-hosts are different; the step S20: rendering the display data according to the rendering operation to obtain rendered data, comprises:

[0082] Step S204, for any target sub-host among the sub-hosts, detecting whether the display data of the target sub-host matches the operation object of the rendering operation;

[0083] The host contains multiple sub-hosts, each of which has its own processing power, storage resources and network interface, and can independently run the operating system and applications. In a multi-screen display system, the sub-host is responsible for processing the data rendering and transmission tasks related to the display device connected to it. Each sub-host is connected to an independent display device and has its own display data that needs to be processed.

[0084] Each sub-host receives the rendering operation, traverses each sub-host, calls the currently traversed sub-host the target sub-host, and detects whether the display data of the target sub-host matches the operation object of the rendering operation. It should be noted that the match refers to the consistency in content or attributes between the display data of the sub-host and the operation object of the rendering operation.

[0085] Step S205: If the display data of the target sub-host matches the operation object, the display data of the target sub-host is rendered according to the rendering operation to obtain rendered data.

[0086] When the display data matches the operation object, it is determined that the display data of the target sub-host needs to be rendered, and the target sub-host renders the display data according to the requirements of the rendering operation to generate final rendered data.

[0087] In a feasible implementation manner, before the step S30: sending the rendered data to each of the display devices, the step further includes:

[0088] Step S01, splitting the rendered data based on the device splicing mode of each display device to obtain a plurality of target data;

[0089] Since a multi-screen display system usually involves the splicing of multiple display devices, such as horizontal splicing, vertical splicing, arc splicing, etc., each display device is responsible for displaying a portion of the entire screen. Therefore, according to the splicing method and parameters of the display device, the rendered data is accurately split into multiple target data to ensure that each display device can receive the data portion that matches its display area. It can be understood that by splitting the rendered data, each display device receives the target data that matches its display area, avoiding screen misalignment or overlap.

[0090] Step S02, determining a display matching relationship between each of the target data and each of the display devices, wherein a set of the display matching relationships includes one of the target data and one of the display devices, and a position of the target data in the display matching relationship in the rendered data is consistent with a position of the display device in the display matching relationship in the plurality of display devices;

[0091] A matching relationship is established between each target data and the corresponding display device. The matching relationship ensures that each part of the rendered data is correctly sent to the corresponding display device. It should be noted that a set of display matching relationships includes one target data and one display device. The position of the target data in the display matching relationship in the rendered data is consistent with the position of the display device in the display matching relationship among the multiple display devices.

[0092] By establishing a matching relationship, each target data is sent to the correct display device to avoid data confusion or loss. In addition, the matching relationship can be dynamically adjusted as the display devices are increased or decreased or the splicing method is changed, enhancing the flexibility and adaptability of multi-screen display.

[0093] The step S30: sending the rendered content to each of the display devices, comprises:

[0094] Step S301 : sending each of the target data to each of the display devices respectively according to the display matching relationship.

[0095] According to the established display matching relationship, each target data is sent to the corresponding display device. It can be understood that by sending the target data according to the matching relationship, collaborative display between multiple display devices can be achieved, presenting a coherent and complete picture, and improving the stability of multi-screen display.

[0096] In a feasible implementation manner, before the step S30: sending the rendered data to each of the display devices, the step further includes:

[0097] Step S03, for any target device in each of the display devices, obtaining network connection data between the target device and the host;

[0098] In order to optimize data transmission and reduce display delays or errors caused by network problems, the network connection status between the target device and the host is used to evaluate the reliability and performance of the network connection to provide a basis for subsequent data transmission. Specifically, the network connection information between each target display device and the host is obtained. The network connection information is indicator data that characterizes the quality of the network connection, including but not limited to key performance indicators such as network bandwidth, delay, packet loss rate, and jitter.

[0099] Step S04, performing feature extraction on the network connection data to obtain a plurality of network connection feature values, performing feature extraction on the rendered data to obtain a plurality of data feature values, and performing feature fusion on the plurality of network connection feature values ​​and the plurality of data feature values ​​to obtain a target feature vector;

[0100] The network connection data is feature extracted to obtain a plurality of network connection feature values, the rendered data is feature extracted to obtain a plurality of data feature values, and the network connection feature values ​​and the data feature values ​​are fused into a target feature vector for subsequent delay prediction. It can be understood that through feature extraction and fusion, the characteristics of the network connection and rendered data can be more comprehensively considered, thereby improving the accuracy of delay prediction.

[0101] Step S05, inputting the target feature vector into a preset delay prediction model to obtain the transmission delay duration of the target device;

[0102] The delay prediction model is trained by taking different network connection information and different rendering data as input data and the corresponding transmission delay duration as label. The specific training process is not limited here and can be set according to actual needs. The delay prediction model can be a neural network model, a support vector machine model, a decision tree, a random forest, a gradient boosting machine, etc. In this implementation, the target feature vector is input into a preset delay prediction model to predict the transmission delay duration of the target device.

[0103] The step S30: sending the rendered data to each of the display devices, comprises:

[0104] Step S302, generate a transmission timestamp, and send the transmission delay duration, the transmission timestamp and the rendered data to the target device, wherein the target device determines a theoretical receiving time based on the transmission delay duration and the transmission timestamp, and displays the rendered data if the actual receiving time is greater than or equal to the theoretical receiving time.

[0105] A transmission timestamp is generated before the transmission timestamp and the rendered data are sent, and the transmission timestamp is sent to the target device together with the transmission timestamp and the rendered data. After receiving the transmission delay duration, the transmission timestamp and the rendered data, the target device will obtain the theoretical receiving time by superimposing the transmission delay duration on the transmission timestamp, and display the rendered data when the actual receiving time reaches or exceeds the theoretical receiving time; if the actual receiving time does not reach the theoretical receiving time, the rendered data will be displayed when the actual receiving time reaches the theoretical receiving time.

[0106] It can be understood that by considering the transmission delay duration and generating a transmission timestamp, multiple display devices can synchronously display the rendered data, thereby improving the user experience.

[0107] In a feasible implementation manner, the step S04: the step of performing feature fusion on the multiple network connection feature values ​​and the multiple data feature values ​​to obtain a target feature vector, comprises:

[0108] Step S041, normalizing the plurality of network connection feature values ​​to obtain a plurality of normalized network features, and vector encoding the plurality of normalized network features to obtain a network feature vector;

[0109] A plurality of network connection eigenvalues ​​are normalized to eliminate the dimensional differences between different eigenvalues. The normalized network eigenvalues ​​are encoded as network eigenvectors. The specific processing process is not limited here.

[0110] Step S042, normalizing the multiple data feature values ​​to obtain multiple normalized data features, and vector encoding the multiple normalized data features to obtain a data feature vector;

[0111] Normalization processing is performed on multiple data feature values ​​to obtain normalized data features, and vector encoding is performed on the normalized data features to obtain data feature vectors.

[0112] Step S043: performing weighted summation processing on the network feature vector and the data feature vector using a preset weight group to obtain a target feature vector.

[0113] A first weighted feature vector of the network feature vector is calculated according to the first vector weight, and a second weighted feature vector of the data feature vector is calculated according to the second vector weight; and a target feature vector is obtained by performing vector fusion on the first weighted feature vector and the second weighted feature vector.

[0114] In this embodiment, the host centrally processes the rendering operation, and then the display device displays the rendered data, so that the user can perform rendering operations on the front-end page without having to perform complex operations directly on the large screen, thereby reducing the difficulty of users operating the multi-screen system and improving the convenience of users operating the multi-screen system.

[0115] Furthermore, compared to rendering the display data based on user operations by a user-end device equipped with a front-end page and then sending it to a display device for display, the rendering process is performed by the host in this embodiment, which reduces the space requirements and device computing requirements for the user-end device and improves the convenience of users operating the multi-screen system.

[0116] For example, to help understand the implementation process of the multi-screen display method obtained by combining the first embodiment and the second embodiment, please refer to Figure 3 , Figure 3 A system architecture diagram of a multi-screen display method is provided, the system comprising:

[0117] (1) Central control page (also known as front-end page). The central control page is created by the front-end to ensure that it can be accessed from different locations and different devices within the local area network.

[0118] (2) A message listener, which is used to monitor rendering operations and send them to the host connected to the port.

[0119] (3) A host, which is used to process rendering operations based on the rendering operations detected by the message listener.

[0120] (4) A display device for displaying based on the rendered data sent by the host.

[0121] The process of multi-screen display based on the above system architecture can be: the message listener listens to the rendering operation of the front-end page. The host listens to the rendering operation of the front-end page through the message listener; renders the display data according to the rendering operation to obtain the rendered data; and sends the rendered data to each of the display devices. Each of the display devices displays based on the rendered data. In this embodiment, through the central control page developed by the front-end, the control device can be a host, a tablet computer or even a mobile phone, thereby eliminating spatial limitations; all devices in the system are connected through the message listener, so that messages can be efficiently and concurrently transmitted, reducing interaction delays.

[0122] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the multi-screen display method of the present application. More simple transformations based on this technical concept are all within the protection scope of the present application.

[0123] This application also provides a multi-screen display device, please refer to Figure 4 , the multi-screen display device is applied to a host, and the multi-screen display device comprises:

[0124] The monitoring module 10 is used to monitor the rendering operation of the front-end page through a message monitor;

[0125] A rendering module 20, configured to render the display data according to the rendering operation to obtain rendered data;

[0126] The sending module 30 is used to send the rendered data to each of the display devices, wherein each of the display devices performs display based on the rendered data.

[0127] The host includes a plurality of sub-hosts, any of the sub-hosts is connected to one display device, and the display devices connected to the sub-hosts are different; the rendering module 20 is also used for:

[0128] For any target sub-host among the sub-hosts, detecting whether the display data of the target sub-host matches the operation object of the rendering operation;

[0129] If the display data of the target sub-host matches the operation object, the display data of the target sub-host is rendered according to the rendering operation to obtain rendered data.

[0130] Optionally, the device further comprises a splitting module, configured to:

[0131] Splitting the rendered data based on the device splicing mode of each of the display devices to obtain a plurality of target data;

[0132] Determine a display matching relationship between each of the target data and each of the display devices, wherein a set of the display matching relationships includes one of the target data and one of the display devices, and a position of the target data in the display matching relationship in the rendered data is consistent with a position of the display device in the display matching relationship in the plurality of display devices;

[0133] The sending module 30 is also used for:

[0134] The target data are respectively sent to the display devices according to the display matching relationship.

[0135] Optionally, the device further comprises a prediction module:

[0136] For any target device in each of the display devices, obtaining network connection data between the target device and the host;

[0137] Performing feature extraction on the network connection data to obtain a plurality of network connection feature values, performing feature extraction on the rendered data to obtain a plurality of data feature values, and performing feature fusion on the plurality of network connection feature values ​​and the plurality of data feature values ​​to obtain a target feature vector;

[0138] Inputting the target feature vector into a preset delay prediction model to obtain the transmission delay duration of the target device;

[0139] The sending module 30 is also used for:

[0140] Generate a transmission timestamp, and send the transmission delay duration, the transmission timestamp and the rendered data to the target device, wherein the target device determines a theoretical receiving time based on the transmission delay duration and the transmission timestamp, and displays the rendered data if the actual receiving time is greater than or equal to the theoretical receiving time.

[0141] Optionally, the prediction module is further used for:

[0142] Normalizing the multiple network connection feature values ​​to obtain multiple normalized network features, and performing vector encoding on the multiple normalized network features to obtain a network feature vector;

[0143] Normalizing the multiple data feature values ​​to obtain multiple normalized data features, and performing vector encoding on the multiple normalized data features to obtain data feature vectors;

[0144] The target feature vector is obtained by performing weighted summation processing on the network feature vector and the data feature vector through a preset weight group.

[0145] Optionally, the host includes a plurality of computing nodes; the rendering module 20 is further used for:

[0146] Splitting the display data into multiple sub-data according to the number of the computing nodes;

[0147] Sending each of the sub-data to each of the computing nodes respectively, wherein one computing node corresponds to one of the sub-data, and each of the computing nodes corresponds to different sub-data;

[0148] The computing nodes perform data rendering on the received sub-data according to the rendering operation to obtain a plurality of rendered sub-data, and the rendered sub-data are spliced ​​to obtain rendered data.

[0149] The multi-screen display device provided by the present application adopts the multi-screen display method in the above embodiment, which can solve the technical problem of low operation convenience of the multi-screen display system. Compared with the prior art, the beneficial effects of the multi-screen display device provided by the present application are the same as the beneficial effects of the multi-screen display method provided by the above embodiment, and other technical features in the multi-screen display device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0150] The present application provides a host, which includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the multi-screen display method in the above-mentioned embodiment.

[0151] Reference below Figure 5 , which shows a schematic diagram of the structure of a host suitable for implementing the embodiment of the present application. The host in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The host shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0152] like Figure 5As shown, the host may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the host are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the host to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a host with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0153] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0154] The host provided by the present application adopts the multi-screen display method in the above embodiment, which can solve the technical problem of low operation convenience of the multi-screen display system. Compared with the prior art, the beneficial effects of the host provided by the present application are the same as the beneficial effects of the multi-screen display method provided by the above embodiment, and other technical features in the host are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0155] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0156] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0157] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the multi-screen display method in the above-mentioned embodiment.

[0158] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0159] The computer-readable storage medium may be included in the host; or may exist independently without being installed in the host.

[0160] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the host, the host: listens to the rendering operation of the front-end page through the message listener; renders the display data according to the rendering operation to obtain rendered data; and sends the rendered data to each of the display devices, wherein each of the display devices displays based on the rendered data.

[0161] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0162] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0163] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0164] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned multi-screen display method, and can solve the technical problem of low operational convenience of the multi-screen display system. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the multi-screen display method provided in the above-mentioned embodiment, and will not be repeated here.

[0165] The present application also provides a computer program product, including a computer program, which implements the steps of the multi-screen display method as described above when executed by a processor.

[0166] The computer program product provided by the present application can solve the technical problem of low operational convenience of the multi-screen display system. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the multi-screen display method provided by the above embodiment, which will not be repeated here.

[0167] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural transformations made using the specification and accompanying data of the present application under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A multi-screen display method, characterized in that: The multi-screen display method is applied to a host, the host is communicatively connected with a plurality of display devices, and the multi-screen display method comprises: Monitor the rendering operation of the front-end page through the message listener; Rendering the display data according to the rendering operation to obtain rendered data; The rendered data is sent to each of the display devices, wherein each of the display devices performs display based on the rendered data.

2. The multi-screen display method according to claim 1, wherein: The host includes a plurality of sub-hosts, any of the sub-hosts is connected to one display device, and the display devices connected to the sub-hosts are different; The step of rendering the display data according to the rendering operation to obtain rendered data comprises: For any target sub-host among the sub-hosts, detecting whether the display data of the target sub-host matches the operation object of the rendering operation; If the display data of the target sub-host matches the operation object, the display data of the target sub-host is rendered according to the rendering operation to obtain rendered data.

3. The multi-screen display method according to claim 1, wherein: Before the step of sending the rendered data to each of the display devices, the step further includes: Splitting the rendered data based on the device splicing mode of each of the display devices to obtain a plurality of target data; Determine a display matching relationship between each of the target data and each of the display devices, wherein a set of the display matching relationships includes one of the target data and one of the display devices, and a position of the target data in the display matching relationship in the rendered data is consistent with a position of the display device in the display matching relationship in the plurality of display devices; The step of sending the rendered content to each of the display devices comprises: The target data are respectively sent to the display devices according to the display matching relationship.

4. The multi-screen display method according to claim 1, wherein: Before the step of sending the rendered data to each of the display devices, the step further includes: For any target device in each of the display devices, obtaining network connection data between the target device and the host; Performing feature extraction on the network connection data to obtain a plurality of network connection feature values, performing feature extraction on the rendered data to obtain a plurality of data feature values, and performing feature fusion on the plurality of network connection feature values ​​and the plurality of data feature values ​​to obtain a target feature vector; Inputting the target feature vector into a preset delay prediction model to obtain the transmission delay duration of the target device; The step of sending the rendered data to each of the display devices comprises: Generate a transmission timestamp, and send the transmission delay duration, the transmission timestamp and the rendered data to the target device, wherein the target device determines a theoretical receiving time based on the transmission delay duration and the transmission timestamp, and displays the rendered data if the actual receiving time is greater than or equal to the theoretical receiving time.

5. The multi-screen display method according to claim 4, characterized in that: The step of performing feature fusion on the multiple network connection feature values ​​and the multiple data feature values ​​to obtain a target feature vector comprises: Normalizing the multiple network connection feature values ​​to obtain multiple normalized network features, and performing vector encoding on the multiple normalized network features to obtain a network feature vector; Normalizing the multiple data feature values ​​to obtain multiple normalized data features, and performing vector encoding on the multiple normalized data features to obtain data feature vectors; The target feature vector is obtained by performing weighted summation processing on the network feature vector and the data feature vector through a preset weight group.

6. The multi-screen display method according to any one of claims 1 to 5, characterized in that: The host includes a plurality of computing nodes; The step of rendering the display data according to the rendering operation to obtain rendered data comprises: Splitting the display data into multiple sub-data according to the number of the computing nodes; Sending each of the sub-data to each of the computing nodes respectively, wherein one computing node corresponds to one of the sub-data, and each of the computing nodes corresponds to different sub-data; The computing nodes perform data rendering on the received sub-data according to the rendering operation to obtain a plurality of rendered sub-data, and the rendered sub-data are spliced ​​to obtain rendered data.

7. A multi-screen display device, characterized in that: The multi-screen display device is applied to a host, and the multi-screen display device comprises: The monitoring module is used to monitor the rendering operation of the front-end page through the message listener; A rendering module, used for rendering the display data according to the rendering operation to obtain rendered data; A sending module is used to send the rendered data to each of the display devices, wherein each of the display devices performs display based on the rendered data.

8. A host, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the multi-screen display method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the multi-screen display method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the multi-screen display method according to any one of claims 1 to 6 are implemented.

Images