Ultrahigh-resolution large-screen split-screen synchronous rendering method and system

Abstract

The invention discloses an ultrahigh-resolution large-screen split-screen synchronous rendering method and system, and the method comprises the steps: collecting the resolution of each device and a mapping relation between a graphic workstation and a large-screen logic partition, and generating a page-large-screen-graphic workstation synchronous coordinate array through a synchronous rendering algorithm; and simultaneously sending data to the plurality of graphic workstations according to the IP address in the array by using a UDP protocol. And a high-resolution synchronous rendering client on the graphic workstation receives the data, analyzes the coordinate array, splices the coordinate array into a URL plus coordinate page service request, loads a page part specified by the coordinate to a background service, renders the loaded page on the plurality of graphic workstations, and finally splices and presents an ultrahigh-resolution complete page on a large screen. And synchronous loading and rendering of contents of an ultrahigh-resolution large screen are realized. According to the method, the problem that point-to-point synchronous rendering and on-screen of pages under ultrahigh resolution are difficult to realize is solved, and the method is widely applicable to high-resolution large-screen display in scenes such as command centers and monitoring systems.

Description

Technical Field

[0001] The present invention relates to a high-resolution large-screen rendering method, and in particular to an ultra-high-resolution large-screen split-screen synchronous rendering method and system. Background Art

[0002] With the development of informatization and the popularization of large-screen display technology, large screens are widely used in operation centers, command centers, monitoring centers, exhibition halls, museums and other places. The ultra-high-resolution large screen in the present invention refers to a large screen with more than 4 4K resolution display screens. In actual use, in order to make full use of the area and ultra-high resolution of the large screen, the display page usually uses point-to-point resolution on the screen (consistent with the resolution of the large screen) to provide a better viewing experience.

[0003] However, the existing technology has the following problems when implementing point-to-point synchronous loading of ultra-high-resolution large-screen content onto the screen:

[0004] It is difficult to display ultra-high resolution point-to-point on the screen: the existing general-purpose graphics workstations support a maximum resolution of 3*4k, which cannot meet the needs of displaying ultra-high resolution pages of 4*4k and above on the screen; poor scalability: when the screen resolution or the number of partitions changes, the existing technology is difficult to adapt. Summary of the invention

[0005] Purpose of the invention: In view of the above problems, the present invention proposes a method and system for ultra-high-resolution large-screen split-screen synchronous rendering, which realizes the synchronous loading and on-screen display of ultra-high-resolution presentation pages, and solves the problem that the current ultra-high-resolution pages cannot be displayed on the screen point-to-point.

[0006] Technical solution: The technical solution adopted by the present invention is a method for synchronous rendering of a large screen with ultra-high resolution and split screen, wherein the large screen with ultra-high resolution refers to a large screen composed of no less than four display screens with a resolution of no less than 4K, and is characterized in that it includes: collecting the large screen resolution, the IP address of the graphics workstation, and the mapping relationship between the graphics workstation and the large screen logical partition, and obtaining the URL address of the page to be rendered; processing the resolution of the page to be rendered to be consistent with the resolution of the large screen; generating the synchronous coordinates of the page-large screen according to the large screen resolution and the mapping relationship between the graphics workstation and the large screen logical partition, and then generating the synchronous coordinate array of the page-large screen-graphics workstation in combination with the URL address of the page to be rendered and the IP address of the graphics workstation; parsing the page-large screen-graphics workstation A synchronization coordinate array is obtained, and synchronization request data is sent to multiple graphic workstations simultaneously using the UDP protocol according to the IP addresses in the array, wherein the synchronization request data includes the URL address and the synchronization coordinates of the page-large screen; the graphic workstation listens to the synchronization request, and splices the URL address and the synchronization coordinates of the page-large screen obtained by parsing the synchronization request data into a page service request of the URL address plus the synchronization coordinates, and requests the background Web service to load the local page specified by the coordinates; multiple graphic workstations render the loaded local pages; the local pages rendered by multiple graphic workstations are simultaneously transmitted to the large screen for display through the video transmission channel, and finally a complete page with ultra-high resolution is spliced ​​on the large screen, so as to realize the synchronous display and rendering of the ultra-high resolution page.

[0007] According to the large-screen resolution and the mapping relationship between the graphics workstation and the large-screen logical partition, the page-large-screen synchronization coordinates are generated, including: cutting the page to be rendered into corresponding page slices according to the large-screen resolution, and calculating the coordinate position of each page slice on the page to be rendered, and the coordinate position is used as the page-large-screen synchronization coordinate.

[0008] The page-large screen-graphics workstation synchronization coordinate array includes: the URL address of the page to be rendered, the page-large screen synchronization coordinates and the graphics workstation IP address.

[0009] A synchronous rendering client is provided on the graphics workstation, and the synchronous rendering client listens to the synchronization request in real time through the socket service.

[0010] When the client listens to the synchronization request data, it parses the URL address of the page to be rendered and the synchronization coordinates of the page and the large screen, splices the URL address and the synchronization coordinates into a new URL request address, calls the browser driver, opens the browser, initiates a request to the background web service on the browser with the new URL request address, and loads the rendered return page.

[0011] The present invention proposes an ultra-high-resolution large-screen split-screen synchronous rendering system, comprising a backend service unit, a graphics workstation, a splicing controller and a large screen connected in sequence;

[0012] The backend service unit is used to: collect the large screen resolution, the graphics workstation IP address, and the mapping relationship between the graphics workstation and the large screen logical partition, and obtain the URL address of the page to be rendered; process the resolution of the page to be rendered to be consistent with the large screen resolution; generate the page-large screen synchronization coordinates according to the large screen resolution and the mapping relationship between the graphics workstation and the large screen logical partition, and then generate the page-large screen-graphics workstation synchronization coordinate array in combination with the URL address of the page to be rendered and the graphics workstation IP address; parse the data of the page-large screen-graphics workstation synchronization coordinate array, and send synchronization request data to multiple graphics workstations at the same time according to the IP addresses in the array using the UDP protocol, wherein the synchronization request data includes the URL address and the page-large screen synchronization coordinates;

[0013] Graphics workstation, which is equipped with a synchronous rendering client. The synchronous rendering client monitors the synchronization request in real time through the socket service, and splices the URL address and the page-large screen synchronization coordinates obtained by parsing the synchronization request data into a page service request of the URL address plus the synchronization coordinates, and requests the background Web service to load the local page specified by the coordinates; multiple graphics workstations render the loaded local pages;

[0014] The splicing controller, the graphics workstation is connected to the splicing controller through the graphics card to form a video transmission channel. Multiple graphics workstations transmit the rendered partial pages to the splicing controller in real time through the video transmission channel.

[0015] The large screen is an ultra-high-resolution large screen, composed of no less than four display screens, and the display screen resolution is no less than 4K; the splicing controller simultaneously transmits multiple rendered local pages to the large screen for display.

[0016] The background service unit queries the background database to collect the large-screen resolution that needs to be displayed, the resolution of the page to be rendered, the mapping relationship between the graphics workstation and the large-screen logical partition, the graphics workstation IP address, and the URL address of the page to be rendered; if the large-screen resolution and the resolution of the page to be rendered are inconsistent, the page to be rendered is processed to make the resolution of the page to be rendered consistent with the large-screen resolution.

[0017] According to the large-screen resolution and the mapping relationship between the graphics workstation and the large-screen logical partition, the page-large-screen synchronization coordinates are generated, including: cutting the page to be rendered into corresponding page slices according to the large-screen resolution, and calculating the coordinate position of each page slice on the page to be rendered, and the coordinate position is used as the page-large-screen synchronization coordinate.

[0018] The page-large screen-graphics workstation synchronization coordinate array includes: the URL address of the page to be rendered, the page-large screen synchronization coordinates and the graphics workstation IP address.

[0019] When the client listens to the synchronization request data, it parses the URL address of the page to be rendered and the synchronization coordinates of the page and the large screen, splices the URL address and the synchronization coordinates into a new URL request address, calls the browser driver, opens the browser, initiates a request to the background web service on the browser with the new URL request address, and loads the rendered return page.

[0020] Beneficial effects: Compared with the prior art, the present invention has the following advantages: The present invention solves the difficulty of ultra-high-resolution pages being unable to be displayed on the screen point-to-point, and realizes the demand for ultra-high-resolution display pages of 4*4k and above to be displayed on the screen point-to-point. Strong flexibility and scalability: When the resolution of the large screen and the number of partitions change, it can be flexibly adapted, and the synchronous rendering is not affected, with extremely strong flexibility and scalability. High synchronization: The time difference for the page to start synchronous rendering is less than 50ms, and the synchronous loading delay of the page cannot be perceived by the naked eye, with high synchronization. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a flowchart of the ultra-high-resolution large-screen split-screen synchronous rendering method of the present invention;

[0022] Figure 2 It is a schematic diagram of the architecture of the ultra-high-resolution large-screen split-screen synchronous rendering system described in the present invention. DETAILED DESCRIPTION

[0023] The technical solution of the present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0024] Example 1

[0025] The ultra-high-resolution large-screen split-screen synchronous rendering method of the present invention is as follows: Figure 1 As shown. It includes the following parts:

[0026] 1. Get synchronous rendering parameters

[0027] The ultra-high-resolution large-screen synchronous rendering server queries the backend database to collect the large-screen resolution that needs to be displayed, the resolution of the page to be rendered, the mapping relationship between the large-screen partitions (the mapping relationship between the large-screen partitions and the graphics workstation), and the IP address of the graphics workstation. Get the URL address of the page to be rendered.

[0028] 2. Synchronous rendering algorithm

[0029] The synchronous rendering algorithm cuts the page to be rendered into corresponding page fragments according to the large screen resolution, the resolution of the page to be rendered, the mapping relationship between the large screen partition and the graphics workstation, the IP address of the graphics workstation, and the URL address of the page to be rendered according to the large screen resolution, and calculates the coordinate position of the fragment on the page to be rendered. Generate an array containing the URL address of the page to be rendered, the page coordinates, and the IP address of the graphics workstation.

[0030] Example of synchronous rendering algorithm:

[0031] The resolution of the large screen is 15,280*2160. According to the pixel-to-pixel requirement, the resolution of the web page on the screen is 15,280*2160. The solution of pushing the screen by 4 graphics workstations is adopted. According to the principle of synchronous rendering algorithm, the large screen is divided into 4 areas, each area is a 4K display, and each area corresponds to a graphics workstation signal input. Each graphics workstation renders a 4K area of ​​the display page, and the array is as follows:

[0032] {

[0033] {url,ip1,{0,0,3820,2160}}

[0034] {url,ip2,{3920,0,7640,2160}}

[0035] {url,ip3,{7640,0,11,460,2160}}

[0036] {url,ip4,{11,460,0,15,280,2160}

[0037] }

[0038] The backend service parses the array. For example, the first data in the array is {url, ip1, {0, 0, 3820, 2160}}, where url is the page to be rendered by the graphics workstation, ip1 is the graphics workstation ip1 corresponding to the large screen area 1, and {0, 0, 3820, 2160} is the page coordinates for local rendering of the page specified by url on the graphics workstation. After parsing the array, the backend service encapsulates the url and coordinates into the UDP transmission data format and sends the data to the graphics workstation with the IP address ip1.

[0039] 3. Data Transmission

[0040] The ultra-high resolution synchronous rendering service reads the two-dimensional array and sends the URL and coordinates in the array to the graphics workstation corresponding to the IP address in the array record through the UDP protocol. The client software in the graphics workstation will receive the data.

[0041] 4. Ultra-high resolution simultaneous rendering client processing

[0042] The ultra-high resolution synchronous rendering client is installed and deployed on the graphics workstation, and uses the socket service to listen to the request data sent by the background ultra-high resolution synchronous rendering service in real time. When the client listens to the data, it parses the URL address and page coordinates of the page to be rendered, splices the URL address and coordinates into a new URL request address, calls the browser driver, opens the browser, and initiates a request to the background web service on the browser with the new URL request address, and loads the rendered return page. The rendered pages returned on multiple graphics workstations will together form a complete ultra-high resolution display page. Multiple graphics workstations simultaneously load the page slices of the page to be rendered to achieve synchronous rendering.

[0043] 5. Large screen splicing

[0044] The graphics workstation is connected to the splicing controller through the graphics card to form a video transmission channel. Multiple graphics workstations transmit the partial content of the page to the splicing controller in real time through different signal channels. The splicing controller outputs the partial images on the graphics workstation to the large screen through the video signal channel, and finally combines them on the large screen to form an ultra-high-resolution point-to-point display page, realizing the synchronous loading and display of the page.

[0045] Example 2

[0046] The ultra-high-resolution large-screen split-screen synchronous rendering system of the present invention has a schematic diagram as shown in Figure 2 It includes background service unit, graphic workstation, splicing controller and large screen. The functions of each component are as follows:

[0047] 1. The background service unit is the background service layer of this system, which is used to read the large screen resolution, the resolution of the page to be rendered, the mapping relationship between the graphics workstation and the large screen logical partition, generate the coordinate synchronization array through the synchronous rendering algorithm, integrate the URL, and send the URL to the graphics workstation through the service socket interface.

[0048] The synchronous rendering algorithm cuts the page to be rendered into corresponding page fragments according to the large-screen resolution, the resolution of the page to be rendered, the mapping relationship between the large-screen partition and the graphics workstation, the IP address of the graphics workstation, and the URL address of the page to be rendered, and calculates the coordinate position of the fragment on the page to be rendered.

[0049] 2. The graphics workstation is the operating environment for the synchronous rendering client and page slices. The page slices are loaded and rendered on the graphics workstation. The graphics workstation is equipped with a synchronous rendering client. The synchronous rendering client is the client software for synchronous loading and rendering of page slices. It listens to and reads socket data, obtains the page slice URL and page slice coordinate data, calls the browser driver API, and renders the specified part of the ultra-high-resolution page according to the coordinates, realizing the synchronous loading and rendering of page slices.

[0050] 3. The splicing controller is connected to the large screen. The splicing controller outputs the local images on the graphics workstation to the large screen through the video signal channel, and finally combines them on the large screen to form an ultra-high-resolution point-to-point display page, realizing synchronous loading and display of the page.

[0051] 4. The large screen is an ultra-high-resolution large screen, including more than four 4k resolution display screens. The graphics workstation is connected to the splicing controller through the graphics card to form a video transmission channel. Multiple graphics workstations simultaneously transmit the partial content of the page to the splicing controller in real time. The splicing controller outputs each partial screen on the graphics workstation to the large screen through the video signal channel, and finally combines them on the large screen to form an ultra-high-resolution point-to-point display page, realizing the synchronous loading and display of the page.

Claims

1. A method for synchronously rendering a large ultra-high-resolution screen with split screens, wherein the large ultra-high-resolution screen refers to a large screen composed of no less than four display screens with a resolution of no less than 4K, characterized in that: include: Collect the large screen resolution, the IP address of the graphics workstation, the mapping relationship between the graphics workstation and the large screen logical partition, and obtain the URL address of the page to be rendered; Make sure the resolution of the page to be rendered is consistent with the resolution of the large screen; Generate page-large screen synchronization coordinates according to the large screen resolution and the mapping relationship between the graphics workstation and the large screen logical partition, and then generate page-large screen-graphics workstation synchronization coordinate array in combination with the URL address of the page to be rendered and the graphics workstation IP address; parse the page-large screen-graphics workstation synchronization coordinate array, and send synchronization request data to multiple graphics workstations simultaneously using the UDP protocol according to the IP addresses in the array, wherein the synchronization request data includes the URL address and the page-large screen synchronization coordinates; The graphic workstation listens to the synchronization request, and according to the URL address and the synchronization coordinates of the page-large screen obtained by parsing the synchronization request data, splices them into a page service request of the URL address plus the synchronization coordinates, and requests the background Web service to load the partial page specified by the coordinates; multiple graphic workstations render the loaded partial pages; the partial pages rendered by multiple graphic workstations are simultaneously transmitted to the large screen through the video transmission channel for display.

2. The ultra-high-resolution large-screen split-screen synchronous rendering method according to claim 1 is characterized in that: According to the large-screen resolution and the mapping relationship between the graphics workstation and the large-screen logical partition, the page-to-large-screen synchronization coordinates are generated, including: cutting the page to be rendered into corresponding page slices according to the large-screen resolution, and calculating the coordinate position of each page slice on the page to be rendered, and the coordinate position is used as the page-to-large-screen synchronization coordinates.

3. The ultra-high-resolution large-screen split-screen synchronous rendering method according to claim 1 is characterized in that: The page-large screen-graphics workstation synchronization coordinate array includes: the URL address of the page to be rendered, the page-large screen synchronization coordinates and the graphics workstation IP address.

4. The ultra-high resolution large-screen split-screen synchronous rendering method according to claim 1 is characterized in that: A synchronous rendering client is provided on the graphics workstation, and the synchronous rendering client listens to the synchronization request in real time through the socket service.

5. The ultra-high-resolution large-screen split-screen synchronous rendering method according to claim 1 is characterized in that: When the client listens to the synchronization request data, it parses the URL address of the page to be rendered and the synchronization coordinates of the page and the large screen, splices the URL address and the synchronization coordinates into a new URL request address, calls the browser driver, opens the browser, initiates a request to the background web service on the browser with the new URL request address, and loads the rendered return page.

6. An ultra-high-resolution large-screen split-screen synchronous rendering system, characterized by: It includes backend service unit, graphic workstation, splicing controller and large screen connected in sequence; The backend service unit is used to collect the large screen resolution, the IP address of the graphics workstation, the mapping relationship between the graphics workstation and the large screen logical partition, and obtain the URL address of the page to be rendered; Make sure the resolution of the page to be rendered is consistent with the resolution of the large screen; Generate page-large screen synchronization coordinates according to the large screen resolution and the mapping relationship between the graphics workstation and the large screen logical partition, and then generate page-large screen-graphics workstation synchronization coordinate arrays in combination with the URL address of the page to be rendered and the IP address of the graphics workstation; parse the data of the page-large screen-graphics workstation synchronization coordinate array, and send synchronization request data to multiple graphics workstations simultaneously according to the IP addresses in the array using the UDP protocol, wherein the synchronization request data includes the URL address and the page-large screen synchronization coordinates; Graphics workstation, which is equipped with a synchronous rendering client. The synchronous rendering client monitors the synchronization request in real time through the socket service, and splices the URL address and the page-large screen synchronization coordinates obtained by parsing the synchronization request data into a page service request of the URL address plus the synchronization coordinates, and requests the background Web service to load the local page specified by the coordinates; multiple graphics workstations render the loaded local pages; The splicing controller, the graphics workstation is connected to the splicing controller through the graphics card to form a video transmission channel. Multiple graphics workstations transmit the rendered partial pages to the splicing controller in real time through the video transmission channel. The large screen is an ultra-high-resolution screen, consisting of no less than four display screens, and the display screen resolution is no less than 4K; the splicing controller simultaneously transmits multiple rendered local pages to the large screen for display.

7. The ultra-high-resolution large-screen split-screen synchronous rendering system according to claim 6, characterized in that: The backend service unit queries the backend database to collect the current large screen resolution to be displayed, the resolution of the page to be rendered, the mapping relationship between the graphics workstation and the large screen logical partition, the graphics workstation IP address, and the URL address of the page to be rendered; If the resolution of the large screen is inconsistent with the resolution of the page to be rendered, the page to be rendered is processed to make the resolution of the page to be rendered consistent with the resolution of the large screen.

8. The ultra-high-resolution large-screen split-screen synchronous rendering system according to claim 6, characterized in that: According to the large-screen resolution and the mapping relationship between the graphics workstation and the large-screen logical partition, the page-to-large-screen synchronization coordinates are generated, including: cutting the page to be rendered into corresponding page slices according to the large-screen resolution, and calculating the coordinate position of each page slice on the page to be rendered, and the coordinate position is used as the page-to-large-screen synchronization coordinates.

9. The ultra-high-resolution large-screen split-screen synchronous rendering system according to claim 6, characterized in that: The page-large screen-graphics workstation synchronization coordinate array includes: the URL address of the page to be rendered, the page-large screen synchronization coordinates and the graphics workstation IP address.

10. The ultra-high-resolution large-screen split-screen synchronous rendering system according to claim 1, characterized in that: When the client listens to the synchronization request data, it parses the URL address of the page to be rendered and the synchronization coordinates of the page and the large screen, splices the URL address and the synchronization coordinates into a new URL request address, calls the browser driver, opens the browser, initiates a request to the background web service on the browser with the new URL request address, and loads the rendered return page.

Images