A graphics rendering display method

Abstract

A graphics rendering and display method, applied to a virtual reality display system, includes: obtaining the user's current posture graphics data; receiving the posture graphics data and performing pre-rendering to generate a first rendering graphics; a processing module calls the first rendering graphics and sends it to a remote server through a communication module; performing main rendering on the first rendering graphics to generate a second rendering graphics; receiving the second rendering graphics, storing it in a storage module, and then storing it in the storage module after superimposing it with the first rendering graphics; judging the current processing capacity of the processing module, outputting the first rendering graphics and the second rendering graphics separately, or superimposing the second rendering graphics with the first rendering graphics and then outputting them. The present invention can improve the content display effect in the display device, prevent delays, freezes, and losses, and improve the user's use effect.

Description

Technical Field

[0001] The present invention relates to the field of graphics rendering technology, and in particular to a graphics rendering and display method. Background Art

[0002] Virtual reality technology is a computer simulation mechanism that can create and experience a virtual world. It combines computer technology and display technology to construct a virtual environment that immerses users in the virtual environment, giving them a strong sense of immersion.

[0003] In order to correctly present the user's perception of the virtual object, the device display will display the image at a certain frame rate (for example, 60 Hz, 120 Hz, etc.) during the image display process to ensure that the user's own movement is consistent with the image seen on the device.

[0004] However, the existing display modules cannot display high-bitrate graphic information in a timely manner, and there are delays, freezes, and losses, which cannot be processed in a timely manner, affecting the user's direct experience and usage effect. Summary of the invention

[0005] In view of this, the technical problem to be solved by the present invention is: to provide a graphics rendering and display method, which can improve the content displayed in the display device, prevent delays, freezes, and losses, improve the user's usage effect, and at the same time, enhance the display content and enhance the user's intuitive experience.

[0006] In order to solve the above technical problems, the technical solution of the present invention is:

[0007] A graphics rendering and display method is applied to a virtual reality display system, wherein the system comprises at least one graphics sensor, a processing module, a storage module, a communication module, a remote server and a display module, wherein the graphics sensor, the storage module, the communication module and the display module are electrically connected to the processing module respectively;

[0008] The method comprises the following steps:

[0009] S1. Based on at least one of the graphic sensors, obtaining current posture graphic data of the user, wherein the posture graphic data includes edge data and space coordinate data;

[0010] S2, based on the processing module, receiving the posture graphic data and performing pre-rendering to generate a first rendering graphic, and storing it in the storage module;

[0011] S3, based on the communication module, the processing module calls the first rendering graphic and sends it to the remote server through the communication module;

[0012] S4. Based on the remote server, perform main rendering on the first rendering graphic to generate a second rendering graphic;

[0013] S5. Based on the processing module, receiving the second rendering graphic through the communication module, storing it in the storage module, and superimposing it with the first rendering graphic and then storing it in the storage module;

[0014] S6. Determine the current processing capability of the processing module based on the display module, and output the first rendering graphic and the second rendering graphic separately, or superimpose the second rendering graphic and the first rendering graphic and then output them.

[0015] Preferably, the S2 further includes graphic correction, and the graphic correction includes the following steps:

[0016] S21, based on the posture graphic data, the processing module performs edge recognition and spatial coordinate transformation on each frame of graphic data, and generates an identification frame;

[0017] S22, determining the width and height of the target corrected image according to the identification frame, and completing the mapping calculation from the initial image to the target corrected image according to the interpolation method to obtain the target corrected image;

[0018] S23, writing the target correction image corresponding to each of the posture graphic data in the sequence of the posture graphic data into the original frame of the posture graphic data in sequence to obtain the corrected posture graphic data;

[0019] S24, pre-rendering the corrected posture graphic data.

[0020] Preferably, the S21 further includes:

[0021] S211, after edge recognition, perform a stroke operation on each frame of graphic data to determine the edge position of each frame of graphic data.

[0022] Preferably, in S3, sending to the remote server through the communication module specifically includes the following steps:

[0023] S31, the communication module converts the electrical signal containing the first rendering graphic processed by the processing module into an optical signal;

[0024] S32, the optical signal is divided into multiple parts, and sent to multiple single-mode optical fibers for transmission to the remote server.

[0025] Preferably, the graphic sensor is located at the user's head position, and is used to obtain the posture graphic data located at the user's head position.

[0026] Preferably, the resolution of the second rendered graphic is greater than that of the first rendered graphic.

[0027] After adopting the above technical solution, the beneficial effects of the present invention are:

[0028] In the present invention, a graphics rendering and display method is disclosed, which is applied to a virtual reality display system, including: S1, obtaining the user's current posture graphics data, the posture graphics data including edge data and space coordinate data; S2, receiving the posture graphics data and performing pre-rendering to generate a first rendering graphics, which is stored in a storage module; S3, the processing module calls the first rendering graphics, and sends it to a remote server through a communication module;

[0029] S4, perform main rendering on the first rendering graphic to generate a second rendering graphic; S5, receive the second rendering graphic through the communication module, store it in the storage module, and store it in the storage module after superimposing it with the first rendering graphic; S6, judge the current processing capacity of the processing module, output the first rendering graphic and the second rendering graphic separately, or superimpose the second rendering graphic and the first rendering graphic and output them. In the present invention, the processing module can pre-render the posture graphic data, generate the first rendering graphic, and display it through the display module to meet the display requirements at a low bit rate and provide a use function; at the same time, the remote server performs main rendering on the first rendering graphic, generates the second rendering graphic, superimposes it with the first rendering graphic, and displays it through the display module to enhance the display effect of the graphic, meet the display requirements at a high bit rate, improve the user experience, prevent delays, freezes, and losses, and enhance the display content, thereby enhancing the user's intuitive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0031] Figure 1 is a flow chart of an embodiment of the present invention;

[0032] Figure 2 4 is a flow chart of graphics correction in an embodiment of the present invention. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0034] like Figure 1 and Figure 2As shown, the present invention is applied to a virtual reality display system, the system includes at least one graphic sensor, a processing module, a storage module, a communication module, a remote server and a display module, and the graphic sensor, the storage module, the communication module and the display module are electrically connected to the processing module respectively.

[0035] The graphic sensor is located at the user's head position and is used to obtain posture graphic data located at the user's head position.

[0036] A graphics rendering and display method comprises the following steps:

[0037] S1. Based on at least one graphic sensor, obtain the user's current posture graphic data, where the posture graphic data includes edge data and space coordinate data;

[0038] S2, based on the processing module, receiving the posture graphic data and performing pre-rendering to generate a first rendering graphic, and storing it in the storage module;

[0039] S3, based on the communication module, the processing module calls the first rendering graphic and sends it to the remote server through the communication module;

[0040] S4, based on the remote server, performing main rendering on the first rendering graphic to generate a second rendering graphic;

[0041] Preferably, the resolution of the second rendered graphic is greater than that of the first rendered graphic;

[0042] S5. Based on the processing module, receiving the second rendering graphic through the communication module, storing it in the storage module, and superimposing it with the first rendering graphic and then storing it in the storage module;

[0043] S6. Based on the display module, determine the current processing capability of the processing module, and output the first rendering graphic and the second rendering graphic separately, or superimpose the second rendering graphic and the first rendering graphic and then output them.

[0044] In the present invention, the processing module can pre-render the posture graphic data to generate a first rendering graphic, and display it through the display module, so as to meet the display requirements at a low bit rate and provide usage functions; at the same time, the remote server performs main rendering on the first rendering graphic to generate a second rendering graphic, which is superimposed with the first rendering graphic and displayed through the display module, so as to enhance the display effect of the graphic, meet the display requirements at a high bit rate, improve the user experience, prevent delays, freezes, and losses, enhance the display content, and enhance the user's intuitive experience.

[0045] Among them, S2 also includes graphic correction, which includes the following steps:

[0046] S21, based on the posture graphic data, the processing module performs edge recognition and spatial coordinate transformation on each frame of graphic data, and generates an identification frame;

[0047] S22, determining the width and height of the target corrected image according to the identification frame, completing the mapping calculation from the initial image to the target corrected image according to the interpolation method, and obtaining the target corrected image;

[0048] S23, writing the target correction image corresponding to each posture graphic data in the sequence of posture graphic data into the original frame of the posture graphic data in sequence to obtain the corrected posture graphic data;

[0049] S24, pre-rendering the corrected posture graphic data.

[0050] Graphics correction can prevent distortion, affect rendering, and improve user experience.

[0051] Among them, S21 also includes:

[0052] S211, after edge recognition, perform a stroke operation on each frame of graphic data to determine the edge position of each frame of graphic data.

[0053] By adopting the stroke operation, preferably, a two-image sketch is performed on the necessary areas in the graphic data to enhance the display and prevent abruptness that affects the experience; at the same time, it can also prevent excessive rendering of non-essential areas during rendering, occupying and reducing the computing power of the processing module, improve the rendering capability within the stroke range, and reduce the rendering time.

[0054] Among them, in S3, sending to the remote server through the communication module specifically includes the following steps:

[0055] S31, the communication module converts the electrical signal including the first rendering graphic processed by the processing module into an optical signal;

[0056] S32. The optical signal is divided into multiple parts and sent to multiple single-mode optical fibers for transmission to the remote server.

[0057] The electro-optical conversion process is adopted to improve the signal transmission rate and reduce the delay; at the same time, multiple single-mode optical fibers are used for simultaneous transmission, which shortens the transmission time and further reduces the delay.

[0058] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A graphics rendering and display method, characterized in that: Applied in a virtual reality display system, the system comprises at least one graphic sensor, a processing module, a storage module, a communication module, a remote server and a display module, wherein the graphic sensor, the storage module, the communication module and the display module are electrically connected to the processing module respectively; The method comprises the following steps: S1. Based on at least one of the graphic sensors, obtaining the user's current posture graphic data, wherein the posture graphic data includes edge data and space coordinate data; S2, based on the processing module, receiving the posture graphic data and performing pre-rendering to generate a first rendering graphic, and storing it in the storage module; S3, based on the communication module, the processing module calls the first rendering graphic and sends it to the remote server through the communication module; S4. Based on the remote server, perform main rendering on the first rendering graphic to generate a second rendering graphic; S5. Based on the processing module, receiving the second rendering graphic through the communication module, storing it in the storage module, and superimposing it with the first rendering graphic and then storing it in the storage module; S6. Determine the current processing capability of the processing module based on the display module, and output the first rendering graphic and the second rendering graphic separately, or superimpose the second rendering graphic and the first rendering graphic and then output them.

2. The graphics rendering and display method according to claim 1, characterized in that: The S2 also includes graphic correction, which includes the following steps: S21, based on the posture graphic data, the processing module performs edge recognition and spatial coordinate transformation on each frame of graphic data, and generates an identification frame; S22, determining the width and height of the target corrected image according to the identification frame, and completing the mapping calculation from the initial image to the target corrected image according to the interpolation method to obtain the target corrected image; S23, writing the target correction image corresponding to each of the posture graphic data in the sequence of the posture graphic data into the original frame of the posture graphic data in sequence to obtain the corrected posture graphic data; S24, pre-rendering the corrected posture graphic data.

3. The graphics rendering and display method according to claim 2, characterized in that: The S21 further includes: S211, after edge recognition, perform a stroke operation on each frame of graphic data to determine the edge position of each frame of graphic data.

4. The graphics rendering and display method according to claim 1, characterized in that: In the S3, sending to the remote server through the communication module specifically includes the following steps: S31, the communication module converts the electrical signal containing the first rendering graphic processed by the processing module into an optical signal; S32, the optical signal is divided into multiple parts, and sent to multiple single-mode optical fibers for transmission to the remote server.

5. The graphics rendering and display method according to claim 1, characterized in that: The graphic sensor is located at the user's head position and is used to obtain the posture graphic data located at the user's head position.

6. The graphics rendering and display method according to claim 1, characterized in that: The resolution of the second rendered graphic is greater than that of the first rendered graphic.

Images