Three-dimensional geological model cloud rendering method based on WebRTC technology

Abstract

The invention discloses a three-dimensional geological model cloud rendering method based on a WebRTC technology, and the method comprises the steps: obtaining geological model data, and carrying out the preprocessing of the geological model data; performing three-dimensional modeling and rendering based on the preprocessed geological model data; and compressing the rendered frame video and audio stream data, outputting the compressed data to a media stream, and sending the rendered frame video and audio stream data to a client browser through a WebRTC technology for decoding and displaying a three-dimensional scene picture. Visual display and interaction of the three-dimensional geologic model on a browser are realized through a WebRTC-based cloud rendering technology, the model display quality can be improved, the model display delay can be reduced, and any server-side content can be pushed to a client side, so that the system can be transplanted to a platform with limited hardware resources, and the service life of the three-dimensional geologic model is prolonged. And the user can perform three-dimensional scene interaction experience at any time and at any place.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional geological model visualization, and in particular to a three-dimensional geological model cloud rendering method based on WebRTC (Web real-time communication) technology. Background Art

[0002] It is difficult to achieve multi-platform compatibility when using traditional methods to render and visualize large-scale three-dimensional geological data. Existing front-end rendering solutions include sending model and material texture data to the client for rendering. Models and material textures require a lot of lightweight processing, so there are certain limitations in image quality. They also take up a large amount of storage space on the client, have a long waiting time, and have high requirements for client rendering performance. In addition, data transmission is less secure. In the field of three-dimensional geology, traditional geological model visualization usually needs to rely on local computing resources and professional geological modeling software, which limits the sharing, communication and real-time analysis of geological data by geological engineers and researchers. There is an urgent need for a convenient, efficient and easy-to-collaborate data visualization solution. Summary of the invention

[0003] The present application provides a 3D geological model cloud rendering method based on WebRTC technology to solve the problems of traditional 3D geological model rendering solutions, such as long model loading time, occupying a large amount of user storage space, having high requirements for client rendering performance, poor displayed model quality, and data transmission security.

[0004] According to the first aspect, an embodiment provides a three-dimensional geological model cloud rendering method based on WebRTC technology, which is applied to a server, and the method includes:

[0005] Acquiring geological model data and preprocessing the geological model data;

[0006] Perform 3D modeling and rendering based on preprocessed geological model data;

[0007] The rendered frame video and audio stream data are compressed and output to the media stream, and the rendered frame video and audio stream data are sent to the client browser through WebRTC technology for decoding and displaying the 3D scene image.

[0008] Further, the geological model data is obtained and preprocessed, specifically including:

[0009] The geological model data includes borehole data and profile data, so as to facilitate the establishment of a three-dimensional geological model; the preprocessing includes checking and modifying the borehole data, and extracting borehole related information including borehole spacing.

[0010] Furthermore, three-dimensional modeling and rendering are performed based on the preprocessed geological model data, including:

[0011] The modeling methods including corner point Grid, triangulated network TIN and quasi-right triangular prism ARTP are used to realize the automatic generation of geological structure and establish a three-dimensional geological model.

[0012] Furthermore, three-dimensional modeling and rendering are performed based on the preprocessed geological model data, including:

[0013] Perform visualization operations on the 3D geological model, including material optimization, multi-level progressive texture MipMap, and automatic model simplification and hierarchical LOD.

[0014] Furthermore, the rendered frame video and audio stream data are compressed and output to the media stream, specifically including:

[0015] Run applications that build 3D geological models, using Unreal Engine’s Pixel Streaming plugin to compress rendered frames;

[0016] Based on the signaling and web service modules in Unreal Engine, the rendered frames and audio stream data are output to the media stream.

[0017] Furthermore, the rendered frame video and audio stream data are sent to the client browser through WebRTC technology for decoding and displaying the 3D scene image, specifically including:

[0018] Use STUN / TURN servers to achieve point-to-point network penetration, ensure the connectivity of signaling and Web services between the server and the client browser, and send media stream data to one or more connected browsers through point-to-point connections.

[0019] According to the second aspect, an embodiment provides a server, the server comprising:

[0020] A data processing module, used for acquiring geological model data and preprocessing the geological model data;

[0021] Modeling and rendering module, used for 3D modeling and rendering based on preprocessed geological model data;

[0022] The transmission module is used to compress the rendered frame video and audio stream data and output them to the media stream, and send the rendered frame video and audio stream data to the client browser through WebRTC technology for decoding and displaying the three-dimensional scene picture.

[0023] According to the third aspect, an embodiment provides a three-dimensional geological model cloud rendering system based on WebRTC technology, the system comprising a server as described above and a client connected to the server.

[0024] According to a fourth aspect, an embodiment provides an electronic device, the device comprising: a processor and a memory;

[0025] The memory is used to store one or more program instructions;

[0026] The processor is used to run one or more program instructions to execute the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any of the above items.

[0027] According to the fifth aspect, an embodiment provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any one of the above items are implemented.

[0028] The present application provides a three-dimensional geological model cloud rendering method based on WebRTC technology, which obtains geological model data and preprocesses the geological model data; performs three-dimensional modeling and rendering based on the preprocessed geological model data; compresses the rendered frame video and audio stream data and outputs them to the media stream, and sends the rendered frame video and audio stream data to the client browser through WebRTC technology for decoding and displaying the three-dimensional scene picture. The present invention can push any server content to the client, so it can be ported to platforms with limited hardware resources, such as mobile devices or XR terminals such as VR helmets and glasses, and users can experience three-dimensional scene interactions at any time and place. The present invention stores data on the server or cloud, and only the pixel stream is pushed to the terminal device, reducing the risk of sensitive data being stolen or leaked during transmission, and performs encryption operations during transmission, so the solution is faster and safer. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 A flowchart of a three-dimensional geological model cloud rendering method based on WebRTC technology provided by an embodiment of the present invention;

[0030] Figure 2 A specific implementation flow chart of a three-dimensional geological model cloud rendering method based on WebRTC technology provided by an embodiment of the present invention;

[0031] Figure 3 A schematic diagram of the logical structure of a 3D geological model cloud rendering system based on WebRTC technology is provided for one embodiment of the present invention. DETAILED DESCRIPTION

[0032] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0033] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0034] Real-time cloud rendering means running a program containing a 3D scene on a server or cloud server. The 3D program screen is rendered, captured and compressed through the server's powerful computing power, and then sent to a client with low computing power in the form of a video stream. Users can interact with the 3D program through the network on the client.

[0035] The first embodiment of the present invention provides a three-dimensional geological model cloud rendering method based on WebRTC technology. Figure 1 and Figure 2 Provide detailed explanation.

[0036] like Figure 1 As shown, in step S100, geological model data is acquired and preprocessed.

[0037] In this embodiment, the geological model data includes drilling data and profile data, so as to facilitate the establishment of a three-dimensional geological model. The preprocessing method includes checking and modifying the drilling data, and extracting drilling related information such as drilling spacing.

[0038] like Figure 1 As shown, in step S200, three-dimensional modeling and rendering are performed based on the preprocessed geological model data.

[0039] In this embodiment, modeling methods including using corner points (Grid), triangulated network (TIN), and quasi-right triangular prism (ARTP) are used to realize automatic generation of geological structures and establish a three-dimensional geological model.

[0040] In this embodiment, the geological model data is displayed in the Unreal Engine and the data is edited and integrated in the editor. The data editing and integration includes the visualization operation of material optimization, multi-level progressive texture (MipMap) and automatic model simplification and classification (LOD) of the three-dimensional geological model.

[0041] like Figure 1 As shown, in step S300, the rendered frame video and audio stream data are compressed and output to the media stream, and the rendered frame video and audio stream data are sent to the client browser through the WebRTC technology for decoding and displaying the three-dimensional scene picture.

[0042] In this embodiment, the rendered frames and audio streams are transmitted through WebRTC, and the STUN / TURN server is used to achieve point-to-point network penetration, ensuring the connectivity between the signaling and the Web server on the server side and the browser. The final result of each rendered frame is encoded using video compression, and these video frames are packaged into the media stream along with the audio, and the stream is sent to one or more connected browsers through a point-to-point connection, and the HTML and JavaScript environment for playing the video stream is provided to the browser.

[0043] The above steps specifically include:

[0044] S301: An application program for a three-dimensional geological model is run on a server, and a pixel streaming plug-in of the Unreal Engine is used to compress rendering frames.

[0045] S302: Output the rendered frames and audio to the media stream through the signaling and Web server module in the Unreal Engine.

[0046] S303: Use the STUN / TURN server to achieve point-to-point network penetration and ensure the connectivity between the signaling and the Web server on the server side and the browser.

[0047] S304: Send the rendered frames and audio streams to the browser and mobile device via WebRTC.

[0048] The embodiment of the present invention provides a three-dimensional geological model cloud rendering method based on WebRTC technology, which realizes the visualization and interaction of the three-dimensional geological model on the browser through the cloud rendering technology based on WebRTC, improves the model display quality, and reduces the model display delay.

[0049] Corresponding to the above disclosed three-dimensional geological model cloud rendering method based on WebRTC technology, the embodiment of the present invention also discloses a server, such as Figure 3 As shown, it specifically includes:

[0050] A data processing module, used for acquiring geological model data and preprocessing the geological model data;

[0051] Modeling and rendering module, used for 3D modeling and rendering based on preprocessed geological model data;

[0052] The transmission module is used to compress the rendered frame video and audio stream data and output them to the media stream, and send the rendered frame video and audio stream data to the client browser through WebRTC technology for decoding and displaying the three-dimensional scene picture.

[0053] It should be noted that, for a detailed description of a server provided in an embodiment of the present invention, reference can be made to the relevant description of a three-dimensional geological model cloud rendering method based on WebRTC technology provided in an embodiment of the present application, which will not be repeated here.

[0054] In addition, an embodiment of the present invention further provides a three-dimensional geological model cloud rendering system based on WebRTC technology, the system comprising a server as described above and a client connected to the server.

[0055] It should be noted that for the detailed description of a three-dimensional geological model cloud rendering system based on WebRTC technology provided in an embodiment of the present invention, reference can be made to the relevant description of a three-dimensional geological model cloud rendering method based on WebRTC technology provided in an embodiment of the present application, which will not be repeated here.

[0056] In addition, an embodiment of the present invention further provides an electronic device, comprising: a processor and a memory; the memory is used to store one or more program instructions; the processor is used to run one or more program instructions to execute the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any of the above items.

[0057] It should be noted that for the detailed description of an electronic device provided in an embodiment of the present invention, reference can be made to the relevant description of a three-dimensional geological model cloud rendering method based on WebRTC technology provided in an embodiment of the present application, which will not be repeated here.

[0058] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any of the above items are implemented.

[0059] It should be noted that, for a detailed description of a computer-readable storage medium provided in an embodiment of the present invention, reference can be made to the relevant description of a three-dimensional geological model cloud rendering method based on WebRTC technology provided in an embodiment of the present application, which will not be repeated here.

[0060] Those skilled in the art will appreciate that all or part of the functions of the various methods in the above-mentioned embodiments can be implemented by hardware or by computer programs. When all or part of the functions in the above-mentioned embodiments are implemented by computer programs, the program can be stored in a computer-readable storage medium, and the storage medium can include: read-only memory, random access memory, disk, optical disk, hard disk, etc., and the program is executed by a computer to implement the above-mentioned functions. For example, the program is stored in the memory of the device, and when the program in the memory is executed by the processor, all or part of the above-mentioned functions can be implemented. In addition, when all or part of the functions in the above-mentioned embodiments are implemented by computer programs, the program can also be stored in a storage medium such as a server, another computer, disk, optical disk, flash disk or mobile hard disk, and can be downloaded or copied and saved in the memory of the local device, or the system of the local device is updated, and when the program in the memory is executed by the processor, all or part of the functions in the above-mentioned embodiments can be implemented.

[0061] The above specific examples are used to illustrate the present invention, which is only used to help understand the present invention and is not intended to limit the present invention. For those skilled in the art, according to the concept of the present invention, some simple deductions, modifications or substitutions can be made.

Claims

1. A three-dimensional geological model cloud rendering method based on WebRTC technology, characterized in that: Applied to the server, the method includes: Acquiring geological model data and preprocessing the geological model data; Perform 3D modeling and rendering based on preprocessed geological model data; The rendered frame video and audio stream data are compressed and output to the media stream, and the rendered frame video and audio stream data are sent to the client browser through WebRTC technology for decoding and displaying the 3D scene image.

2. A three-dimensional geological model cloud rendering method based on WebRTC technology as claimed in claim 1, characterized in that: Acquiring geological model data and preprocessing the geological model data specifically includes: The geological model data includes borehole data and profile data, so as to facilitate the establishment of a three-dimensional geological model; the preprocessing includes checking and modifying the borehole data, and extracting borehole related information including borehole spacing.

3. A three-dimensional geological model cloud rendering method based on WebRTC technology as claimed in claim 1, characterized in that: 3D modeling and rendering are performed based on the preprocessed geological model data, including: The modeling methods including corner point Grid, triangulated network TIN and quasi-right triangular prism ARTP are used to realize the automatic generation of geological structure and establish a three-dimensional geological model.

4. A three-dimensional geological model cloud rendering method based on WebRTC technology as claimed in claim 1, characterized in that: 3D modeling and rendering based on preprocessed geological model data, including: Perform visualization operations on the 3D geological model, including material optimization, multi-level progressive texture MipMap, and automatic model simplification and hierarchical LOD.

5. The three-dimensional geological model cloud rendering method based on WebRTC technology according to claim 1, characterized in that: The rendered frame video and audio stream data are compressed and output to the media stream, including: Run applications that build 3D geological models, using Unreal Engine’s Pixel Streaming plugin to compress rendered frames; Based on the signaling and web service modules in Unreal Engine, the rendered frames and audio stream data are output to the media stream.

6. A three-dimensional geological model cloud rendering method based on WebRTC technology as claimed in claim 5, characterized in that: The rendered frame video and audio stream data are sent to the client browser through WebRTC technology for decoding and displaying the 3D scene image, including: Use STUN / TURN servers to achieve point-to-point network penetration, ensure the connectivity of signaling and Web services between the server and the client browser, and send media stream data to one or more connected browsers through point-to-point connections.

7. A server, characterized in that: The server includes: A data processing module, used for acquiring geological model data and preprocessing the geological model data; Modeling and rendering module, used for 3D modeling and rendering based on preprocessed geological model data; The transmission module is used to compress the rendered frame video and audio stream data and output them to the media stream, and send the rendered frame video and audio stream data to the client browser through WebRTC technology for decoding and displaying the three-dimensional scene picture.

8. A 3D geological model cloud rendering system based on WebRTC technology, characterized in that: The system comprises a server as claimed in claim 7 and a client connected to the server.

9. An electronic device, characterized in that: The device comprises: a processor and a memory; The memory is used to store one or more program instructions; The processor is used to run one or more program instructions to execute the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of a three-dimensional geological model cloud rendering method based on WebRTC technology as described in any one of claims 1 to 6 are implemented.

Images