A display method for simulating real-time illumination of 3D scanning models of cultural relics
Through the combination of three-dimensional scanning and display engine systems, efficient and clear display of cultural relics is achieved, the problem of poor display effect of multimedia models is solved, real-time lighting and flexible switching effects are provided, and the authenticity and popularization of cultural relics display are improved.
Patent Information
- Application Number
- CN202111321137.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-09
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2041-11-09
AI Technical Summary
Among the existing cultural relics display technologies, the multimedia model display effect is poor, making it difficult to achieve dynamic lighting and real three-dimensional display, resulting in rigid display effects and difficult to promote and apply.
Obtain the three-dimensional model file of the cultural relics through three-dimensional scanning, import the display engine system for ultra-high-definition triangle mesh splitting and lighting map calculation, dynamically calculate the lighting effect in real time, and flexibly switch the proxy model cluster details level and lighting map according to the camera view to achieve Efficient and clear real-time lighting display.
The display effect of the three-dimensional scanning model of cultural relics has been optimized, providing an efficient and clear interactive experience, real-time lighting display and flexible switching, improving work efficiency, and improving the authenticity and popularization of the display.
Smart Images

Figure CN114332406B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of cultural relics display, and in particular to a display method for simulating real-time illumination of a 3D scanned model of a cultural relic. Background Art
[0002] As people's living standards continue to improve, they gradually pay more attention to their cultural living standards, and museums and other places have become an important part of the cultural life of ordinary people. Museums are an industry that has developed rapidly in recent years. Under the encouragement of national and local policies, as well as people's growing demand for cultural life, they have gradually received more attention, and social development and technological progress have led to the definition of museums being constantly updated. The most important part of the museum display is the display of cultural relics, but cultural relics usually require strict preservation conditions. Generally, they need to be placed in protective display cabinets. In addition, there are also graphic and multimedia displays to display cultural relics, but multimedia display of cultural relic models has not yet achieved a good display effect. The conventional method is to pre-render sequence frame pictures, which makes the display effect more rigid and gives people an unreal feeling.
[0003] In actual museums, original cultural relics often need to be displayed. The existing method usually places the cultural relics in protective display cabinets, or prints the graphic information content of the cultural relics on display boards for presentation; some museums use multimedia to display cultural relics, but conventional multimedia model displays can only realize static graphic content, or the display effect is poor because the model display uses pre-rendered panoramic frames. It can be seen from the above that the existing cultural relic displays have the disadvantages of only being able to realize static graphics or having poor display effects, and are difficult to be promoted and applied.
[0004] Therefore, it is necessary to provide a display method for simulating real-time lighting of a 3D scanned model of cultural relics, aiming to solve the above problems. Summary of the invention
[0005] In view of the deficiencies in the prior art, an embodiment of the present invention aims to provide a display method for simulating real-time lighting of a 3D scanned model of a cultural relic, so as to solve the problems in the above-mentioned background technology.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A display method for simulating real-time illumination of a 3D scanned model of a cultural relic comprises the following steps:
[0008] S1, perform three-dimensional scanning on the cultural relics to obtain a three-dimensional model file;
[0009] S2, importing the 3D model file into the display engine system, parsing to obtain an ultra-high-definition triangular mesh, and analyzing the mesh during the import process to split it into hierarchical clusters consisting of triangle groups;
[0010] S3, display engine system: analyzes the rendering precision coefficient according to the model screen ratio, and calculates the display precision of the triangular surface of the model's triangular proxy object according to the precision coefficient;
[0011] S4. Calculation of display accuracy: quantization processing is performed according to the vertex positions of the hierarchical clustered mesh bodies;
[0012] S5. Generation of proxy mesh: The proxy triangle percentage means extracting a certain percentage of triangles from the original mesh to generate the proxy mesh;
[0013] S6. Calculate the light map on the proxy mesh. The light map calculation includes directional light source calculation, point light source calculation, spot light source calculation and skylight calculation. The lighting is calculated dynamically in real time, and the diffuse reflection and indirect highlight reflection of the set reflection number are rendered.
[0014] S7. During the global illumination calculation process, the diffuse light source on the surface of the artifact selects the color of the surface and reflects the colored light on nearby surfaces, and the mesh in the scene forms indirect shadows by blocking indirect lighting;
[0015] S8, after obtaining the texture by calculation according to the lighting display engine, superimposing the texture file on the display model to obtain a model for rendering real-time lighting display;
[0016] S9. During the display process, the display engine determines the display situation in real time, and dynamically switches the proxy model cluster detail level and the corresponding precision light map at runtime according to the camera view, and repeats steps S6, S7 and S8.
[0017] As a further solution of the present invention, the three-dimensional model file includes model point cloud data and texture data.
[0018] As a further solution of the present invention, the step size of the quantization in S4 is set to a power of two, and the size of the step size is determined individually by the position and scale accuracy attributes and the requirements of each grid body.
[0019] As a further solution of the present invention, the details of the grid body remaining after the original grid body is extracted are proportional to the value of the percentage.
[0020] As a further solution of the present invention, the percentage in S5 has a value range of 0-100%.
[0021] As a further solution of the present invention, the number of proxy grid bodies in S5 is greater than or equal to 2000.
[0022] As a further solution of the present invention, the lighting needs to be calculated through light sources, light beams, Lightmass, lighting functions and cascaded shadow maps.
[0023] In summary, compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0024] The present invention optimizes the display effect of the three-dimensional scanning model of the cultural relic by optimizing the digital interactive model display method, so that when the real cultural relic is inconvenient to display, the three-dimensional scanning model of the cultural relic can be efficiently and clearly displayed. Through the real-time judgment of the display situation by the display engine and the flexible switching of the detail level of the proxy model cluster, it is possible to maintain the efficient and clear three-dimensional display of the cultural relic during the interactive experience, and has the effects of real-time lighting display, efficient and clear display, flexible switching and connection, and improved work efficiency.
[0025] In order to more clearly illustrate the structural features and effects of the present invention, the present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 Flowchart of an embodiment of the invention. DETAILED DESCRIPTION
[0027] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0028] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments.
[0029] In one embodiment of the present invention, see Figure 1 The method for displaying a 3D scanned model of a cultural relic in real time comprises the following steps:
[0030] S1, perform three-dimensional scanning on the cultural relics to obtain a three-dimensional model file;
[0031] S2, importing the 3D model file into the display engine system, parsing to obtain an ultra-high-definition triangular mesh, and analyzing the mesh during the import process to split it into hierarchical clusters consisting of triangle groups;
[0032] S3, display engine system: analyzes the rendering precision coefficient according to the model screen ratio, and calculates the display precision of the triangular surface of the model's triangular proxy object according to the precision coefficient;
[0033] S4. Calculation of display accuracy: quantization processing is performed according to the vertex positions of the hierarchical clustered mesh bodies;
[0034] S5. Generation of proxy mesh: The proxy triangle percentage means extracting a certain percentage of triangles from the original mesh to generate the proxy mesh;
[0035] S6. Calculate the light map on the proxy mesh. The light map calculation includes directional light source calculation, point light source calculation, spot light source calculation and skylight calculation. The lighting is calculated dynamically in real time, and the diffuse reflection and indirect highlight reflection of the set reflection number are rendered.
[0036] S7. During the global illumination calculation process, the diffuse light source on the surface of the artifact selects the color of the surface and reflects the colored light on nearby surfaces, and the mesh in the scene forms indirect shadows by blocking indirect lighting;
[0037] S8, after obtaining the texture by calculation according to the lighting display engine, superimposing the texture file on the display model to obtain a model for rendering real-time lighting display;
[0038] S9. During the display process, the display engine determines the display situation in real time, and dynamically switches the proxy model cluster detail level and the corresponding precision light map at runtime according to the camera view, and repeats steps S6, S7 and S8.
[0039] In this embodiment, the staff uses a high-precision 3D scanner to scan the cultural relics and obtain a 3D model file, wherein the 3D model file includes model point cloud data and texture data; the 3D model file is imported into the display engine system, parsed to obtain an ultra-high-definition triangular mesh, and the mesh is analyzed during the import process to split it into a hierarchical cluster composed of triangle groups; the rendering accuracy coefficient is analyzed according to the model screen ratio, and the display accuracy of the triangular surface of the triangular proxy object of the model is calculated according to the accuracy coefficient; quantization processing is performed according to the vertex position of the hierarchical clustered mesh, and during the quantization processing, the quantized The step size is set to a power of two, and the size of the step size is determined individually by the position and scale accuracy attributes and the requirements of each mesh; the proxy triangle percentage represents extracting a certain percentage of triangles from the original mesh to generate a proxy mesh, wherein the percentage ranges from 0-100%, and the details of the mesh remaining after the original mesh is extracted are proportional to the percentage value, that is, the larger the percentage, the more details of the original mesh are retained, and regardless of the size of the percentage of the proxy mesh, the number of proxy meshes is not less than 2000; lightmap calculations are performed on the proxy meshes;
[0040] Light map calculations include directional light source calculations, point light source calculations, spot light source calculations, and skylight calculations. Lighting is calculated dynamically in real time, and diffuse reflections and indirect highlight reflections with a set number of reflections are rendered. Directional light sources are mainly used as basic outdoor light sources, or as any light source that needs to appear to be emitted from a very far distance or close to infinity. Point light sources are light sources like traditional "light bulbs", emitting light in all directions from a single point. Spotlight sources also emit light outward from a single point, but their light is restricted by a set of cones. Skylights obtain the background of the scene and use it for the lighting effects of the scene mesh objects. In the global illumination calculation process, the diffuse light source on the surface of the cultural relic selects the color of the surface and reflects the colored light on nearby surfaces, and the meshes in the scene form indirect shadows by blocking indirect lighting. After the map is calculated by the lighting display engine, the map file is superimposed on the display model to obtain a model for rendering real-time lighting display. In the display process, the display engine determines the display situation in real time, and dynamically switches the proxy model cluster detail level and the corresponding precision light map at runtime according to the camera view, repeating the light map calculation, forming indirect shadows and the superimposed rendering process of the map file.
[0041] All lighting needs to be calculated through light sources, light beams, Lightmass, lighting functions and cascaded shadow maps. Among them, light source parameters include intensity, color, cast shadows and indirect lighting intensity; light beam parameters include occlusion mask darkness, light beam floodlight, reflection shading and light beam direction; Lightmass parameters include light source angle, indirect lighting saturation and shadow index; lighting functions include lighting function materials and lighting function fade distance; cascaded shadow map parameters include shadow distance movable lighting, digital dynamic shadow cascades, cascade distribution index, cascade transition part and shadow distance fade part.
[0042] In a real-time example of the present invention, Figure 1 The display method for simulating real-time lighting of a 3D scanned model of a cultural relic is described. After calculating the accuracy coefficient, according to the required accuracy, a proxy model of the sampled surface corresponding to the model to be displayed is taken for lighting calculation to obtain a light map. After sampling the map, it is reloaded back onto the high-precision model for superposition to establish a lighting effect, so as to achieve a realistic global light rendering effect.
[0043] In this embodiment, the display method of the simulated cultural relic 3D scanning model real-time lighting follows the principle of on-demand calculation and on-demand display. The display method of the simulated cultural relic 3D scanning model real-time lighting has two types of situations in the process of ultra-high-definition model display and interactive experience: single-threaded and multi-threaded:
[0044] Single thread: In multimedia exhibits with a small screen size and the need to display three-dimensional models of cultural relics, when the model display technology needs to be called, the real-time lighting display will cooperate with the three-dimensional model display engine and the corresponding three-dimensional model file to initialize the real-time lighting display, and the operation interface supports dragging, rotating and scaling operations on the model. After each operation command is entered, the display engine will calculate the display accuracy required for the display, and perform real-time lighting calculations on the model in the picture, so as to achieve a better display effect.
[0045] Multithreading: In multimedia exhibits with large screen sizes and the need to display three-dimensional models of cultural relics, this technology can be called as a thread to achieve the rendering effect of displaying multiple three-dimensional models of cultural relics at the same time. In this state, the thread also has an activity parameter, which increases the priority of the real-time display thread of the interactive model for computing performance, and then the internal calculation judgment and screen rendering are consistent with a single thread.
[0046] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A display method for simulating real-time illumination of a 3D scanned model of cultural relics, It is characterized in that The following steps are involved: S1, perform three-dimensional scanning on the cultural relics to obtain a three-dimensional model file; S2, importing the 3D model file into the display engine system, parsing to obtain an ultra-high-definition triangular mesh, and analyzing the mesh during importing to split it into hierarchical clusters consisting of triangle groups; S3, display engine system: analyzes the rendering precision coefficient according to the model screen ratio, and calculates the display precision of the triangular surface of the model's triangular proxy object according to the precision coefficient; S4. Calculation of display accuracy: quantization processing is performed according to the vertex positions of the hierarchical clustered mesh bodies; S5. Generation of proxy mesh: The proxy triangle percentage means extracting a certain percentage of triangles from the original mesh to generate the proxy mesh; S6. Calculate the light map on the proxy mesh. The light map calculation includes directional light source calculation, point light source calculation, spot light source calculation and skylight calculation. The lighting is calculated dynamically in real time, and the diffuse reflection and indirect highlight reflection of the set reflection number are rendered. S7. During the global illumination calculation process, the diffuse light source on the surface of the artifact selects the color of the surface and reflects the colored light on nearby surfaces, and the mesh in the scene forms indirect shadows by blocking indirect lighting; S8, after obtaining the texture by calculation according to the lighting display engine, superimposing the texture file on the display model to obtain a model for rendering real-time lighting display; S9. During the display process, the display engine determines the display situation in real time, and dynamically switches the proxy model cluster detail level and the corresponding precision light map at runtime according to the camera view, and repeats steps S6, S7 and S8.
2. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 1, It is characterized in that The three-dimensional model file includes model point cloud data and texture data.
3. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 1, It is characterized in that The step size of the quantization in S4 is set to a power of two, and the size of the step size is determined individually by the position and scale accuracy attributes and the requirements of each grid body.
4. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 1, It is characterized in that The details of the remaining mesh body after the original mesh body is extracted are proportional to the value of the percentage.
5. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 4, It is characterized in that The percentage in S5 has a value range of 0-100%.
6. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 5, It is characterized in that The number of proxy mesh bodies in S5 is greater than or equal to 2000.
7. The method for displaying a simulated 3D scanned model of a cultural relic in real time according to claim 1, It is characterized in that The lighting needs to be calculated through light sources, light beams, Lightmass, lighting functions and cascaded shadow maps.
