Non-uniform illumination underground mine scene reconstruction method based on three-dimensional Gaussian sputtering

Abstract

The invention provides a non-uniform illumination underground mine scene reconstruction method based on three-dimensional Gaussian sputtering. The method comprises the following steps: firstly, acquiring mine vision data, processing to generate a multi-view two-dimensional image, constructing a sparse point cloud, and initializing a three-dimensional Gaussian ellipsoid set containing dynamic structure features to obtain an initial three-dimensional Gaussian body; and extracting a mine physical prior structure diagram as a geometric growth supervision signal. Performing decoupling rendering on the initial Gaussian body to generate a vector chromaticity diagram, a physical radiation diagram and a structural feature diagram; and performing exposure compensation on the physical radiation pattern by combining camera parameters, inhibiting dark part noise through an intensity collapse function to obtain a clean physical intensity pattern, recombining the clean physical intensity pattern into an HSV component and inversely transforming the HSV component into an RGB image. And finally, constructing a multi-loss constraint based on the RGB image, the structural feature graph, the physical prior structure graph and a real image, performing end-to-end training by adopting an Adam algorithm to update Gaussian parameters to convergence, and outputting a three-dimensional reconstruction result through visual angle adaptive rendering, thereby giving consideration to robustness, high precision and real-time performance.

Description

A Method for Reconstructing Underground Mine Scenes Based on Non-Uniform Illumination Using 3D Gaussian Sputtering Technical Field

[0001] This invention relates to the field of underground mine scene reconstruction technology, and in particular to a method for underground mine scene reconstruction based on non-uniform illumination using three-dimensional Gaussian sputtering. Background Technology

[0002] Safe production and intelligent mining in underground mines are the core directions for high-quality development in the mining industry. 3D reconstruction of underground mine scenes, as a key technology for smart mine construction, is a crucial foundation for realizing digital twins of mines, navigation and planning for unmanned inspection robots, emergency drills for underground disasters, and intelligent equipment operation and maintenance. Accurate 3D mine scene models can intuitively reconstruct key information such as roadway topology, equipment layout, and spatial structure, providing data support for risk warning, path planning, and remote control in the mine production process. This plays an irreplaceable role in improving the level of intelligent mine production and reducing the safety risks of manual operations. With the development of computer vision and 3D reconstruction technology, visual acquisition-based 3D reconstruction methods have become the mainstream technical route for underground mine scene reconstruction due to their non-contact and high convenience advantages. Their technical performance directly determines the effectiveness of intelligent mine applications.

[0003] In the field of 3D scene reconstruction technology, 3D Gaussian Splatting (3DGS) has gradually replaced traditional reconstruction methods as the mainstream solution for 3D reconstruction of industrial scenes due to its advantages of fast real-time rendering and high reconstruction accuracy. Compared with reconstruction techniques such as Neural Radiance Field (NeRF) and its variants, 3D Gaussian Splatting does not require a complex voxel rendering process, and can meet the real-time requirements of industrial sites while ensuring reconstruction accuracy. However, it has many significant drawbacks when directly applied to non-uniform lighting scenes in mines.

[0004] While existing 3D Gaussian sputtering technology is the mainstream solution for 3D reconstruction, its direct application to non-uniform lighting scenes in underground mines lacks adaptation to extreme environmental characteristics such as low light and weak textures, strong noise, dust and water vapor interference, and photometric consistency failure caused by light source movement. This results in numerous key technical defects. The initial point cloud generated by the motion recovery structure algorithm is sparse and contains a large amount of noise, failing to provide a reliable foundation for subsequent accurate optimization. Furthermore, the use of the RGB color space leads to strong coupling between color and lighting, making it easy for the model to incorrectly integrate lighting effects into the geometric structure, causing color flickering distortion. The inconsistent exposure of multi-view images of the mine can also directly cause floating artifacts and geometric collapse in the reconstruction. In addition, the ability to suppress noise from mine sensors and dust scattering is insufficient, and this noise is amplified during the rendering process, ultimately leading to structural breaks and frequent artifacts in the reconstructed model. The reconstruction accuracy and environmental robustness are difficult to meet the requirements of the mine. While NeRF and its variants can adapt to complex lighting conditions to some extent, they suffer from slow training speed and insufficient real-time rendering capabilities, making them unsuitable for real-time applications such as rapid reconstruction of mine sites and unmanned inspection navigation. Summary of the Invention

[0005] Therefore, the purpose of this invention is to provide a method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering, aiming to solve the problem that there is a lack of a method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering that takes into account robustness, high accuracy and real-time performance in the prior art.

[0006] According to an embodiment of the present invention, a method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering includes: acquiring visual data of the underground mine scene, processing the visual data to obtain multi-view two-dimensional image data, generating a sparse point cloud based on the multi-view two-dimensional image data, and initializing a three-dimensional Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point cloud to obtain an initial three-dimensional Gaussian volume set for the mine scene; extracting a physical prior structure map adapted to the mine environment based on the multi-view two-dimensional image data as a supervision signal for the geometric growth of the Gaussian ellipsoid; and decoupling and rendering the initial three-dimensional Gaussian volume set to generate a vector chromaticity map, a physical radiation map, and a structural feature map. The process involves: 1) Image acquisition; 2) Exposure compensation of the physical radiometric map based on camera parameters during visual data acquisition, and suppression of dark noise using an intensity collapse function to obtain a clean physical intensity map; 3) Recombining the clean physical intensity map and the vector chromaticity map into HSV components, and performing an inverse transform to obtain an RGB image; 4) Constructing a multi-loss constraint function based on the RGB image, the structural feature map, the physical prior structure map, and a real image of the mine scene, and using the Adam optimization algorithm to perform end-to-end training and updating of the learnable parameters of the 3D Gaussian ellipsoid until the loss converges; 5) Based on the converged Gaussian body set parameters, outputting the 3D reconstruction result of the underground mine scene from the desired viewpoint through viewpoint adaptive rendering.

[0007] Furthermore, according to the above embodiments of the present invention, a method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering may also have the following additional technical features: Further, the step of initializing a set of three-dimensional Gaussian ellipsoidal attributes containing dynamic structural features based on the sparse point cloud to obtain an initial set of three-dimensional Gaussian volumes for the mine scene includes: acquiring visual data of the underground mine scene from a sparse viewpoint using a camera, processing the visual data to obtain multi-view two-dimensional image data, and generating a sparse point cloud from the multi-view two-dimensional image data based on a motion recovery structure algorithm; reconstructing the three-dimensional scene using three-dimensional Gaussian sputtering technology based on the sparse point cloud; wherein, in the initial stage of the reconstruction process, each point in the sparse point cloud is initialized as a geometric attribute of a three-dimensional Gaussian ellipsoid, and the coverage area of ​​the Gaussian ellipsoid is expanded according to a preset ratio to adapt to the sparse point cloud scene; based on the RGB information of the underground mine image, the vector chromaticity attribute is initialized through inverse Gamma correction, and the physical emissivity attribute is initialized by combining the color features of the sparse point cloud and the low-light characteristics of the mine; the structural feature dimension is determined based on the sparse point cloud density and scene type, and the initial assignment of structural features is completed.

[0008] Furthermore, the step of extracting a physical prior structure map adapted to the mine environment from the multi-view two-dimensional image data as a supervision signal for Gaussian ellipsoidal geometric growth includes: calculating the pixel brightness gradient of each pixel in the image based on the physical prior theory of photometric gradient, and constructing the physical prior structure map by combining spatial differential operators; for all-black pixel areas in the mine, filling pseudo-structure signals based on neighborhood gradients to avoid invalid regions in the physical prior structure map; and for strongly reflective pixel areas, introducing noise suppression factors to perform gradient smoothing to reduce the impact of reflection interference on the physical prior structure map.

[0009] Furthermore, the step of decoupling the rendering of the initial three-dimensional Gaussian volume set to generate a vector chromaticity map, a physical radiometric map, and a structural feature map includes: performing α-blending rasterization on the three-dimensional Gaussian volume to generate a vector chromaticity map, a physical radiometric map, and a structural feature map, respectively; for high-noise regions in the vector chromaticity map where the physical radiometric rate is lower than a preset threshold, weighted smoothing is applied to their rendering weights; for the structural feature map, if multi-dimensional structural features are used, their channel composite value is taken as the supervision signal, and if single-dimensional structural features are used, a single-channel map is directly output to balance the structural supervision effect and computational efficiency; wherein, the vector chromaticity map is used to characterize the intrinsic color of the object after the illumination is stripped, the physical radiometric map is used to characterize the real light field distribution including the influence of the light source, and the structural feature map is used to maintain geometric continuity in the dark region.

[0010] Furthermore, the steps of performing exposure compensation on the physical radiometric map based on the camera parameters when acquiring the visual data, and suppressing dark noise using an intensity collapse function to obtain a clean physical intensity map include: determining whether the camera parameters provide EXIF ​​metadata; if so, directly calculating the exposure gain based on exposure-related parameters; if not, calculating the exposure parameters based on image statistical features, and removing outliers using multi-view statistical information; and denoising the exposure-compensated physical radiometric map using an adjusted intensity collapse function, adapting the pixel value truncation range in the function to the strong light source area of ​​the mine, and simultaneously setting parameters adapted to suppress dark noise to obtain a clean physical intensity map.

[0011] Furthermore, the step of recombining the clean physical intensity map and the vector chromaticity map into HSV components and inversely transforming them to obtain an RGB image includes: recovering the hue and saturation components from the vector chromaticity map and enhancing the saturation by a preset amplitude to improve the recognizability of the mine equipment markings; using the clean physical intensity map as the luminance component to combine them to obtain an HSV image; inversely transforming the HSV image into an sRGB image using a differentiable color space conversion function, and optimizing the sRGB image using a lightweight tone mapping module to ensure that the image color and details meet the observation requirements of the mine scene.

[0012] Furthermore, the steps of constructing a multi-loss constraint function based on the RGB image, the structural feature map, the physical prior structure map, and the real image of the mine scene, and using the Adam optimization algorithm to perform end-to-end training and updating of the learnable parameters of the 3D Gaussian ellipsoid until the model converges include: constructing a total loss function composed of photometric loss, structural consistency loss, and buoyancy suppression loss; configuring corresponding optimization parameters and iteration stages for large-scale tunnel scenes and close-range equipment scenes respectively; configuring hyperparameters according to general combinations for all scenes and scene-specific combinations, using the Adam optimization algorithm to update the learnable parameters of the Gaussian ellipsoid end-to-end, and performing Gaussian densification pruning and fine optimization in stages until the loss converges; wherein, the photometric loss is based on the difference between the RGB image and the real image of the mine scene using a multi-class loss weighted combination, the structural consistency loss is based on the difference constraint between the structural feature map and the physical prior structure map, and the buoyancy suppression loss introduces a gradient scaling strategy.

[0013] Another objective of this invention is to provide a system for reconstructing underground mine scenes based on non-uniform illumination using 3D Gaussian sputtering. This system implements the aforementioned method for reconstructing underground mine scenes using non-uniform illumination based on 3D Gaussian sputtering. The system includes: a data acquisition and processing module for acquiring visual data of the underground mine scene and processing the visual data to obtain multi-view 2D image data; generating sparse point clouds based on the multi-view 2D image data; and initializing a 3D Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point clouds to obtain an initial 3D Gaussian volume set for the mine scene; a physical prior structure map determination module for extracting a physical prior structure map adapted to the mine environment based on the multi-view 2D image data, serving as a monitoring signal for the geometric growth of the Gaussian ellipsoid; and a decoupling rendering module for decoupling and rendering the initial 3D Gaussian volume set to generate vectors. The system comprises: a chromaticity map, a physical radiosity map, and a structural feature map; a clean physical intensity map determination module, used to perform exposure compensation on the physical radiosity map based on camera parameters acquired during the acquisition of the visual data, and to suppress dark noise through an intensity collapse function to obtain a clean physical intensity map; an RGB image determination module, used to reconstruct the clean physical intensity map and the vector chromaticity map into HSV components, and perform inverse transformation to obtain an RGB image; a model training module, used to construct a multi-loss constraint function based on the RGB image, the structural feature map, the physical prior structure map, and a real image of the mine scene, and to perform end-to-end training and updating of the learnable parameters of the three-dimensional Gaussian ellipsoid using the Adam optimization algorithm until the loss converges; and a three-dimensional reconstruction module, used to output the three-dimensional reconstruction result of the underground mine scene from the desired viewpoint through viewpoint adaptive rendering based on the Gaussian body set parameters after training convergence.

[0014] Another objective of this invention is to provide a storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering.

[0015] Another objective of this invention is to provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the above-described method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering.

[0016] This invention acquires visual data of an underground mine scene and processes it into multi-view 2D image data. After generating a sparse point cloud, it initializes a 3D Gaussian ellipsoid attribute set containing dynamic structural features to obtain an initial 3D Gaussian volume set for the mine scene. Simultaneously, it extracts a physical prior structure map adapted to the mine environment as a supervision signal for Gaussian ellipsoid geometric growth. This effectively solves the problems of existing motion structure recovery algorithms generating sparse and noisy initial point clouds that cannot support accurate optimization, and the lack of effective structural supervision during Gaussian volume geometric growth that easily leads to structural breakage in the reconstructed structure. Furthermore, by decoupling and rendering the initial 3D Gaussian volume set to generate a vector chromaticity map, a physical radiation map, and a structural feature map, it removes the interference of lighting on the intrinsic color of objects, overcoming the limitations of existing technologies that use RGB. Color spaces result in strong coupling between color and lighting, making it easy for models to incorporate lighting effects into geometric structures, leading to color flickering and distortion in reconstructed images. This paper addresses the problem of inconsistent exposure in multi-view images of mines, which easily produces floating artifacts and geometric collapse. Furthermore, sensor noise and dust scattering noise are amplified during rendering, making it difficult for traditional denoising methods to balance detail preservation and noise suppression. The paper further describes the process of reconstructing clean physical intensity maps and vector chromaticity maps into HSV components and inversely transforming them to obtain RGB images. Multiple loss constraint functions are constructed based on the RGB images, structural feature maps, physical prior structure maps, and real images of the mine scene, employing Adam... The optimization algorithm performs end-to-end training and updates of the learnable parameters of the 3D Gaussian ellipsoid until the loss converges, overcoming the shortcomings of existing technologies such as the lack of effective multi-dimensional constraints in model training and insufficient reconstruction accuracy and robustness to extreme mine environments. By performing viewpoint adaptive rendering based on the converged Gaussian volume set parameters, it outputs the 3D reconstruction result of the underground mine scene from the desired viewpoint, solving the problems of slow training speed and insufficient real-time rendering capabilities of NeRF and its variants in existing technologies, which cannot meet the needs of rapid reconstruction and real-time navigation in mine sites. Therefore, this invention solves the problem of the lack of a robust, high-accuracy, and real-time underground mine scene reconstruction method based on non-uniform illumination using 3D Gaussian sputtering. Attached Figure Description

[0017] Figure 1 is a flowchart of the underground mine scene reconstruction method based on non-uniform illumination of three-dimensional Gaussian sputtering in the first embodiment of the present invention; Figure 2 is a structural schematic diagram of the underground mine scene reconstruction system based on non-uniform illumination of three-dimensional Gaussian sputtering in the second embodiment of the present invention; Figure 3 is a structural schematic diagram of the electronic device in the third embodiment of the present invention; the following detailed embodiments will further illustrate the present invention in conjunction with the above figures. Detailed Implementation

[0018] To facilitate understanding of the present invention, a more complete description will be given below with reference to the accompanying drawings. Several embodiments of the invention are illustrated in the drawings. However, the invention can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0020] Please refer to Figure 1 for Example 1, which shows the underground mine scene reconstruction method based on non-uniform illumination of three-dimensional Gaussian sputtering in the first embodiment of the present invention. The method specifically includes steps S1-S7.

[0021] S1. Obtain visual data of the underground mine scene, process the visual data to obtain multi-view two-dimensional image data, generate sparse point cloud based on the multi-view two-dimensional image data, and initialize a three-dimensional Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point cloud to obtain an initial three-dimensional Gaussian volume set of the mine scene.

[0022] Specifically, visual data of an underground mine scene is acquired using a camera from a sparse perspective, and the visual data is processed to obtain multi-view 2D image data. A sparse point cloud is then generated from the multi-view 2D image data based on a motion recovery structure algorithm. A 3D scene is reconstructed using 3D Gaussian sputtering technology based on the sparse point cloud. In the initial stage of the reconstruction process, each point in the sparse point cloud is initialized with the geometric properties of a 3D Gaussian ellipsoid, and the coverage area of ​​the Gaussian ellipsoid is expanded according to a preset ratio to adapt to the sparse point cloud scene. Based on the RGB information of the underground mine image, the vector chromaticity attribute is initialized through inverse Gamma correction, and the physical emissivity attribute is initialized by combining the color features of the sparse point cloud with the low-light characteristics of the mine. The structural feature dimension is determined based on the sparse point cloud density and scene type, and the initial values ​​of the structural features are assigned.

[0023] In specific implementation, S1.1, mining scene data is collected by using an intrinsically safe smart handheld terminal for mining (such as an explosion-proof mobile phone equipped with a high-sensitivity module) or a camera of an inspection robot.

[0024] Specifically, the acquisition method supports two modes: one is to directly capture still photos; the other is to record a video stream and then perform frame extraction at a fixed frame rate (e.g., 5 frames / second). During the acquisition process, the device moves along the tunnel or around the device to acquire a sequence of multi-view 2D images, ensuring a preset overlap rate between adjacent views, and acquiring a total of 50-200 images. The image resolution is normalized to 1920×1080 or 2048×1536.

[0025] S1.2 The above image sequence is processed using the Structure from Motion (SfM) algorithm.

[0026] Specifically, feature points are extracted from each image using feature point extraction algorithms (such as ORB, SIFT, etc.), then mismatched feature points are removed using the RANSAC algorithm, and the camera pose (including position vector) is calculated based on the correspondence of the remaining feature points. and rotation matrix , (for view indexing) and generating sparse point clouds ,in , For the first The spatial coordinates of the points The total number of point clouds is 2-15 points / m². Although the point cloud generated by SfM is sparse and noisy, the present invention can overcome the problem of poor initialization quality of SfM by using a density enhancement strategy guided by structural features (S6.2) and a physical prior structure graph (S2).

[0027] S1.3. Based on the sparse point cloud generated in S1.2, each point... Expanded into a three-dimensional Gaussian body Initialize the set of three-dimensional Gaussian volumes Among them, the set of three-dimensional Gaussian volumes is initialized. Notation:

[0028] Among them, the superscript " " indicates the initial stage (i.e., 0 iterations), subscript Indicates the first A Gaussian body; This represents the geometric properties of the Gaussian body in its initial stage; This represents the vector chromaticity attribute in the initial stage; Indicates the physical emissivity attribute in the initial stage; Indicates the structural characteristic attributes of the initial stage; (1) Geometric attributes Geometric properties of Gaussian solids, defining the nth Gaussian solid. The probability distribution at any point x in three-dimensional space:

[0029] Among them, parameters Gaussian body The initial values ​​of the coordinates of the center point in three-dimensional space. for The coordinates are then iteratively updated; where the parameters... Representing a three-dimensional Gaussian body The learnable covariance matrix is ​​derived from the scaling vector. and rotation quaternions Construct and describe the ellipsoidal shape, size, and orientation of the Gaussian body in the three-dimensional space of an underground mine tunnel. The formula for calculating the covariance matrix is: ;parameter The upper limit of opacity is represented by a learnable parameter. Obtained by mapping using the Sigmoid function. in, (2) Vector chromaticity attribute Extract corresponding points from the image acquired in S1.1. RGB pixel values ​​at the projection position Illumination coupling is removed by inverse Gamma correction, and the correction formula is: Convert linear RGB to HSV space and extract hue. and saturation The initial vector chromaticity coordinates are obtained through vector transformation: ,make sure , To avoid numerical breaks in the red area.

[0030] (3) Physical emissivity attribute Take the maximum channel value of linear RGB in S1.3(2). Adaptability coefficient for low-light scenes in mines ,in The initialization formula is: ,ensure This enhances signal strength in low-light areas.

[0031] (4) Structural characteristics and attributes Based on the coefficient point cloud density (S represents the area of ​​the reconstructed mine scene, unit) Adaptive selection of dimensions based on scene type Specifically: when Or when the scene is a large-scale tunnel scene, .

[0032] .

[0033] The set of indices of all Gaussian solids intersecting point x After sorting by depth from near to far, and combining the vector chromaticity attributes With physical emissivity properties The color at point x is obtained using forward blending: ,in, The transparency of the preceding Gaussian volume is multiplied to ensure the correct occlusion relationship between equipment and tunnels in the mine scene.

[0034] S1.4 After initializing the 3D Gaussian volume set, it is necessary to use differentiable rendering and parameter optimization to gradually match the real geometry and appearance features of the mine scene.

[0035] Specifically, the three-dimensional Gaussian volume is projected onto the two-dimensional image plane of each view acquired in step S1 through differentiable rendering, and the difference between the reconstructed image and the input real image of the mine is used as the reconstruction loss; the Adam optimization algorithm is used to iteratively optimize the geometric and attribute parameters of each three-dimensional Gaussian volume until the loss converges, thereby obtaining an initial set of three-dimensional Gaussian volumes adapted to the mine scene. Further, in the t-th iteration: (1) Gaussian projection: using the camera projection function of the k-th view The center point of the three-dimensional Gaussian solid Projecting onto a two-dimensional pixel plane yields the projection position. : ,in, This is the camera intrinsic parameter matrix (obtained from the calibration of the industrial camera). Let k be the extrinsic parameter matrix of view. It is the rotation matrix of the camera coordinate system relative to the world coordinate system. , It is a translation vector. Both describe the camera's shooting posture in the mine scene; The homogeneous coordinates of the center point of the Gaussian body are used to adapt the linear operations of the projection transformation; the superscript "(t)" indicates the iteration number t; (2) Calculate the two-dimensional covariance matrix after projection: calculate the projection function right Jacobian matrix Combined with the transformation matrix from the world coordinate system to the camera coordinate system , three-dimensional covariance Convert to two-dimensional covariance : Take the 2×2 submatrix in its upper left corner as the two-dimensional covariance after projection: , where the projection function It is a linear transformation, and its Jacobian matrix is... Equivalent to camera intrinsic parameter matrix The first two lines describe the effect of minute changes in three-dimensional coordinates on the two-dimensional projection position. It is a 3×3 matrix after three-dimensional covariance pose transformation and projection transformation; the symbol “[ ]” “1:2,1:2” indicates that the first and second rows and the first and second columns of the matrix are truncated; (3) Calculate pixel-level opacity: opacity The calculation is based on a two-dimensional Gaussian kernel, and the formula is:

[0036] in, Let k be the two-dimensional pixel coordinates of view k; For a two-dimensional Gaussian kernel term, it represents the three-dimensional Gaussian volume at pixel coordinates. The degree of coverage at a given location indicates that the closer the value of the two-dimensional Gaussian kernel term is to 1, the greater the contribution of the Gaussian volume to that pixel. It is the upper limit of the opacity of the Gaussian body, which controls its maximum contribution intensity.

[0037] (4) Calculate the pixel coordinates in the two-dimensional image plane Color of the location: color The calculation is performed by combining vector chromaticity with physical radiance, followed by α-blending, as shown in the formula:

[0038] in, To cover pixel coordinates The Gaussian volume index set; It is the fusion of vector chromaticity (color) and physical emissivity (brightness) to obtain the complete color information corresponding to the Gaussian body; It is the cumulative product of the opacity of the preceding Gaussian volume—for example, if the opacity of the preceding Gaussian volume is 0.5, then the current Gaussian volume can only transmit 50% of the brightness, thus realizing the realistic spatial occlusion relationship of "near equipment occluding the far tunnel wall" in the mine scene.

[0039] (5) Reconstruction Loss Calculation: Reconstruct the scene of the specified view in the two-dimensional image plane and calculate the reconstruction loss. For the view... Corresponding original image Let its corresponding reconstructed image be ,definition The loss function measures the difference between the reconstructed image and the original image. In one embodiment of the present invention, the formula for the loss function is: ,in, For the total number of views, Let k be the set of pixels. (6) Parameter update: Calculate the total number of pixels across all views using the backpropagation algorithm. about The gradients are calculated, and these parameters are updated using the Adam optimization algorithm: ,in, For a set of learnable parameters, For learning rate, Used to adjust the position of the Gaussian volume to match the sparse point cloud. Used to optimize color and prevent red device logos from breaking. Used to enhance brightness in low-light areas Used to enhance brightness in low-light areas. Used to adjust the shape and size of a Gaussian body to fit the surface of a real object; Used to adjust the opacity of a Gaussian volume to reflect the spatial occlusion relationships of objects; Used to fit local structural features to maintain geometric continuity.

[0040] (7) Iteration Termination: Let Then, by repeating steps (1)-(6) until the loss converges, assuming the iteration terminates after a certain number of iterations. The initialized set of three-dimensional Gaussian volumes is obtained. :

[0041] S2, extract a physical prior structure diagram adapted to the mine environment based on the multi-view two-dimensional image data, as a supervision signal for Gaussian ellipsoid geometric growth.

[0042] Specifically, the pixel brightness gradient of each pixel in the image is calculated based on the physical prior theory of photometric gradient, and a physical prior structure map is constructed by combining the spatial differential operator; for the all-black pixel area of ​​the mine, the pseudo-structure signal is filled based on the neighborhood gradient to avoid invalid areas in the physical prior structure map; for the strongly reflective pixel area, a noise suppression factor is introduced to smooth the gradient and reduce the impact of reflection interference on the physical prior structure map.

[0043] In practical implementation, for each two-dimensional image in the multi-view set described in step S1, an illumination-invariant physical prior structure map is extracted using the physical prior theory based on photometric gradients and the Sobel spatial differential operator. This provides precise structural supervision signals for subsequent Gaussian body geometric growth, ensuring that the Gaussian body distribution conforms to the real-world structure of tunnel walls, equipment, etc. The processing flow is as follows: S2.1, Calculate pixel brightness values ​​and gradients: For each mine image... By pixel Calculate pixel brightness value , The calculation formula is: ,in, For pixels The RGB channel values ​​are calculated using a weighted formula that aligns with the human eye's sensitivity to the brightness of the three channels, avoiding fluctuations in the values ​​of a single channel from affecting the calculation of pixel brightness values, thus meeting the brightness extraction needs under low-light conditions in mines.

[0044] Then, three types of gradients are further calculated to fully capture scene structure (device edges, tunnel textures, etc.): first-order gradient Along pixel space Direction calculation is performed using the Sobel operator; second-order gradient. :along The pixel step size is used to calculate the second-order gradient in space, focusing on the finer structural textures in the scene (such as cracks in tunnel walls and the texture of device screws).

[0045] Third gradient :along The pixel step size is used to calculate the third-order gradient in space, which helps to enhance the features of deep structures and compensate for the loss of features of small components in low-light environments.

[0046] S2.2 Generate a Physical Prior Structure Map (PGT) and calculate pixels according to the formula. Physical prior structure diagram value Integrate the structural information of the three types of gradients:

[0047] in, It is a pixel brightness value estimation. It is a discrete gradient operator (such as Sobel); Set the gradient weight coefficients. The first-order gradient weight is set to 1.0 by default, which is used to extract the edges of major structures such as equipment and tunnels. The second and third-order gradient weights are lower to avoid excessive amplification of subtle noise and to balance the contribution ratio of different orders of gradients.

[0048] S2.3 Targeted optimizations were made to address the unique characteristics of underground mine scenes, such as completely black areas and strong reflection interference: Processing completely black pixels: This addresses the issue of pixels prone to appearing deep within the mine tunnel. For all-black pixels, fill with the average gradient of the 3×3 neighborhood, using the following formula:

[0049] in, For pixels The 3×3 neighborhood set is used to complete the structure of the black area by using neighborhood information, thus ensuring the integrity of the structure graph; if the 3×3 neighborhood is invalid, the neighborhood range is expanded or the global mean is used.

[0050] Processing of highly reflective pixels: These pixels are prone to causing issues on the metal surfaces of mining equipment. Highly reflective pixels can introduce false gradient noise. This can be addressed by introducing a noise suppression factor. The gradient is smoothed using Gaussian blur, and the formula is:

[0051] in, Standard deviation Gaussian kernel, satisfying Gaussian blur can soften abrupt gradients in regions of strong reflection. Suppress noise while preserving the structure.

[0052] The final set of physical prior structure diagrams for all views is as follows: , will this As a Ground Truth, it provides reliable input for the supervision of Gaussian structure.

[0053] S3, decouple and render the initial three-dimensional Gaussian volume set to generate a vector chromaticity map, a physical radiation map, and a structural feature map.

[0054] Specifically, an α-blending rasterization operation is performed on the 3D Gaussian volume to generate a vector chromaticity map, a physical radiometric map, and a structural feature map. For high-noise regions in the vector chromaticity map where the physical radiometric rate is below a preset threshold, the rendering weights are weighted and smoothed. For the structural feature map, if multi-dimensional structural features are used, their channel composite value is taken as the supervision signal; if single-dimensional structural features are used, a single-channel map is directly output to balance the structural supervision effect and computational efficiency. Among these, the vector chromaticity map is used to characterize the intrinsic color of the object after the illumination is stripped, the physical radiometric map is used to characterize the true light field distribution, including the influence of the light source, and the structural feature map is used to maintain geometric continuity in dark regions.

[0055] In practical implementation, to achieve independent optimization of the color, brightness, and structural features of the mine scene, the initial three-dimensional Gaussian volume set obtained in S1.4 is... The process involves performing α-blending rasterization, rendering in three branches to obtain a vector chromaticity map, a physical radiosity map, and a structural feature map. This ensures the purity of each feature while maintaining scene hierarchy through a uniform opacity contribution. The processing flow and calculation method are as follows: S3.1, Define the first... A Gaussian solid for the view Pixels Opacity contribution The effective intensity of the Gaussian body after considering preceding occlusion is used to calculate its opacity contribution.

[0056] ,in, The final opacity calculated in S1.4(3); product term Multiply the transparency of the preceding Gaussian volume to ensure that the spatial logic of "near equipment occluding the far tunnel wall" in the mine scene remains consistent during rendering.

[0057] S3.2 Based on the calculated weights The rendering of the following three branch feature maps is performed in parallel.

[0058] (1) Vector chromaticity map (HV-Map) rendering: In order to remove the interference of brightness on color, a 2-channel pure chromaticity feature map containing hue and saturation information is rendered. , The formula is:

[0059]

[0060] in, To cover pixels A set of Gaussian volume indices; in low-light conditions in underground mines. The region is prone to chromatic noise. Multiply by 0.8 for weighted smoothing to prevent noise from being amplified during rendering and to ensure the stability of key colors such as device identification colors.

[0061] (2) Rendering of physical radiance map, rendering a single-channel physical intensity map. Focusing on real-world information, the formula is:

[0062] This image directly reflects the physical light intensity distribution of the mine scene, providing a clean brightness basis for subsequent exposure correction and noise reduction, and avoiding correction deviations caused by interference between color and brightness.

[0063] (3) Rendering of Structure-Map: Rendering feature maps used for structure supervision. According to structural feature dimensions Adaptable to different mining scenarios: When When adapting to complex equipment structures (such as motor and pipe combinations), the average of the three channels is used as the monitoring signal to improve the richness of structural representation. The formula is as follows:

[0064] when Time: Adapts to simple tunnels and large-scale scenarios, directly outputs a single-channel image, reducing computational complexity. The formula is:

[0065] in, When the iteration terminates (i.e., at time t) * The structural feature attribute values ​​of the nth Gaussian body are optimized in the next iteration.

[0066] S4. Based on the camera parameters when acquiring the visual data, the physical radiometric map is exposed and compensated, and dark noise is suppressed by the intensity collapse function to obtain a clean physical intensity map.

[0067] Specifically, it is determined whether the camera parameters provide EXIF ​​metadata; if so, the exposure gain is directly calculated based on the exposure-related parameters; if not, the exposure parameters are calculated based on image statistical features, and outliers are removed using multi-view statistical information; for the physical radiometric map after exposure compensation, the adjusted intensity collapse function is used for denoising, the pixel value truncation range in the function is adapted to the strong light source area of ​​the mine, and parameters adapted to suppress noise in dark areas are set to obtain a clean physical intensity map.

[0068] The physical radiation map obtained in step S3 represents the true light intensity of the scene, but the acquired training images are affected by camera exposure parameters and sensitivity noise, resulting in domain differences between the two. This step unifies the brightness benchmark through exposure gain correction and suppresses dark noise through intensity collapse technology, thereby providing high-quality brightness data for subsequent image reconstruction.

[0069] In practical implementation, S4.1, considering the diversity of mine image acquisition equipment, the exposure gain is calculated in two cases: whether or not EXIF ​​metadata exists.

[0070] 1) When EXIF ​​metadata exists: Read the EXIF ​​parameters (exposure time) of view k. ,aperture ISO ), calculate the exposure gain according to the formula : ,in, This is a preset adjustment coefficient for the mine scene; in the low-light environment of a mine, the camera often uses long exposure and high ISO settings; in this embodiment, it is set to... Gain can be appropriately reduced to avoid noise amplification caused by high sensitivity.

[0071] 2) When EXIF ​​metadata is missing, the exposure gain is estimated using the image's own brightness features. The steps are as follows: 1. Calculate the global average brightness of the image. Dark pixel ratio Peak value of strong light source 2. Obtain the estimated exposure gain value through the fitting formula: The higher the proportion of dark areas and the lower the average brightness relative to the peak value, the greater the gain, which is suitable for the low-light characteristics of mines; 3. Outlier correction: for Outliers are corrected using linear interpolation: ,in, For all views of the median.

[0072] S4.2 Based on the calculated gain, the physical radiation map generated in step S3 is first converted into an intensity map simulating the image received by the camera sensor. .

[0073] Then, in order to remove sensor thermal noise in low-light environments, an intensity collapse function is introduced. ,right Nonlinear filtering is performed to obtain a pure brightness image. : ,in, Will Truncate to the [0,1] range to prevent overexposure from overflowing. hour, This enables noise collapse in dark areas, while the sine function can enhance details in low-brightness areas, making it suitable for effective information extraction in low-light environments like mines.

[0074] S5, the clean physical intensity map and the vector chromaticity map are recombined into HSV components, and the RGB image is obtained by inverse transformation.

[0075] Specifically, the hue and saturation components are recovered from the vector chromaticity map, and the saturation is enhanced by a preset amplitude to improve the recognizability of mine equipment markings; the clean physical intensity map is used as the luminance component and combined to obtain an HSV image; the HSV image is inversely transformed into an sRGB image through a differentiable color space conversion function, and a lightweight tone mapping module is used to optimize the sRGB image to ensure that the image color and details meet the observation requirements of the mine scene.

[0076] After obtaining the pure chromaticity features (from S3) and the denoised luminance features (from S4) respectively, this step restores the true colors and visual effects of the mine scene through HSV color space reconstruction and tone mapping network. In specific implementation, step S5 includes: S5.1, recombining the decoupled features into the three components of the HSV color space for HSV component recovery: 1) Hue: deduced from the vector chromaticity map to avoid breaks in the red marking area of ​​the mine equipment, the formula is: 2) Saturation: Calculated using a formula to enhance the recognizability of equipment identification colors, addressing the issue of low saturation in low-light conditions in mines. The formula is: , where 1.1 is the saturation enhancement coefficient, which improves the distinction between the equipment identification color and the background without amplifying noise.

[0077] 3) Brightness (Value): Directly use the denoised brightness map output in step S4. : After obtaining the HSV components in S5.2, a differentiable 3D LUT (i.e., a three-dimensional lookup table) trilinear interpolation function is used. The formula for inverse transforming the HSV components into an sRGB image is as follows: This process maintains gradient transitivity, enabling the entire rendering pipeline to support end-to-end training.

[0078] Finally, to further optimize the visual effects, a network structure of " "Lightweight tone mapping network" Process and optimize images This aims to fine-tune local tonal differences and normalize pixel values ​​to the [0,1] display range. The final output is the predicted image. It takes into account the accurate reproduction of colors, the uniform distribution of brightness, and the clear presentation of structure, providing high-quality predictive input for the loss calculation of S6.

[0079] S6. Based on the RGB image, the structural feature map, the physical prior structure map, and the real image of the mine scene, construct a multi-loss constraint function, and use the Adam optimization algorithm to perform end-to-end training and update of the learnable parameters of the three-dimensional Gaussian ellipsoid until the loss converges.

[0080] Specifically, a total loss function is constructed, consisting of photometric loss, structural consistency loss, and buoyancy suppression loss. For both large-scale tunnel scenarios and close-range equipment scenarios, corresponding optimization parameters and iteration stages are configured. Based on a combination of general and scenario-specific hyperparameters, the Adam optimization algorithm is used to update the learnable parameters of the Gaussian ellipsoid end-to-end. Gaussian pruning and fine-tuning are performed in stages until the loss converges. Specifically, the photometric loss uses a weighted combination of multiple loss classes based on the difference between the RGB image and the real image of the mine scene; the structural consistency loss is constrained by the difference between the structural feature map and the physical prior structure map; and the buoyancy suppression loss incorporates a gradient scaling strategy.

[0081] To drive accurate updates of the aforementioned model parameters (including Gaussian volume properties, tone mapping network parameters, etc.), this step constructs a multi-loss function encompassing photometric, structural, and regularized values, and employs a phased optimization strategy to ensure the model's convergence and robustness in complex mining scenarios. In specific implementation, S6.1 first defines the total loss function. It consists of photometric loss, structural consistency loss, and regularization loss, and the formula is: , among which, setting These are the weighting coefficients; It can enhance structural monitoring and adapt to the structural accuracy requirements of mining scenarios. Lower values ​​can smooth parameters while avoiding excessive suppression of details. The loss terms are calculated as follows: 1) Photometric loss Combining L1 loss and D-SSIM loss, the effect of noise in mine images is suppressed by the following formula: ,in, , The images used are real images of the mine scene (or high-fidelity images collected); L1 loss is robust to noise, and D-SSIM loss focuses on structural similarity. The combination of the two ensures pixel-level accuracy while avoiding structural distortion.

[0082] 2) Structural consistency loss The difference between the constrained rendering structure graph and the physical prior structure graph is used to ensure that the Gaussian volume distribution fits the real scene structure. The formula is: Where H and W are the image height and width, the rendering structure is forced to align with the physical prior by using the global pixel average error.

[0083] 3) Regularization loss To prevent buoyancy artifacts caused by sudden parameter changes during training, L2 smoothing constraints are applied to the physical radiance and vector chromaticity. The formula is as follows: ,in, The total number of Gaussian bodies is determined by penalizing excessively large parameter values ​​to ensure a smooth transition of Gaussian body properties.

[0084] S6.2 This embodiment designs a two-stage optimization strategy from coarse to fine, utilizing the physical prior structure diagram generated in step S2 ( As a guiding signal throughout: In the first stage (rounds 1-5000), geometric topology construction and structure-oriented densification: 1) Weighted structure-guided densification: changing the traditional reliance solely on location gradients Encryption logic, introducing As a weight for structural confidence, the weighted gradient norm is calculated. : ,in, For Gaussian solid projection coordinates, To enhance the coefficients; splitting strategy: when the Gaussian body satisfies When the gradient threshold (set to 0.0002 in the example) is greater than 1% of the point cloud spacing, it is split into two Gaussian bodies.

[0085] 2) Aggressive pruning based on opacity: To remove "floating artifacts" caused by mine dust and sparse viewpoints, double pruning is performed: Threshold pruning: Every 100 iterations, the upper limit of opacity is removed. A Gaussian body (set to 0.005).

[0086] Periodic Reset: Every 3000 iterations, the opacity of all Gaussian volumes is reset to 0.01. This forces the model to "compete" for survival again through the geometric constraints of step S1, effectively eliminating accumulated translucent, smoky artifacts.

[0087] In the second phase (rounds 5001-15000), geometric locking and physical appearance decoupling refinement are performed: 1) Geometric parameter locking mechanism: all densification and pruning operations are stopped, and all spatial geometric parameters of the 3D Gaussian body (including position coordinates) are frozen. Rotation Quaternions With scaling vector This prevents it from accepting gradient updates.

[0088] Only optimized vector chromaticity is available Physical emissivity Structural features and tone mapping network The weight.

[0089] 2) Based on Spatial Adaptive Gradient Scaling: Constructing a pixel-level gradient scaling mask using the physical prior structure map generated by S2. Differentiated learning is implemented for different frequency domain regions: ,in, for High quantile threshold, This is the lower bound of the basic learning rate.

[0090] Device / Edge Area ( high): It allows for full-intensity gradient backhaul, ensuring clear restoration of high-frequency details such as dashboard readings and warning signs.

[0091] Tunnel wall / ground area ( Low): It attenuates the gradient amplitude, thus playing a regularization role and smoothing out the sensor's chromaticity noise under low light conditions.

[0092] 3) Cosine annealing scheduling in the time dimension: During the iteration process, the learning rate of the open parameters is adjusted. Cosine annealing attenuation: ,in, This is the initial refinement learning rate. for The percentage is 1%. This strategy ensures that the model can quickly adapt to the adjustment of lighting features in the early stage of the phase, and converge slightly at the end of the phase, avoiding parameter oscillation and obtaining delicate rendering quality.

[0093] Iteration terminates: when The fluctuation is less than 500 consecutive iterations Training should be stopped when the time comes.

[0094] The final optimized set of three-dimensional Gaussian volumes is obtained. Its definition is: ,in, This represents the total number of Gaussian bodies retained after phased optimization. The optimized geometric properties are designed to fit the actual spatial structure of mine tunnels and equipment. The color features restore the equipment identification colors and the natural colors of the environment. The structural properties are highly aligned with the physical priors, thus meeting the high-precision 3D reconstruction requirements of mine scenarios.

[0095] S7, based on the Gaussian body set parameters after training convergence, outputs the 3D reconstruction result of the underground mine scene from the desired viewpoint through viewpoint adaptive rendering.

[0096] Specifically, after training, based on step S6, the final optimized set of three-dimensional Gaussian volumes includes four decoupled attributes: geometry, chromaticity, physics, and structure. and the 3D LUT interpolation function trained in step S5. and tone mapping network It performs inverse color space transformation and viewpoint adaptive rendering to output high-precision, robust 3D data of the mine scene. The specific process includes: S7.1 rendering attribute loading and viewpoint space mapping; for any user-specified target viewpoint, obtaining its camera extrinsic parameter matrix. and intrinsic parameter matrix Traversing the set Each Gaussian body Using the Gaussian projection formula in step S1, calculate its two-dimensional projection center from the target's perspective. Two-dimensional covariance matrix and depth-based sorted indexes .

[0097] S7.2 Parallel rasterization of decoupled features, based on sorted Gaussian volume index, utilizing... - The blending technique renders two core decoupled branches in parallel to obtain intermediate feature maps from the target's perspective: 1) Vector chromaticity branch: utilizing optimized vector chromaticity attributes The hue feature map from the target viewpoint is obtained by rendering. and saturation feature map 2) Physical radiation branch: utilizing the optimized physical emissivity property Rendering yields a pure physical intensity map from the target's perspective. The formula is expressed as:

[0098] in, The opacity of the Gaussian body under the target viewpoint is assigned a weight, and the weight is calculated in the same way as the opacity contribution formula in S3.1 to ensure consistency across steps.

[0099] S7.3 HSV spatial reconstruction reassembles the three independent channel features obtained in S7.2 into a complete HSV image. At this stage, the system can enhance specific areas of the mine according to actual needs (e.g., artificially improve...). The gain is used to simulate the effect of turning on a searchlight, or to enhance... (To highlight warning signs)

[0100] S7.4 Inverse Color Transformation and Final Imaging: To convert the HSV image in physical space into an sRGB image visible to the human eye and eliminate the non-uniform lighting artifacts unique to the mining environment, The process proceeds sequentially through the trained color mapping module: 1) Inverse color space transformation: Trilinear interpolation is performed using the 3D LUT function optimized in step S5.2.

[0101] 2) Tone mapping and detail enhancement: Input lightweight tone mapping network Output the final high-fidelity reconstructed image. : .

[0102] Based on the above embodiments, this invention proposes a high-fidelity 3D reconstruction and multi-mode rendering method for non-uniform lighting and weak texture environments in underground mines. This method uses 3D Gaussian sputtering as the explicit scene representation basis, combined with color space decoupling and lighting physical properties, and sequentially executes the following steps: First, preprocessing the mine multi-view data initializes a four-dimensional decoupled Gaussian volume set containing geometry, vector chromaticity, physical emissivity, and structural features; second, extracting a lighting-independent physical prior structure diagram based on the physical prior theory of photometric gradients to provide strong constraints for dark geometry; third, constructing a physically-based decoupled rendering pipeline, explicitly simulating camera exposure and lighting response, and combining... This invention guides Gaussian geometric growth and pruning to complete chroma-luminance reorganization and inverse transformation. Scene parameters are jointly optimized end-to-end using photometric loss, structural consistency loss, and HSV space regularization. Finally, based on the optimized decoupling properties, inverse HSV transformation and intensity collapse are performed to achieve illumination-independent pure scene extraction (de-illuminated mode) and physically driven virtual relighting (simulation mode), and low-confidence textures are repaired using cross-view consistency. Through this process, the invention can achieve geometrically accurate and texture-clear 3D reconstruction in complex mining environments with moving miner lamp interference and frequent dynamic shadows; effectively solves the problem of traditional 3DGS generating numerous floating artifacts and texture noise in low-light environments; successfully achieves visual enhancement and detail repair of overexposed or extremely dark areas using physical property decoupling; and further supports low-cost real-time relighting editing of reconstructed scenes.

[0103] This technology improves reconstruction accuracy in extreme underground mine environments. By decoupling Gaussian sphere properties and optimizing physical prior extraction, it addresses the low reconstruction accuracy issues in non-uniform lighting and sparse point cloud scenarios in mines, achieving scene reconstruction with centimeter- to millimeter-level accuracy. It also ensures real-time application requirements by balancing reconstruction accuracy and computational efficiency through dynamic structural feature dimensions and lightweight processing, meeting the real-time rendering needs of scenarios such as mine inspection and navigation. Furthermore, it enhances environmental robustness by employing exposure compensation adaptation and intensity collapse denoising schemes to improve the model's adaptability to extreme conditions such as low light, strong reflection, and noise in mines, reducing reconstruction artifacts and structural fractures. This technology meets the urgent application needs in fields such as smart mine digital twins, underground disaster emergency drills, and navigation planning for unmanned inspection robots.

[0104] Please refer to Figure 2 for the second embodiment of the present invention. The figure shows a structural block diagram of the underground mine scene reconstruction system based on non-uniform illumination using 3D Gaussian sputtering. This system 200 includes: a data acquisition and processing module 21, a physical prior structure map determination module 22, a decoupled rendering module 23, a clean physical intensity map determination module 24, an RGB image determination module 25, a model training module 26, and a 3D reconstruction module 27. Specifically: the data acquisition and processing module 21 acquires visual data of the underground mine scene and processes the visual data to obtain multi-view 2D image data. It then generates a sparse point cloud based on the multi-view 2D image data and initializes a 3D Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point cloud to obtain an initial 3D Gaussian body set for the mine scene. The physical prior structure map determination module 22 extracts a physical prior structure map adapted to the mine environment from the multi-view 2D image data, which serves as the Gaussian ellipsoid. The system includes: a supervision signal for spherical geometric growth; a decoupled rendering module 23 for decoupling rendering the initial 3D Gaussian ellipsoid set to generate a vector chromaticity map, a physical radiometric map, and a structural feature map; a clean physical intensity map determination module 24 for performing exposure compensation on the physical radiometric map based on the camera parameters when acquiring the visual data, and suppressing dark noise through an intensity collapse function to obtain a clean physical intensity map; an RGB image determination module 25 for recombining the clean physical intensity map and the vector chromaticity map into HSV components, and performing an inverse transformation to obtain an RGB image; a model training module 26 for constructing a multi-loss constraint function based on the RGB image, the structural feature map, the physical prior structure map, and a real image of the mine scene, and using the Adam optimization algorithm to perform end-to-end training and updating of the learnable parameters of the 3D Gaussian ellipsoid until the loss converges; and a 3D reconstruction module 27 for outputting the 3D reconstruction result of the underground mine scene from the desired viewpoint through viewpoint adaptive rendering based on the parameters of the Gaussian ellipsoid set after training convergence.

[0105] Example 3 Another aspect of the present invention also proposes an electronic device. Please refer to Figure 3, which is a schematic diagram of the electronic device in the third embodiment of the present invention. It includes a memory 20, a processor 10, and a computer program 30 stored in the memory and executable on the processor. When the processor 10 executes the computer program 30, it implements the underground mine scene reconstruction method based on non-uniform illumination of three-dimensional Gaussian sputtering as described above.

[0106] In some embodiments, the processor 10 may be a central processing unit (CPU), controller, microcontroller, microprocessor or other data processing chip, used to run program code stored in memory 20 or process data, such as executing access restriction programs.

[0107] The memory 20 includes at least one type of readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 20 can be an internal storage unit of an electronic device, such as the hard disk of the electronic device. In other embodiments, the memory 20 can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. Furthermore, the memory 20 can include both internal and external storage units of the electronic device. The memory 20 can be used not only to store application software and various types of data of the electronic device, but also to temporarily store data that has been output or will be output.

[0108] It should be noted that the structure shown in Figure 3 does not constitute a limitation on the electronic device. In other embodiments, the electronic device may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0109] This invention also proposes a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering.

[0110] Those skilled in the art will understand that the logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can mean any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0111] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0112] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0113] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0114] The above embodiments merely illustrate several implementation methods of the present invention, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this patent should be determined by the appended claims.

Claims

1. A method for reconstructing underground mine scenes based on non-uniform illumination using 3D Gaussian sputtering, characterized in that, The method includes: acquiring visual data of an underground mine scene, processing the visual data to obtain multi-view two-dimensional image data, generating a sparse point cloud based on the multi-view two-dimensional image data, and initializing a three-dimensional Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point cloud to obtain an initial three-dimensional Gaussian volume set for the mine scene; extracting a physical prior structure map adapted to the mine environment based on the multi-view two-dimensional image data as a supervision signal for Gaussian ellipsoid geometric growth; decoupling and rendering the initial three-dimensional Gaussian volume set to generate a vector chromaticity map, a physical radiation map, and a structural feature map; and based on camera parameters acquired during the acquisition of the visual data... Exposure compensation is applied to the physical radiometric map, and dark noise is suppressed using an intensity collapse function to obtain a clean physical intensity map. The clean physical intensity map and the vector chromaticity map are recombined into HSV components, and an inverse transform is performed to obtain an RGB image. Based on the RGB image, the structural feature map, the physical prior structure map, and the real image of the mine scene, a multi-loss constraint function is constructed. The Adam optimization algorithm is used to perform end-to-end training and update of the learnable parameters of the three-dimensional Gaussian ellipsoid until the loss converges. Based on the Gaussian body set parameters after training convergence, the three-dimensional reconstruction result of the underground mine scene under the desired viewpoint is output through viewpoint adaptive rendering.

2. The method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, The steps for initializing a set of three-dimensional Gaussian ellipsoidal attributes containing dynamic structural features based on the sparse point cloud to obtain an initial set of three-dimensional Gaussian volumes for the mine scene include: acquiring visual data of the underground mine scene from a sparse viewpoint using a camera, processing the visual data to obtain multi-view two-dimensional image data, and generating a sparse point cloud from the multi-view two-dimensional image data based on a motion recovery structure algorithm; reconstructing the three-dimensional scene using three-dimensional Gaussian sputtering technology based on the sparse point cloud; wherein, in the initial stage of the reconstruction process, each point in the sparse point cloud is initialized as a geometric attribute of a three-dimensional Gaussian ellipsoid, and the coverage area of ​​the Gaussian ellipsoid is expanded according to a preset ratio to adapt to the sparse point cloud scene; initializing the vector chromaticity attribute based on the RGB information of the underground mine image through inverse Gamma correction, and initializing the physical emissivity attribute by combining the color features of the sparse point cloud and the low-light characteristics of the mine; determining the structural feature dimension based on the sparse point cloud density and scene type, and completing the initial assignment of structural features.

3. The method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, The steps for extracting a physical prior structure map adapted to the mine environment from the multi-view two-dimensional image data, and using it as a supervision signal for Gaussian ellipsoidal geometric growth, include: calculating the pixel brightness gradient of each pixel in the image based on the physical prior theory of photometric gradient, and constructing the physical prior structure map by combining spatial differential operators; for all-black pixel areas in the mine, filling pseudo-structure signals based on neighborhood gradients to avoid invalid regions in the physical prior structure map; and for strongly reflective pixel areas, introducing noise suppression factors to perform gradient smoothing to reduce the impact of reflection interference on the physical prior structure map.

4. The method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, The steps of decoupling and rendering the initial 3D Gaussian volume set to generate a vector chromaticity map, a physical radiometric map, and a structural feature map include: performing α-blending rasterization on the 3D Gaussian volume to generate a vector chromaticity map, a physical radiometric map, and a structural feature map, respectively; for high-noise regions in the vector chromaticity map where the physical radiometric rate is lower than a preset threshold, weighted smoothing is applied to their rendering weights; for the structural feature map, if multi-dimensional structural features are used, their channel composite value is taken as the supervision signal; if single-dimensional structural features are used, a single-channel map is directly output to balance the structural supervision effect and computational efficiency; wherein, the vector chromaticity map is used to characterize the intrinsic color of the object after stripping the illumination, the physical radiometric map is used to characterize the true light field distribution including the influence of the light source, and the structural feature map is used to maintain geometric continuity in dark regions.

5. The method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, The steps of performing exposure compensation on the physical radiometric map based on the camera parameters when acquiring the visual data, and suppressing dark noise using an intensity collapse function to obtain a clean physical intensity map include: determining whether the camera parameters provide EXIF ​​metadata; if so, directly calculating the exposure gain based on exposure-related parameters; if not, calculating the exposure parameters based on image statistical features and removing outliers using multi-view statistical information; and denoising the exposed physical radiometric map using an adjusted intensity collapse function, truncating the pixel values ​​in the function to fit the strong light source area of ​​the mine, and setting parameters to adapt to dark noise suppression to obtain a clean physical intensity map.

6. The method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, The steps of recombining the clean physical intensity map and the vector chromaticity map into HSV components and inversely transforming them to obtain an RGB image include: recovering the hue and saturation components from the vector chromaticity map and enhancing the saturation by a preset amplitude to improve the recognizability of mine equipment markings; using the clean physical intensity map as the luminance component to combine them to obtain an HSV image; inversely transforming the HSV image into an sRGB image using a differentiable color space conversion function, and optimizing the sRGB image using a lightweight tone mapping module to ensure that the image color and details meet the observation requirements of the mine scene.

7. The method for reconstructing an underground mine scene based on non-uniform illumination using three-dimensional Gaussian sputtering according to claim 1, characterized in that, Based on the RGB image, the structural feature map, the physical prior structure map, and the real image of the mine scene, a multi-loss constraint function is constructed. The Adam optimization algorithm is used to perform end-to-end training and updating of the learnable parameters of the 3D Gaussian ellipsoid until the loss converges. The steps include: constructing a total loss function composed of photometric loss, structural consistency loss, and buoyancy suppression loss; configuring corresponding optimization parameters and iteration stages for large-scale tunnel scenes and close-range equipment scenes respectively; configuring hyperparameters according to general combinations for all scenes and scene-specific combinations, using the Adam optimization algorithm to update the learnable parameters of the Gaussian ellipsoid end-to-end, and performing Gaussian densification pruning and fine optimization in stages until the loss converges; wherein, the photometric loss is based on the difference between the RGB image and the real image of the mine scene and adopts a multi-class loss weighted combination, the structural consistency loss is based on the difference constraint between the structural feature map and the physical prior structure map, and the buoyancy suppression loss introduces a gradient scaling strategy.

8. A system for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering, characterized in that, The system for implementing the underground mine scene reconstruction method based on non-uniform illumination using three-dimensional Gaussian sputtering as described in any one of claims 1 to 7 comprises: a data acquisition and processing module for acquiring visual data of the underground mine scene, processing the visual data to obtain multi-view two-dimensional image data, generating sparse point clouds based on the multi-view two-dimensional image data, and initializing a three-dimensional Gaussian ellipsoid attribute set containing dynamic structural features based on the sparse point clouds to obtain an initial three-dimensional Gaussian volume set for the mine scene; a physical prior structure map determination module for extracting a physical prior structure map adapted to the mine environment based on the multi-view two-dimensional image data, serving as a supervision signal for the geometric growth of the Gaussian ellipsoid; and a decoupled rendering module for performing decoupled rendering on the initial three-dimensional Gaussian volume set to generate a vector chromaticity map, a physical radiation map, and structural features. The diagram includes: a clean physical intensity map determination module, used to perform exposure compensation on the physical radiometric map based on camera parameters during the acquisition of the visual data, and to suppress dark noise through an intensity collapse function to obtain a clean physical intensity map; an RGB image determination module, used to reconstruct the clean physical intensity map and the vector chromaticity map into HSV components, and perform inverse transformation to obtain an RGB image; a model training module, used to construct a multi-loss constraint function based on the RGB image, the structural feature map, the physical prior structure map, and the real image of the mine scene, and to perform end-to-end training and updating of the learnable parameters of the three-dimensional Gaussian ellipsoid using the Adam optimization algorithm until the loss converges; and a three-dimensional reconstruction module, used to output the three-dimensional reconstruction result of the underground mine scene from the desired viewpoint through viewpoint adaptive rendering based on the Gaussian body set parameters after training convergence.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the underground mine scene reconstruction method based on non-uniform illumination of three-dimensional Gaussian sputtering as described in any one of claims 1 to 7.

10. An electronic device, characterized in that, The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the method for reconstructing underground mine scenes based on non-uniform illumination using three-dimensional Gaussian sputtering as described in any one of claims 1-7.

Images