Photogrammetry modeling precision optimization method and device based on cross polarization and medium

Through cross-polarization technology and depth mask mapping, the reflection and shadow problems in traditional photogrammetry are solved, the quality and efficiency of three-dimensional reconstruction are improved, high-reality models are generated, and physical rendering is supported, which simplifies the operation process and reduces costs.

CN118967966AActive Publication Date: 2024-11-15SUZHOU IND PARK SURVEYING MAPPING & GEOINFORMATION CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411411721.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-11
Publication Date
2024-11-15
Estimated Expiration
2044-10-11

AI Technical Summary

Technical Problem

Traditional photogrammetry and three-dimensional reconstruction methods have problems with reflection and shadowing, and efficiency and quality are difficult to optimize. Especially in ensuring the accuracy and reality of the model, simplifying the process and supporting the generation of physical rendering materials.

Method used

Using photogrammetry technology based on cross-polarization, photo processing and 3D model generation are carried out by designing light source polarization components and camera polarization lenses, combining depth mask mapping and control point alignment technology, optimizing the three-dimensional reconstruction process, eliminating reflections and shadows, and improving the model Accuracy and efficiency.

Benefits of technology

It significantly improves the quality and efficiency of three-dimensional reconstruction, generates a three-dimensional model with high realistic and low memory footprint, supports high-quality physical rendering, simplifies operational processes and reduces costs, and is suitable for multiple application fields.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118967966A_ABST
    Figure CN118967966A_ABST
Patent Text Reader

Abstract

The invention relates to a photogrammetry modeling precision optimization method and device based on cross polarization and a medium, and belongs to the technical field of remote sensing, and the method comprises the steps: designing and manufacturing a light source polarization assembly on a photogrammetry device based on a three-dimensional model of a flash lamp on the photogrammetry device; the light source polarization assemblies are installed on a flash lamp and a camera lens of photogrammetry equipment respectively, photogrammetry scanning is carried out on a main body needing three-dimensional reconstruction based on the cross polarization technology, and a measurement image of the main body is obtained; processing the measurement image to obtain a processed image; in photogrammetry model generation software, generating a three-dimensional model of the subject based on the processed image; optimizing the three-dimensional model of the main body to obtain a model generated by performing photogrammetry on the main body; the three-dimensional reconstruction quality can be improved, the model reconstruction efficiency can be improved, the high-reality model can be generated, the operation process is simplified, the application field is wide, and the economic cost is low.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to a method, device and medium for optimizing photogrammetric modeling accuracy based on cross polarization, and belongs to the field of remote sensing technology. Background Art

[0002] Photogrammetry modeling is a technology that uses photogrammetry technology to perform three-dimensional digital modeling of objects or the ground by taking photos or satellite images. It is widely used in topographic mapping, urban planning, architectural design, cultural relics protection and other fields. This technology involves multiple disciplines such as photogrammetry, digital image processing, and three-dimensional modeling, and is an important branch of remote sensing technology. Through photogrammetry modeling, the three-dimensional shape, position, size and other information of space targets can be accurately obtained, providing important basic data for related applications. It provides efficient data collection and analysis methods for various industries.

[0003] Traditional photogrammetry and 3D reconstruction methods have some limitations and challenges. Photos scanned using ordinary photogrammetry solutions often have problems such as reflections and shadows, which affect the quality of 3D reconstruction and do not have realistic physically based rendering (PBR) material properties. In addition, since the 3D reconstruction process involves a large amount of image resources and complex processing procedures, how to optimize each link to improve efficiency and quality is also an urgent problem to be solved. Therefore, how to simplify the photogrammetry process, improve the efficiency and quality of 3D reconstruction, and support the generation of PBR materials while ensuring model accuracy and realism is an important challenge facing this field. Summary of the invention

[0004] This application provides a method, device and medium for optimizing the accuracy of photogrammetric modeling based on cross polarization, which can solve the problems of harsh environmental requirements, difficult to ensure shooting accuracy and high memory usage in photogrammetric modeling. This application provides the following technical solutions: In a first aspect, a method for optimizing photogrammetric modeling accuracy based on cross polarization is provided, the method comprising: Based on the three-dimensional model of the flash on the photogrammetry equipment, design and manufacture the light source polarization component on the photogrammetry equipment; wherein the light source polarization component includes a light source polarization accessory and a polarizer; The light source polarization component is respectively mounted on the flash and the camera lens of the photogrammetric equipment to perform photogrammetric scanning on the subject to be three-dimensionally reconstructed based on the cross-polarization technology to obtain a measurement image of the subject; Processing the measured image to obtain a processed image; In photogrammetric model generation software, a three-dimensional model of the subject is generated based on the processed image; The three-dimensional model of the subject is optimized to obtain a model generated by photogrammetry of the subject.

[0005] Optionally, the designing and manufacturing of a light source polarization component on the photogrammetry equipment based on a three-dimensional model of a flash on the photogrammetry equipment includes: Performing photogrammetry on the flashlight to obtain a photogrammetry image of the flashlight; Importing the photogrammetric image of the flashlight into a three-dimensional software for three-dimensional reconstruction, deleting the generated redundant area, exporting the plain model of the flashlight, and obtaining the three-dimensional model of the flashlight; Designing a three-dimensional model of a light source polarization accessory that matches the three-dimensional model of the flashlight; The light source polarization accessory is manufactured based on the three-dimensional model of the accessory by a 3D printer; Based on the assembly space of the first assembly position on the light source polarization accessory, the polarizer is cut to obtain a polarizer adapted to the assembly space, and the cut polarizer is assembled to the light source polarization accessory through the first assembly position to obtain the light source polarization component.

[0006] Optionally, the accessory three-dimensional model of the light source polarization accessory designed to match the three-dimensional model of the flashlight includes: Designing the three-dimensional model of the accessory using a hollowing process; A plurality of holes are arranged inside the three-dimensional model of the accessory to embed a magnet block, and the iron block is used to quickly assemble the light source polarization accessory and the flashlight.

[0007] Optionally, performing photogrammetric scanning on a subject to be three-dimensionally reconstructed based on a cross-polarization technique to obtain a measurement image of the subject includes: The flash power is adjusted to full power, and the format of the measurement image is set to Raw; Performing photogrammetric scanning on the upper half and the lower half of the subject respectively based on the cross-polarization technique to obtain a measurement image of the subject; Place the color card in the same light and shadow environment as the subject, and shoot the color card based on the cross polarization technology.

[0008] Optionally, the performing photogrammetric scanning on the upper half and the lower half of the subject respectively based on the cross-polarization technology to obtain the measurement image of the subject includes: When performing photogrammetric scanning on each part, the physical distance between the photogrammetric equipment and the subject is kept constant, and photographs are taken of the subject at various heights and levels to obtain a measurement image of the subject; There is an overlap area of ​​a preset area between the measurement images captured in adjacent positions; and a dark frame is captured between the photogrammetric scan of the upper half and the photogrammetric scan of the lower half to distinguish the measurement image corresponding to the upper half from the measurement image of the lower half.

[0009] Optionally, the processing the measured image to obtain a processed image includes: Importing the measured images into image processing software matched with the color card to perform batch color calibration on the measured images; Importing the color-calibrated images into image processing software, selecting one of the color-calibrated images to adjust image parameters, and applying the adjustment to other color-calibrated images to correct the color-calibrated image obtained in this shooting, thereby obtaining a corrected measurement image; The corrected measurement image corresponding to the upper half of the subject and the corrected measurement image corresponding to the lower half are saved in different folders, respectively, and exported to Jpeg format to obtain processed images.

[0010] Optionally, in the photogrammetry model generation software, generating the three-dimensional model of the subject based on the processed image comprises: Import the processed images in the folder corresponding to the upper part into the photogrammetry model generation software, automatically align the images, and obtain the point cloud data of the upper part of the subject; set the reconstruction area and erase the unnecessary area; use the cropping function to crop the upper and lower parts of the support frame in the upper part and reconstruct the model to generate a depth mask map of the cropped area; Disable all cameras in the upper part, import the processed images in the folder corresponding to the lower part, automatically align the images, and obtain the point cloud data of the lower part of the scanned model; set the reconstruction area to erase the unnecessary area; use the cropping function to crop the upper and lower parts of the support frame in the lower part and reconstruct the model to generate a depth mask map of the cropped area; A new modeling task is created in the photogrammetry model, and a folder corresponding to the upper half, a folder corresponding to the lower half, a depth mask map corresponding to the upper half, and a depth mask map corresponding to the lower half are imported into the new modeling task, and images are automatically aligned. If the images of the set are not completely aligned, control points are used to assist the photogrammetry model generation software to align the image overlapping points, so as to obtain a three-dimensional model of the subject.

[0011] In a second aspect, a device for optimizing photogrammetric modeling accuracy based on cross-polarization is provided, the device comprising a processor and a memory; a program is stored in the memory, and the program is loaded and executed by the processor to implement the method for optimizing photogrammetric modeling accuracy based on cross-polarization described in the first aspect.

[0012] In a third aspect, a computer-readable storage medium is provided, wherein a program is stored in the storage medium, and the program is loaded and executed by the processor to implement the method for optimizing the accuracy of photogrammetric modeling based on cross-polarization as described in the first aspect.

[0013] The beneficial effects of this application are: (1) Improving the quality of 3D reconstruction: Using cross-polarization photogrammetry technology, the reflection and shadow effects on the surface of the object being photographed are effectively eliminated through special light source polarization accessories and camera polarization lenses, significantly improving the quality of photogrammetry photos. At the same time, a series of optimization processes such as color correction and shadow adjustment are performed on the photos, laying a solid foundation for high-precision 3D reconstruction.

[0014] (2) Improving model reconstruction efficiency: In order to address the problem of photo misalignment that is prone to occur during complete model reconstruction, a strategy of processing the upper and lower halves of the photographed object separately is adopted, combined with depth mask mapping and control point alignment technology to effectively solve this problem and improve the accuracy and efficiency of model reconstruction.

[0015] (3) Generate a high-realistic model: Based on the high-resolution 3D model, post-processing such as surface correction, topology optimization, and texture reprojection are performed, and normal maps, color maps, metalness maps, and roughness maps are generated in combination with physical properties. Finally, an optimized 3D model with high realism and low memory usage is obtained, laying a solid foundation for achieving high-quality PBR rendering.

[0016] (4) Simplified operation process: The entire process from photogrammetry to 3D reconstruction has been systematically optimized and simplified, including the magnetic quick-install design of polarization accessories, the integration of multi-angle shooting and depth information capture, batch preset of photo processing, and stage splitting of the reconstruction process. This has greatly reduced the operation threshold and workload, and improved the overall production efficiency.

[0017] (5) Wide range of applications: Cross-polarization photogrammetry and 3D reconstruction optimization solutions are highly versatile and practical, and can be widely used in archaeological excavation, cultural relics protection, medical research, industrial manufacturing, virtual reality and other fields, providing strong technical support for high-precision 3D digitization and digital twins.

[0018] (6) Low economic cost: The hardware equipment used is relatively simple, mainly self-designed light source polarization accessories and camera polarization lenses, which are relatively low in cost. In terms of software, by optimizing algorithms and simplifying parameters in each link, the consumption of computing resources is effectively controlled, further reducing economic costs.

[0019] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application and implement it according to the contents of the specification, the following is a detailed description of the preferred embodiments of the present application in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a flow chart of a method for optimizing photogrammetric modeling accuracy based on cross-polarization provided by an embodiment of the present application; Figure 2 It is a block diagram of a device for optimizing the accuracy of photogrammetric modeling based on cross polarization provided by one embodiment of the present application; Figure 3 It is a block diagram of a device for optimizing photogrammetric modeling accuracy based on cross-polarization provided by an embodiment of the present application. DETAILED DESCRIPTION

[0021] The specific implementation methods of the present application are further described in detail below in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present application but are not intended to limit the scope of the present application.

[0022] In order to solve the limitations of traditional photogrammetry and 3D reconstruction methods, this application proposes a new solution, namely a 3D reconstruction method based on photogrammetry and optimized processing of cross-polarization accessories. This method uses independently designed light source polarization accessories and camera polarization lenses to achieve cross-polarization shooting, effectively eliminating the interference of reflections and shadows on the model surface. At the same time, a series of optimization strategies such as photo preprocessing, staged modeling, surface correction, and texture reprojection are adopted to ensure that while improving modeling efficiency, a detailed, realistic, and PBR-textured 3D model is generated.

[0023] However, to achieve this goal, a series of problems need to be solved, including how to design reasonable polarization accessories, how to choose the best shooting parameters, how to perform efficient photo processing, how to split and optimize the modeling process, and how to generate high-quality PBR texture maps. Designing polarization accessories requires considering multiple factors such as optical performance, heat dissipation, structural strength, and ease of assembly; selecting shooting parameters requires repeated testing and weighing in terms of light brightness, polarization angle, and shooting distance; optimizing the modeling process requires reasonable division of stages and the use of key technologies such as control point-assisted alignment, depth mask denoising, mesh simplification, and texture mapping; generating PBR maps requires drawing and baking multi-channel maps such as normals, metalness, and roughness based on the model's geometry and material properties.

[0024] Therefore, developing a high-quality 3D reconstruction solution based on cross-polarization photogrammetry and system optimization is a very challenging and innovative task. This requires comprehensive consideration of theories and technologies in multiple fields such as optical imaging, image processing, 3D reconstruction, PBR rendering, etc., and through systematic experiments and optimization, ultimately achieving an all-round improvement in efficiency, quality, and realism.

[0025] To achieve the above goals, this application provides a comprehensive optimization solution that uses cross-polarization, photogrammetry, model topology baking and other technologies to effectively solve many problems in photogrammetry modeling. This method has significant advantages in improving production efficiency, reducing memory usage, ensuring rendering quality and maintaining visual consistency, and provides important support for its wide application in topographic mapping, urban planning, architectural design, cultural relics protection and other fields.

[0026] Figure 1 This is a flow chart of a method for optimizing the accuracy of photogrammetric modeling based on cross polarization provided by an embodiment of the present application. The method includes at least the following steps: Step 101, based on the three-dimensional model of the flash on the photogrammetry equipment, design and manufacture a light source polarization component on the photogrammetry equipment; wherein the light source polarization component includes a light source polarization accessory and a polarizer.

[0027] In this embodiment, the flashlight is a high-power annular flashlight, which has the best imaging effect due to its uniform lighting characteristics.

[0028] Based on the three-dimensional model of the flash on the photogrammetry equipment, a light source polarization component on the photogrammetry equipment is designed and manufactured, including steps 1011-1015: Step 1011, perform photogrammetry on the flash to obtain a photogrammetry image of the flash.

[0029] The photogrammetry of the flash includes: taking full coverage photos of the flash at multiple angles to obtain a photogrammetry image of the flash. In the process of constructing a three-dimensional model of the flash, since only the structure of the flash needs to be obtained, there is no need to perform additional optimization processing on the accuracy of the three-dimensional modeling of the flash.

[0030] Step 1012, importing the photogrammetric image of the flash into a 3D software for 3D reconstruction, deleting the generated redundant area, exporting the plain model of the flash, and obtaining a 3D model of the flash.

[0031] Step 1013, designing a three-dimensional model of a light source polarization accessory that matches the three-dimensional model of the flash, specifically includes: Designing a three-dimensional model of a light source polarization accessory that is compatible with a three-dimensional model of a flashlight, including: using a hollowing process to design the three-dimensional model of the accessory; setting multiple holes on the inner side of the three-dimensional model of the accessory to embed magnet blocks, and the iron blocks are used to quickly assemble the light source polarization accessory and the flashlight.

[0032] The number of holes may be 8-12. In other embodiments, the number of holes may be greater or lesser. This embodiment does not limit the number of holes.

[0033] Since a high-power, high-speed flash generates a lot of heat when running, the use of hollowing technology when designing accessories can ensure the heat dissipation and stability of the light source polarization accessories.

[0034] Step 1014: Using a 3D printer to produce a light source polarization accessory based on the accessory three-dimensional model.

[0035] Specifically, the three-dimensional model of the accessory is converted into the Stl format, printed using black nylon carbon fiber material in a 3D printer, and the printed product is polished using sandpaper to obtain a light source polarization accessory.

[0036] Step 1015, based on the assembly space of the first assembly position on the light source polarization accessory, cut the polarizer to obtain a polarizer adapted to the assembly space, and assemble the cut polarizer to the light source polarization accessory through the first assembly position to obtain a light source polarization assembly.

[0037] In one example, the polarizer is cut according to the size of the inner groove ring and the size of the empty space of the accessory, and the polarizer is assembled into the light source polarization accessory. Magnets are installed at the reserved holes of the polarization accessory and at the contact points of the ring flash, and fixed with AB glue. The polarization accessory is assembled on the flash body by magnetic attraction.

[0038] Step 102 , respectively installing light source polarization components on the flash and camera lens of the photogrammetric equipment, so as to perform photogrammetric scanning on the subject to be three-dimensionally reconstructed based on the cross-polarization technology, and obtain a measurement image of the subject.

[0039] In one example, a subject to be three-dimensionally reconstructed is subjected to photogrammetric scanning based on a cross-polarization technique to obtain a measurement image of the subject, including steps 1021-1023: Step 1021, adjust the flash power to full power, and set the format of the measured image to Raw.

[0040] Install the light source polarization accessory and polarizing filter on the flash and camera lens respectively, and adjust the flash power to full power.

[0041] Step 1022 , performing photogrammetric scanning on the upper half and the lower half of the subject respectively based on the cross-polarization technique to obtain a measurement image of the subject.

[0042] Specifically, photogrammetric scanning is performed on the upper and lower parts of the subject respectively based on the cross-polarization technology to obtain a measurement image of the subject, including: when photogrammetric scanning is performed on each part respectively, the physical distance between the photogrammetric equipment and the subject is kept unchanged, and the subject is photographed at various heights and various horizontal planes to obtain a measurement image of the subject.

[0043] There is an overlap area of ​​a preset area between the measurement images captured in adjacent positions; and a dark frame is captured between the photogrammetric scan of the upper half and the photogrammetric scan of the lower half to distinguish the measurement image corresponding to the upper half from the measurement image of the lower half.

[0044] After completing a cycle of shooting, raise the camera height and shoot another cycle of shooting for the subject. After completing the shooting, cover the lens cap and shoot a dark frame to ensure that the upper and lower parts of the photo are easy to distinguish later.

[0045] In one example, the upper half is photographed first, and then the lower half is photographed. When photographing the lower half of the subject, the subject is turned over to ensure that the subject does not undergo any deformation during the turning process.

[0046] The preset area may be 50%-60%. In other embodiments, the value of the preset area may also be other values. This embodiment does not limit the value of the preset area.

[0047] The following shooting conditions were met during the shooting process: 1. During the shooting process, the camera position was moved and changed instead of being rotated up and down to take photos at the same place; 2. Silent shooting or electronic shutter was not used to avoid the problem of jello effect affecting the quality of the generated data; 3. Videos were avoided to replace photos.

[0048] In addition, you can also use photogrammetric equipment without a light source polarization component installed to perform photogrammetric scans on the upper and lower parts of the subject respectively to obtain a contrast image of the subject. At this time, by observing the contrast image and the measured image, you can find that the subject surface of the contrast image has obvious reflection and shadow effects, while the measured image has no obvious reflection and shadow effects, and the color restoration effect is much better than that of the contrast image.

[0049] Step 1023, placing the color card under the same light and shadow environment as the subject, and photographing the color card based on the cross polarization technology.

[0050] Step 103: Process the measured image to obtain a processed image.

[0051] Processing the measured image to obtain a processed image includes steps 1031-1033: Step 1031 , importing the measured images into the image processing software matched with the color card, so as to perform batch color calibration on the measured images.

[0052] Batch color calibration of measured images can be performed, including: optimizing the color difference of color, white balance, brightness, etc. caused by light in the measured images.

[0053] Step 1032, import the color-calibrated images into image processing software (such as Adobe Lightroom), select one of the color-calibrated images to adjust image parameters, and apply the adjustment to other color-calibrated images to correct the color-calibrated image obtained by this shooting, and obtain a corrected measurement image.

[0054] The image parameters include, but are not limited to, image shadow, brightness, exposure and other parameters, and the present embodiment does not limit the content of the image parameters. The color scale of the corrected measured image is flatter than the color scale of the calibrated image.

[0055] It is worth noting that during the image correction process, AI intelligent sampling operations should be avoided. Increasing the resolution of AI intelligent sampling does not improve the generation effect, but will make it worse.

[0056] Step 1032 , the corrected measurement image corresponding to the upper half of the subject and the corrected measurement image corresponding to the lower half are saved in different folders respectively, and exported to Jpeg format to obtain processed images.

[0057] The folder corresponding to the upper part is named differently from the folder corresponding to the lower part. For example, the folder corresponding to the upper part is named Top, and the folder corresponding to the lower part is named Botten.

[0058] Step 104 , in the photogrammetry model generation software, a three-dimensional model of the subject is generated based on the processed image.

[0059] In one example, in the photogrammetry model generation software, generating a three-dimensional model of a subject based on the processed image includes steps 1041-1043: Step 1041, import the processed images in the folder corresponding to the upper half into the photogrammetry model generation software, automatically align the images, and obtain the point cloud data of the upper half of the subject; set the reconstruction area and erase the unnecessary area; use the cropping function to crop the upper and lower parts of the support frame in the upper half and reconstruct the model to generate a depth mask map of the cropped area.

[0060] In this embodiment, the camera depth should be exported simultaneously when the depth mask map is exported.

[0061] Step 1042, disable all cameras in the upper half, import the processed images in the folder corresponding to the lower half, automatically align the images, and obtain the point cloud data of the lower half of the scanned model; erase the unnecessary areas by setting the reconstruction area; use the cropping function to crop the upper and lower areas of the support frame in the lower half and reconstruct the model to generate a depth mask map of the cropped area.

[0062] Step 1043, create a new modeling task in the photogrammetry model, import the folder corresponding to the upper half, the folder corresponding to the lower half, the depth mask map corresponding to the upper half, and the depth mask map corresponding to the lower half into the new modeling task, and automatically align the images. If the images of the set are not completely aligned, use the control point-assisted photogrammetry model generation software to align the image overlapping points to obtain a three-dimensional model of the subject.

[0063] Optionally, if a photogrammetric measurement device without a light source polarization component is used to perform photogrammetric scanning on the upper and lower parts of the subject to obtain a comparison image of the subject, the comparison image of the subject can also be processed in steps 103 and 104 to obtain a comparison model of the subject. At this time, the comparison model and the three-dimensional model of the subject are observed, and it is found that there are many bumps generated by noise on the surface of the comparison model, and the generated texture map has many effects such as overexposure or darkening caused by natural light. The surface of the three-dimensional model of the subject is smooth, and the generated texture map is not baked by natural light.

[0064] Step 105, optimizing the three-dimensional model of the subject to obtain a model generated by performing photogrammetry on the subject.

[0065] Optionally, the three-dimensional model of the subject is optimized to obtain a model generated by photogrammetry of the subject, including steps 1051-1055: Step 1051 , export the high-resolution model from the photogrammetry model generation software to the Zbrush software, and perform polishing correction on the surface of the three-dimensional model of the subject.

[0066] Although the cross polarization technology is used to collect the test image, the scanning effect of some high-brightness materials such as metal is still unsatisfactory. In this embodiment, by further optimizing the three-dimensional model of the subject, the reconstruction effect of the three-dimensional model of the subject can be further improved.

[0067] Step 1052, import the corrected high-resolution model back into the photogrammetry model generation software (in this process, the position and scale of the model are guaranteed to remain unchanged); fill in the upper limit of the number of polygons in the simplification function, perform topology on the high-resolution model, and generate a low-resolution model.

[0068] Step 1053, use the texture reprojection tool on the high-resolution model, set the resolution to 8K, and map the texture map to the high-resolution model.

[0069] Step 1054, use the texture reprojection tool again, set the high-resolution model as the source model, set the low-resolution model as the object model, and generate a normal map and a color map; Step 1055, import the source model and the object model into the texture drawing software, draw the metalness and roughness maps according to the material characteristics of the model, control the intensity through the grayscale value, and obtain the model generated by photogrammetry.

[0070] At this point, the model generated by photogrammetry can be used in any 3D software. It not only retains a high degree of authenticity but also does not take up too much memory.

[0071] In summary, the cross-polarization-based photogrammetry modeling accuracy optimization method provided in this embodiment has the following beneficial effects: (1) Improving the quality of 3D reconstruction: Using cross-polarization photogrammetry technology, the reflection and shadow effects on the surface of the object being photographed are effectively eliminated through special light source polarization accessories and camera polarization lenses, significantly improving the quality of photogrammetry photos. At the same time, a series of optimization processes such as color correction and shadow adjustment are performed on the photos, laying a solid foundation for high-precision 3D reconstruction.

[0072] (2) Improving model reconstruction efficiency: In order to address the problem of photo misalignment that is prone to occur during complete model reconstruction, a strategy of processing the upper and lower halves of the photographed object separately is adopted, combined with depth mask mapping and control point alignment technology to effectively solve this problem and improve the accuracy and efficiency of model reconstruction.

[0073] (3) Generate a high-realistic model: Based on the high-resolution 3D model, post-processing such as surface correction, topology optimization, and texture reprojection are performed, and normal maps, color maps, metalness maps, and roughness maps are generated in combination with physical properties. Finally, an optimized 3D model with high realism and low memory usage is obtained, laying a solid foundation for achieving high-quality PBR rendering.

[0074] (4) Simplified operation process: The entire process from photogrammetry to 3D reconstruction has been systematically optimized and simplified, including the magnetic quick-install design of polarization accessories, the integration of multi-angle shooting and depth information capture, batch preset of photo processing, and stage splitting of the reconstruction process. This has greatly reduced the operation threshold and workload, and improved the overall production efficiency.

[0075] (5) Wide range of applications: Cross-polarization photogrammetry and 3D reconstruction optimization solutions are highly versatile and practical, and can be widely used in archaeological excavation, cultural relics protection, medical research, industrial manufacturing, virtual reality and other fields, providing strong technical support for high-precision 3D digitization and digital twins.

[0076] (6) Low economic cost: The hardware equipment used is relatively simple, mainly self-designed light source polarization accessories and camera polarization lenses, which are relatively low in cost. In terms of software, by optimizing algorithms and simplifying parameters in each link, the consumption of computing resources is effectively controlled, further reducing economic costs.

[0077] Figure 2 The block diagram of a device for optimizing the accuracy of photogrammetric modeling based on cross polarization provided by an embodiment of the present application includes at least the following modules: a component manufacturing module 210, an image measurement module 220, an image processing module 230, a model generation module 240 and a model optimization module 250.

[0078] The component manufacturing module 210 is used to design and manufacture a light source polarization component on the photogrammetry equipment based on the three-dimensional model of the flash on the photogrammetry equipment; wherein the light source polarization component includes a light source polarization accessory and a polarizer; An image measurement module 220, for respectively installing the light source polarization component on the flash and the camera lens of the photogrammetric equipment, so as to perform photogrammetric scanning on the subject to be three-dimensionally reconstructed based on the cross-polarization technology, and obtain a measurement image of the subject; An image processing module 230 is used to process the measurement image to obtain a processed image; A model generation module 240, for generating a three-dimensional model of the subject based on the processed image in a photogrammetric model generation software; The model optimization module 250 is used to optimize the three-dimensional model of the subject to obtain a model generated by performing photogrammetry on the subject.

[0079] For relevant details, refer to the above method embodiment.

[0080] It should be noted that: the device for optimizing photogrammetric modeling accuracy based on cross-polarization provided in the above embodiment only uses the division of the above functional modules as an example when optimizing photogrammetric modeling accuracy based on cross-polarization. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device for optimizing photogrammetric modeling accuracy based on cross-polarization is divided into different functional modules to complete all or part of the functions described above. In addition, the device for optimizing photogrammetric modeling accuracy based on cross-polarization provided in the above embodiment belongs to the same concept as the method embodiment for optimizing photogrammetric modeling accuracy based on cross-polarization. The specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0081] Figure 3 30 is a block diagram of a device for optimizing the accuracy of photogrammetric modeling based on cross polarization provided by an embodiment of the present application. The device may be a smart phone, a tablet computer, a laptop computer, a desktop computer or a server, etc. The device for optimizing the accuracy of photogrammetric modeling based on cross polarization may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal, a control terminal, etc., which is not limited in this embodiment. The device includes at least a processor 301 and a memory 302.

[0082] The processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0083] The memory 302 may include one or more computer-readable storage media, which may be non-transitory. The memory 302 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 302 is used to store at least one instruction, which is used to be executed by the processor 301 to implement the cross-polarization based photogrammetric modeling accuracy optimization method provided in the method embodiment of the present application.

[0084] In some embodiments, the device for optimizing the accuracy of photogrammetric modeling based on cross polarization may optionally include: a peripheral device interface and at least one peripheral device. The processor 301, the memory 302 and the peripheral device interface may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface via a bus, a signal line or a circuit board. Schematically, the peripheral devices include but are not limited to: a radio frequency circuit, a touch display screen, an audio circuit, and a power supply.

[0085] Of course, the device for optimizing the accuracy of photogrammetric modeling based on cross-polarization may also include fewer or more components, which is not limited in this embodiment.

[0086] Optionally, the present application also provides a computer-readable storage medium, in which a program is stored, and the program is loaded and executed by a processor to implement the cross-polarization-based photogrammetry modeling accuracy optimization method of the above method embodiment.

[0087] Optionally, the present application also provides a computer product, which includes a computer-readable storage medium, in which a program is stored, and the program is loaded and executed by a processor to implement the cross-polarization-based photogrammetry modeling accuracy optimization method of the above method embodiment.

[0088] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0089] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A method for optimizing photogrammetric modeling accuracy based on cross-polarization, characterized in that: The method comprises: Based on the three-dimensional model of the flash on the photogrammetry equipment, design and manufacture the light source polarization component on the photogrammetry equipment; wherein the light source polarization component includes a light source polarization accessory and a polarizer; Mounting the light source polarization component on the flash and camera lens of the photogrammetric equipment respectively, so as to perform photogrammetric scanning on a subject requiring three-dimensional reconstruction based on a cross-polarization technique to obtain a measurement image of the subject; processing the measured image to obtain a processed image; In photogrammetric model generation software, generating a three-dimensional model of the subject based on the processed image; The three-dimensional model of the subject is optimized to obtain a model generated by photogrammetry of the subject.

2. The method according to claim 1, characterized in that The method of designing and manufacturing a light source polarization component on the photogrammetry equipment based on a three-dimensional model of a flash on the photogrammetry equipment includes: performing photogrammetry on the flashlight to obtain a photogrammetric image of the flashlight; Importing the photogrammetric image of the flash into a 3D software for 3D reconstruction, deleting the generated redundant areas, and exporting a plain model of the flash to obtain a 3D model of the flash; Designing a three-dimensional model of a light source polarization accessory that matches the three-dimensional model of the flashlight; A light source polarization accessory is manufactured based on the three-dimensional model of the accessory by a 3D printer; Based on the assembly space of the first assembly position on the light source polarization accessory, the polarizer is cut to obtain a polarizer adapted to the assembly space, and the cut polarizer is assembled to the light source polarization accessory through the first assembly position to obtain the light source polarization assembly.

3. The method according to claim 2, characterized in that The accessory three-dimensional model of the light source polarization accessory designed to be compatible with the three-dimensional model of the flash lamp includes: Designing a three-dimensional model of the accessory using a hollowing process; A plurality of holes are provided inside the three-dimensional model of the accessory to embed magnet blocks, and the magnet blocks are used to quickly assemble the light source polarization accessory and the flashlight.

4. The method according to claim 1, wherein The method of performing photogrammetric scanning on a subject requiring three-dimensional reconstruction based on the cross-polarization technology to obtain a measurement image of the subject includes: Adjust the flash power to full power and set the format of the measurement image to Raw; performing photogrammetric scanning on the upper and lower parts of the subject respectively based on a cross-polarization technique to obtain a measurement image of the subject; Place the color card in the same light and shadow environment as the subject, and shoot the color card based on cross polarization technology.

5. The method according to claim 4, characterized in that The photogrammetric scanning of the upper and lower parts of the subject based on the cross-polarization technology to obtain a measurement image of the subject includes: When performing photogrammetric scanning on each part, the physical distance between the photogrammetric equipment and the subject is kept constant, and photographs are taken of the subject at various heights and levels to obtain a measurement image of the subject; There is a preset overlapping area between the measurement images captured in adjacent positions; and a dark frame is captured between the photogrammetric scan of the upper half and the photogrammetric scan of the lower half to distinguish the measurement image corresponding to the upper half from the measurement image of the lower half.

6. The method according to claim 4, characterized in that The processing of the measured image to obtain a processed image includes: Importing the measured images into image processing software that matches the color card to perform batch color calibration on the measured images; Importing the color-calibrated images into image processing software, selecting one of the color-calibrated images to adjust image parameters, and applying the adjustment to other color-calibrated images to correct the color-calibrated image obtained in this shooting, thereby obtaining a corrected measurement image; The corrected measurement image corresponding to the upper half of the subject and the corrected measurement image corresponding to the lower half are saved in different folders, respectively, and exported to Jpeg format to obtain processed images.

7. The method according to claim 6, characterized in that The step of generating a three-dimensional model of the subject based on the processed image in the photogrammetry model generation software includes: Import the processed images in the folder corresponding to the upper half into the photogrammetry model generation software, automatically align the images, and obtain the point cloud data of the upper half of the subject; set the reconstruction area and erase the unnecessary areas; use the cropping function to crop the upper and lower parts of the support frame in the upper half and reconstruct the model to generate a depth mask map of the cropped area; Disable all cameras in the upper half, import the processed images from the folder corresponding to the lower half, and automatically align the images to obtain the point cloud data of the lower half of the scanned model. Set the reconstruction area to erase the unused areas. Use the cropping function to crop the upper and lower areas of the support frame in the lower half and reconstruct the model to generate a depth mask map for the cropped area. A new modeling task is created in the photogrammetry model. The folder corresponding to the upper half, the folder corresponding to the lower half, the depth mask map corresponding to the upper half, and the depth mask map corresponding to the lower half are imported into the new modeling task. The images are automatically aligned. If the assembled images are not completely aligned, control points are used to assist the photogrammetry model generation software in aligning the overlapping points of the images to obtain a three-dimensional model of the subject.

8. The method according to any one of claims 1 to 7, characterized in that: The step of optimizing the three-dimensional model of the subject to obtain a model generated by photogrammetry of the subject includes: Exporting a high-resolution model from the photogrammetry model generation software to Zbrush software to perform polishing correction on the surface of the three-dimensional model of the subject; Importing the corrected high-resolution model back into the photogrammetry model generation software; filling in the upper limit of the number of polygons in the simplification function, topologically retopologizing the high-resolution model, and generating a low-resolution model; Use the texture reprojection tool on the high-resolution model, set the resolution to 8K, and map the texture map onto the high-resolution model; Use the texture reprojection tool again, set the high-resolution model as the source model and the low-resolution model as the object model, and generate a normal map and a color map; The source model and the object model are imported into the texture drawing software, and the metalness and roughness maps are drawn according to the material characteristics of the model. The intensity is controlled by the grayscale value to obtain the model generated by the photogrammetry.

9. A device for optimizing photogrammetric modeling accuracy based on cross polarization, characterized in that: The device includes a processor and a memory; the memory stores a program, and the program is loaded and executed by the processor to implement the cross-polarization-based photogrammetry modeling accuracy optimization method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that The storage medium stores a program, which, when executed by a processor, is used to implement the cross-polarization-based photogrammetry modeling accuracy optimization method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Human body three-dimensional model generation method, equipment and device

    CN114677427A

  • Three-dimensional reconstruction method and device based on point cloud data and computer equipment

    CN114930403A

  • Historical relic scanning model with mapping topology method and system

    CN115690299A

  • Three-dimensional face data acquisition equipment and three-dimensional face high-precision reconstruction method

    CN116912901A

  • Method and device for reconstructing three-dimensional geometric and optical materials of small porcelain

    CN118411398A