A method, apparatus, and electronic device for surface treatment of white molds
By performing dimensional transformation and block division on the white model, combined with entity image capture and feature point matching, the problem of low accuracy in 3D modeling in existing technologies is solved, and efficient 3D real-scene model construction is achieved.
Patent Information
- Application Number
- CN202111498983.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-09
- Publication Date
- 2025-12-02
- Estimated Expiration
- 2041-12-09
AI Technical Summary
Existing 3D modeling methods suffer from low accuracy and high cost, especially when using images or videos for modeling, which requires high-quality images and makes it difficult to achieve efficient 3D reality model construction.
By calling the dimension converter to perform dimension transformation and block division on the white model, and combining entity image shooting and feature point matching, the modified dimension converter is used to perform pixel point mapping, realizing two dimension transformations to improve accuracy.
It improves the accuracy of 3D model processing, reduces the amount of computation, and enables efficient 3D reality model construction.
Smart Images
Figure CN114332603B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computers, and more particularly to a method, apparatus, and electronic device for processing the appearance of a white mold. Background Technology
[0002] A 3D model is a polygonal representation of an object, typically displayed using a computer or other video equipment. The displayed object can be a real-world entity or a fictional one. Anything existing in the physical world can be represented by a 3D model. A 3D model can be abstracted into four basic elements in three-dimensional space: points, lines, surfaces, and volumes. More complex objects can then be constructed using the sets of these four elements and their topological relationships.
[0003] Currently, there are generally three methods for modeling objects: the first uses 3D software; the second uses instruments and equipment for measurement; and the third uses images or videos. While the first two methods offer high accuracy, they are less efficient and more expensive. In contrast, the third method is inexpensive, provides a high degree of realism, and is highly automated, thus having broad application prospects. Currently, software (such as Smart3D) can synthesize 3D models from continuous images of a target object from all angles, but it has limitations in practical applications due to the high quality requirements of the images.
[0004] Therefore, it is necessary to improve the accuracy of the processing method.
[0005] Analysis of existing technologies reveals that, in practical applications, some 3D models already have white models. If we obtain a real-world image, we can obtain a 3D real-world model simply by applying textures. Summary of the Invention
[0006] This specification provides a method, apparatus, and electronic device for processing the appearance of a white model to improve the accuracy of the model.
[0007] This specification provides an embodiment of a method for processing the appearance of a white mold, including:
[0008] The white model to be processed is invoked, and the white model is dimensionally transformed using a dimension converter with transformation rules, and then divided into blocks;
[0009] The real object corresponding to the white model is photographed to obtain the entity image and the photographic parameters at the time of shooting.
[0010] The three-dimensional contours and feature points are identified and extracted from the entity image. Combined with the photography parameters, the three-dimensional contours and feature points are matched with blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is used to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model.
[0011] Optionally, the dimensional transformation of the white model using a dimensional converter with transformation rules includes:
[0012] Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
[0013] Optionally, the step of performing dimensional transformation on the pixels within the entity image using the modified dimensionality converter includes:
[0014] The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
[0015] Optionally, the photographic parameters include the relative orientation of the camera lens and the entity.
[0016] Optionally, it also includes:
[0017] The modified dimension converter is used to merge overlapping regions and derive missing regions.
[0018] Optionally, the partitioning of blocks includes:
[0019] The two-dimensional surface is divided into blocks based on the contour boundary dimensions of the white model.
[0020] Optionally, it also includes:
[0021] The extracted contour feature points are compared and corrected on the blocks.
[0022] This specification also provides an apparatus for surface treatment of white molds, including:
[0023] The block partitioning module calls the white model to be processed, uses a dimension converter with conversion rules to perform dimension conversion on the white model, and divides it into blocks;
[0024] The physical imaging module captures images of the real objects corresponding to the white model, obtaining physical images and photographic parameters at the time of shooting.
[0025] The matching and mapping module identifies and extracts three-dimensional contours and feature points from the entity image. Combined with the photography parameters, the three-dimensional contours and feature points are matched and corresponded with blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is used to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model.
[0026] Optionally, the dimensional transformation of the white model using a dimensional converter with transformation rules includes:
[0027] Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
[0028] Optionally, the step of performing dimensional transformation on the pixels within the entity image using the modified dimensionality converter includes:
[0029] The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
[0030] Optionally, the photographic parameters include the relative orientation of the camera lens and the entity.
[0031] Optionally, it also includes:
[0032] The modified dimension converter is used to merge overlapping regions and derive missing regions.
[0033] Optionally, the partitioning of blocks includes:
[0034] The two-dimensional surface is divided into blocks based on the contour boundary dimensions of the white model.
[0035] Optionally, it also includes:
[0036] The extracted contour feature points are compared and corrected on the blocks.
[0037] This specification also provides an electronic device, wherein the electronic device includes:
[0038] Processor; and,
[0039] A memory that stores computer-executable instructions, which, when executed, cause the processor to perform any of the methods described above.
[0040] This specification also provides a computer-readable storage medium that stores one or more programs that, when executed by a processor, implement any of the methods described above.
[0041] The various technical solutions provided in the embodiments of this specification call the white model to be processed, use a dimension converter with conversion rules to perform dimensional transformation on the white model, divide the white model into blocks, photograph the real object corresponding to the white model, obtain the entity image and the photographic parameters at the time of shooting, identify and extract the three-dimensional contour and feature points from the entity image, match the three-dimensional contour and feature points with the blocks in combination with the photographic parameters, correct the dimension converter based on the correspondence, and use the corrected dimension converter to perform dimensional transformation on the pixels inside the entity image, mapping them onto the surface of the white model corresponding to each block of the white model. Using the existing white model for processing is computationally inefficient and efficient. By performing two dimensional transformations sequentially, with the dimension converter corrected based on the correspondence in between, the processing accuracy is improved. Attached Figure Description
[0042] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:
[0043] Figure 1 This is a schematic diagram illustrating the principle of a method for processing the appearance of a white mold, as provided in the embodiments of this specification.
[0044] Figure 2 This is a schematic diagram of the structure of an appearance processing device for white mold provided in the embodiments of this specification;
[0045] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification;
[0046] Figure 4 This is a schematic diagram of a computer-readable medium provided for embodiments of this specification. Detailed Implementation
[0047] Exemplary embodiments of the invention will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limiting the invention to the embodiments set forth herein. Rather, these exemplary embodiments are provided to make the invention more comprehensive and complete, and to facilitate a full communication of the inventive concept to those skilled in the art. The same reference numerals in the drawings denote the same or similar elements, components, or parts, and therefore repeated descriptions of them will be omitted.
[0048] Subject to the technical concept of this invention, the features, structures, characteristics or other details described in a particular embodiment may be combined in one or more other embodiments in a suitable manner.
[0049] In the description of specific embodiments, the features, structures, characteristics, or other details described in this invention are intended to enable those skilled in the art to fully understand the embodiments. However, it is not excluded that those skilled in the art can practice the technical solutions of this invention without one or more of the specific features, structures, characteristics, or other details.
[0050] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.
[0051] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.
[0052] The terms “and / or” or “and / or” include all combinations of any one or more of the listed items.
[0053] Figure 1 This is a schematic diagram illustrating the principle of a method for processing the appearance of a white mold, as provided in an embodiment of this specification. The method may include:
[0054] S101: Call the white model to be processed, use a dimension converter with conversion rules to perform dimension conversion on the white model, and divide it into blocks.
[0055] Among them, the white model refers to a three-dimensional structural model constructed using modeling software, which does not have appearance elements.
[0056] Specifically, the dimension converter of the transformation rule can be a matrix transformation instruction, accompanied by a transformation matrix, used to perform dimension transformation on pixels.
[0057] In the embodiments of this specification, the dimensional transformation of the white model using a dimensional converter with transformation rules includes:
[0058] Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
[0059] In the embodiments of this specification, the division of blocks includes:
[0060] The two-dimensional surface is divided into blocks based on the contour boundary dimensions of the white model.
[0061] S102: Take a picture of the real object corresponding to the white model to obtain the entity image and the photography parameters at the time of shooting.
[0062] In the embodiments described in this specification, the photographic parameters include the relative orientation of the camera lens and the entity.
[0063] S103: Identify and extract three-dimensional contours and feature points from the entity image, match the three-dimensional contours and feature points with the blocks in combination with the photography parameters, correct the dimension converter based on the correspondence, and use the corrected dimension converter to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model.
[0064] By calling the white model to be processed, a dimension converter with conversion rules is used to perform dimensional transformation on the white model and divide it into blocks. The corresponding real object is photographed to obtain the entity image and the photographic parameters at the time of shooting. Three-dimensional contours and feature points are identified and extracted from the entity image. Combined with the photographic parameters, the 3D contours and feature points are matched with the blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is then used to perform dimensional transformation on the pixels within the entity image, mapping them onto the surfaces of the white model corresponding to each block. Using the existing white model for processing results in low computational load and high efficiency. By performing two dimensional transformations sequentially, with intermediate correction of the dimension converter based on the correspondence, the processing accuracy is improved.
[0065] In the embodiments of this specification, the dimensional transformation of pixels within an entity image using a modified dimensionality converter includes:
[0066] The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
[0067] The embodiments in this specification also include:
[0068] The modified dimension converter is used to merge overlapping regions and derive missing regions.
[0069] The embodiments in this specification also include:
[0070] The extracted contour feature points are compared and corrected on the blocks.
[0071] Figure 2 This is a schematic diagram of a device for processing the appearance of a white mold, provided in an embodiment of this specification. The device may include:
[0072] The block partitioning module 201 calls the white model to be processed, uses a dimension converter with conversion rules to perform dimension conversion on the white model, and partitions it into blocks;
[0073] The physical shooting module 202 takes pictures of the real object corresponding to the white model to obtain physical images and shooting parameters.
[0074] The matching and mapping module 203 identifies and extracts three-dimensional contours and feature points from the entity image. Combined with the photography parameters, the three-dimensional contours and feature points are matched and corresponded with the blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is used to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model. Texture mapping is then performed to obtain a three-dimensional model with a realistic appearance.
[0075] In the embodiments of this specification, the dimensional transformation of the white model using a dimensional converter with transformation rules includes:
[0076] Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
[0077] In the embodiments of this specification, the dimensional transformation of pixels within an entity image using a modified dimensionality converter includes:
[0078] The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
[0079] In the embodiments described in this specification, the photographic parameters include the relative orientation of the camera lens and the entity.
[0080] The embodiments in this specification also include:
[0081] The modified dimension converter is used to merge overlapping regions and derive missing regions.
[0082] In the embodiments of this specification, the division of blocks includes:
[0083] The two-dimensional surface is divided into blocks based on the contour boundary dimensions of the white model.
[0084] The embodiments in this specification also include:
[0085] The extracted contour feature points are compared and corrected on the blocks.
[0086] This device calls upon the white model to be processed, uses a dimension converter with conversion rules to perform dimensional transformation on the white model, divides the white model into blocks, and photographs the real objects corresponding to the white model to obtain entity images and photographic parameters at the time of shooting. It identifies and extracts 3D contours and feature points from the entity images, matches the 3D contours and feature points with the blocks based on the photographic parameters, corrects the dimension converter based on the correspondence, and uses the corrected dimension converter to perform dimensional transformation on the pixels within the entity images, mapping them onto the surfaces of the white model corresponding to each block. Using existing white models for processing results in low computational load and high efficiency. By performing two dimensional transformations sequentially, with intermediate correction of the dimension converter based on the correspondence, the processing accuracy is improved.
[0087] Based on the same inventive concept, embodiments of this specification also provide an electronic device.
[0088] The following describes embodiments of the electronic device of the present invention, which can be considered as specific implementations of the methods and apparatus embodiments of the present invention described above. Details described in the embodiments of the electronic device of the present invention should be considered as supplements to the methods or apparatus embodiments described above; details not disclosed in the embodiments of the electronic device of the present invention can be implemented with reference to the methods or apparatus embodiments described above.
[0089] Figure 3 This is a schematic diagram of an electronic device provided as an embodiment of this specification. Refer to the following... Figure 3 The electronic device 300 according to this embodiment of the present invention will be described. Figure 3 The electronic device 300 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.
[0090] like Figure 3 As shown, the electronic device 300 is presented in the form of a general-purpose computing device. The components of the electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, a bus 330 connecting different system components (including storage unit 320 and processing unit 310), a display unit 340, etc.
[0091] The storage unit stores program code that can be executed by the processing unit 310, causing the processing unit 310 to perform the steps described in the processing method section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 310 can perform, for example... Figure 1 The steps are shown.
[0092] The storage unit 320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 3201 and / or a cache storage unit 3202, and may further include a read-only memory unit (ROM) 3203.
[0093] The storage unit 320 may also include a program / utility 3204 having a set (at least one) program module 3205, such program module 3205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.
[0094] Bus 330 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.
[0095] Electronic device 300 can also communicate with one or more external devices 400 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with the electronic device 300, and / or with any device that enables the electronic device 300 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 350. Furthermore, electronic device 300 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 360. Network adapter 360 can communicate with other modules of electronic device 300 via bus 330. It should be understood that, although... Figure 3 As not shown, other hardware and / or software modules may be used in conjunction with electronic device 300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0096] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described in this invention can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, or network device, etc.) to execute the above-described method according to this invention. When the computer program is executed by a data processing device, it enables the computer-readable medium to implement the above-described method of this invention, i.e.: as... Figure 1 The method shown.
[0097] Figure 4 This is a schematic diagram of a computer-readable medium provided for embodiments of this specification.
[0098] accomplish Figure 1 The computer program of the method shown can be stored on one or more computer-readable media. A computer-readable medium can be a readable signal medium or a readable storage medium. A readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.
[0099] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.
[0100] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0101] In summary, this invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that in practice, general-purpose data processing devices such as microprocessors or digital signal processors (DSPs) can be used to implement some or all of the functions of some or all of the components according to the embodiments of the invention. The invention can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such programs implementing the invention can be stored on a computer-readable medium or can take the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
[0102] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the present invention is not inherently related to any specific computer, virtual device, or electronic device, and various general-purpose devices can also implement the present invention. The above descriptions are merely specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
[0103] The various embodiments in this specification are described in a progressive manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.
[0104] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.
Claims
1. A method for processing the appearance of a white mold, characterized in that, include: The white model to be processed is invoked, and a dimension converter with transformation rules is used to perform dimension transformation on the white model and divide it into blocks; the white model does not have appearance elements; the dimension converter is a matrix transformation instruction, which is accompanied by a transformation matrix and is used to perform dimension transformation on pixels; The real object corresponding to the white model is photographed to obtain the entity image and the photographic parameters at the time of shooting. The three-dimensional contours and feature points are identified and extracted from the entity image. Combined with the photography parameters, the three-dimensional contours and feature points are matched with blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is used to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model.
2. The method according to claim 1, characterized in that, The step of performing dimensional transformation on the white model using a dimensional converter with transformation rules includes: Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
3. The method according to claim 1, characterized in that, The step of performing dimensional transformation on the pixels within the entity image using the modified dimensionality converter includes: The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
4. The method according to claim 1, characterized in that, The photographic parameters include the relative orientation of the camera lens and the entity.
5. The method according to claim 1, characterized in that, Also includes: The modified dimension converter is used to merge overlapping regions and derive missing regions.
6. The method according to claim 1, characterized in that, The partitioning of the blocks includes: partitioning the two-dimensional surfaces based on the contour boundary dimensions of the white model.
7. The method according to claim 1, characterized in that, Also includes: The extracted contour feature points are compared and corrected on the blocks.
8. An apparatus for processing the appearance of a white mold, characterized in that, include: The block division module calls the white model to be processed, uses a dimension converter with transformation rules to perform dimension transformation on the white model, and divides it into blocks; the white model does not have appearance elements; the dimension converter is a matrix transformation instruction, which is accompanied by a transformation matrix and is used to perform dimension transformation on pixels; The physical imaging module captures images of the real objects corresponding to the white model, obtaining physical images and photographic parameters at the time of shooting. The matching and mapping module identifies and extracts three-dimensional contours and feature points from the entity image. Combined with the photography parameters, the three-dimensional contours and feature points are matched and corresponded with blocks. Based on the correspondence, the dimension converter is corrected. The corrected dimension converter is used to perform dimension conversion on the pixels inside the entity image and map them onto the surface of the white model corresponding to each block of the white model.
9. The apparatus according to claim 8, characterized in that, The step of performing dimensional transformation on the white model using a dimensional converter with transformation rules includes: Convert objects in a white model in three-dimensional coordinates into objects in two-dimensional coordinates.
10. The apparatus according to claim 8, characterized in that, The step of performing dimensional transformation on the pixels within the entity image using the modified dimensionality converter includes: The pixels inside the entity image in two-dimensional coordinates are converted into pixels in three-dimensional coordinates.
11. The apparatus according to claim 8, characterized in that, The photographic parameters include the relative orientation of the camera lens and the entity.
12. The apparatus according to claim 8, characterized in that, Also includes: The modified dimension converter is used to merge overlapping regions and derive missing regions.
13. The apparatus according to claim 8, characterized in that, The partitioning of the blocks includes: partitioning the two-dimensional surfaces based on the contour boundary dimensions of the white model.
14. The apparatus according to claim 8, characterized in that, Also includes: The extracted contour feature points are compared and corrected on the blocks.
15. An electronic device, wherein, The electronic device includes: Processor; and, A memory storing computer-executable instructions, which, when executed, cause the processor to perform the method according to any one of claims 1-7.
16. A computer-readable storage medium, wherein, The computer-readable storage medium stores one or more programs that, when executed by a processor, implement the method of any one of claims 1-7.