Method for quickly constructing three-dimensional model by using picture based on generation of AI (Artificial Intelligence)

Abstract

The invention discloses a method for quickly constructing a three-dimensional model by using a picture based on AI generation, and the method comprises the following steps: 1, moving an image collection device to a picture collection position, then shooting an image needing modeling through a mobile device, and carrying out the scanning processing of the position of the shot image through a 3D scanner, then, pictures shot by the mobile equipment are uploaded to an image collector, the image collector stores and backs up image data and then transmits the image data to a modeling computer, and data scanned by the 3D scanner is transmitted to the modeling computer; 2, feature extraction is carried out, a system firstly analyzes picture data, extracts information such as edges and angular points of an object in the picture data, and determines the position and the structure of the object in the space; the problems that an existing modeling method only can conduct modeling processing on a building structure, large limitation exists, modeling processing can not be conducted anytime and anywhere according to needs, and consequently modeling work is inconvenient are solved.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional model construction, and in particular to a method for quickly constructing a three-dimensional model using pictures based on generating AI. Background Art

[0002] Building a 3D model refers to the process of using 3D modeling software to create a virtual model or image with length, width, and height. 3D models are widely used, including special effects and scene creation in film production, character and scene design in game design, product prototyping in industrial design, and architectural models and visualization effects in architectural design. This technology not only helps people better understand and visualize objects and scenes in the real world, but is also widely used in various fields.

[0003] For example, the announcement number is: CN117272491B (named "A rapid modeling method, device and medium based on AI drawing model"), firstly, the facade attributes of the corresponding urban building are obtained according to the building white film model, and the keyword information corresponding to each urban building is extracted according to the facade attribute analysis, and then the urban building facade drawings corresponding to each urban building are generated according to the keyword information based on the AI ​​drawing model, and finally a real-life three-dimensional urban building model is generated according to the facade attributes, the urban building facade drawings and the urban white film model. That is, the present application is equivalent to providing a method for automatically constructing an urban white film model and generating a real-life three-dimensional urban building model based on the urban white film model. Since the present application does not need to construct an urban white film model and generate a real-life three-dimensional urban building model manually, the rapid modeling method based on the AI ​​drawing model of the present application can effectively reduce the labor intensity of constructing a real-life three-dimensional urban building model and improve the construction efficiency of a real-life three-dimensional urban building model.

[0004] The above modeling method can only model the building structure, which has great limitations and cannot be modeled anytime and anywhere as needed, resulting in inconvenience in modeling work. To this end, we provide a method based on generating AI to quickly build a three-dimensional model using pictures. Summary of the invention

[0005] An object of the present invention is to solve at least the above problems and to provide at least the advantages which will be described hereinafter.

[0006] Another object of the present invention is to provide a method for quickly constructing three-dimensional models using pictures based on generating AI. The AI ​​technology is used to realize the rapid conversion from photos to three-dimensional models, which greatly shortens the modeling cycle. It not only enhances the design efficiency, but also greatly broadens the creative space, making 3D modeling more convenient and efficient.

[0007] To achieve the above purpose and some other purposes, the present invention adopts the following technical solutions:

[0008] A method for quickly building a three-dimensional model using pictures based on generative AI, comprising the following steps:

[0009] Step 1: Move the image acquisition device to the image acquisition position, then use the mobile device to capture the image to be modeled, and use the 3D scanner to scan the location where the image is captured. Then upload the image captured by the mobile device to the image acquisition device, and the image acquisition device will store and back up the image data and then transmit it to the modeling computer. The data scanned by the 3D scanner will be transmitted to the modeling computer;

[0010] Step 2: Feature extraction: The system first analyzes the image data to extract information such as the edges and corners of the objects in the image data, and determines the position and structure of the objects in space.

[0011] Step 3: Perform point cloud processing. The system processes the point cloud data obtained by the 3D scanner, removes noise and abnormal points, and optimizes data quality.

[0012] Step 4: Perform triangulation. Using the point cloud data, the system generates a mesh model of the object through a triangulation algorithm. By connecting the points in the point cloud into triangles, the surface of the object is constructed.

[0013] Step 5: Texture mapping: the system extracts texture information from the photo and maps it onto the mesh model, giving the model a realistic appearance.

[0014] Step 6: Finally, optimize and refine the generated 3D model to enhance the accuracy and aesthetics of the model.

[0015] Preferably, the image acquisition device includes a supporting frame, a supporting chassis and a computer frame are arranged at the upper end of the supporting frame, a modeling computer is arranged at the upper end of the computer frame, an image acquisition device and a mobile power supply are arranged on one side of the computer frame, a supporting column is integrally formed at the upper end of the supporting chassis, a top rotating cylinder is rotatably sleeved on the upper end of the supporting column, and a 3D scanner is integrally formed on the outer wall of the top rotating cylinder.

[0016] Preferably, a sealing baffle is provided on one side of the supporting chassis and the computer stand, and the two sealing baffles are an integral structure with the supporting stand, base plates are welded on the outer walls of both sides of the two sealing baffles, and the upper ends of the two base plates are provided with flip plates, and hinges are provided at the connecting positions of the two flip plates and the two base plates, and the flip plates are movably connected to the base plates through the hinges.

[0017] Preferably, the upper ends of the two flap plates and the two sealing baffles are both installed with top cover plates, and limiting end blocks are welded on both side outer walls of the top cover plates, and the two limiting end blocks are respectively abutted against the two flap plates.

[0018] Preferably, two connecting rods are integrally formed at the bottom of the top cover plate, and assembly sockets are provided at the plug-in connection positions of the two connecting rods and the two sealing baffles, and the assembly sockets and the sealing baffles are an integral structure.

[0019] Preferably, four roller bottom grooves are provided at the bottom of the support frame, ground rollers are movably provided inside the four roller bottom grooves, a roller coupling is linked between two ground rollers, and a generator is provided on one side of the mobile power supply.

[0020] Preferably, a driven pulley is provided on the induction shaft of the generator, a driving pulley is provided at the center position of the roller coupling, a transmission belt is provided between the driving pulley and the driven pulley, and the roller coupling is connected to the induction shaft of the generator through the transmission belt.

[0021] Preferably, an inverter is provided inside the chassis of the mobile power supply, the output end of the generator is electrically connected to the input end of the mobile power supply, the output end of the mobile power supply is electrically connected to the input end of the inverter, and the output end of the inverter is electrically connected to the input end of the image acquisition device, the 3D scanner and the modeling computer.

[0022] Preferably, the output ends of the image collector and the 3D scanner are connected to the input end of the modeling computer.

[0023] Preferably, a trailer end is welded to one end of the support frame, a traction handle is provided above the trailer end, and the traction handle is welded to the support frame.

[0024] The present invention has at least the following beneficial effects:

[0025] 1. The present invention realizes the rapid conversion from photos to three-dimensional models by adopting AI technology, which greatly shortens the modeling cycle, not only enhances the design efficiency, but also greatly broadens the creative space, making 3D modeling more convenient and efficient, and solves the problem that the existing modeling method can only model the building structure, has great limitations, and cannot perform modeling anytime and anywhere as needed, resulting in inconvenience in modeling work.

[0026] 2. The image acquisition device is set up to carry AI to quickly build a three-dimensional model, so that the staff can take pictures for three-dimensional modeling anytime and anywhere. The power of the equipment required in the three-dimensional modeling process is provided by a mobile power supply, and the mobile power supply can be recharged. During the grounding activity of the image acquisition device, the generator generates electricity to supplement the mobile power supply, so that it can be charged during the mobile process of image acquisition, saving energy consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1It is a schematic diagram of a method for quickly constructing a three-dimensional model using pictures based on generating AI provided by the present invention;

[0028] Figure 2 It is a front view of the structure of the picture acquisition device of the method for quickly constructing a three-dimensional model using pictures based on generating AI provided by the present invention;

[0029] Figure 3 It is a rear view of the structure of the picture acquisition device of the method for quickly constructing a three-dimensional model using pictures based on generating AI provided by the present invention;

[0030] Figure 4 It is a bottom view of the structure of the picture acquisition device of the method for quickly constructing a three-dimensional model using pictures based on generating AI provided by the present invention;

[0031] Figure 5 It is a schematic diagram of the internal structure of the picture acquisition device of the method for quickly constructing a three-dimensional model using pictures based on generating AI provided by the present invention;

[0032] Figure 6 It is a schematic diagram of the workflow of a generator based on the method provided by the present invention for quickly building a three-dimensional model using pictures based on generating AI. DETAILED DESCRIPTION

[0033] The present invention is described in detail below in conjunction with the accompanying drawings so that ordinary technicians in the field can implement it according to the instructions.

[0034] like Figure 1-6 As shown, a method for quickly building a three-dimensional model using pictures based on generating AI includes the following steps:

[0035] Step 1: Move the image acquisition device to the image acquisition position, then use the mobile device to capture the image to be modeled, and use the 3D scanner to scan the location where the image is captured. Then upload the image captured by the mobile device to the image acquisition device, and the image acquisition device will store and back up the image data and then transmit it to the modeling computer. The data scanned by the 3D scanner will be transmitted to the modeling computer;

[0036] Step 2: Feature extraction: The system first analyzes the image data to extract information such as the edges and corners of the objects in the image data, and determines the position and structure of the objects in space.

[0037] Step 3: Perform point cloud processing. The system processes the point cloud data obtained by the 3D scanner, removes noise and abnormal points, and optimizes data quality.

[0038] Step 4: Perform triangulation. Using the point cloud data, the system generates a mesh model of the object through a triangulation algorithm. By connecting the points in the point cloud into triangles, the surface of the object is constructed.

[0039] Step 5: Texture mapping: the system extracts texture information from the photo and maps it onto the mesh model, giving the model a realistic appearance.

[0040] Step 6: Finally, optimize and refine the generated 3D model to enhance the accuracy and aesthetics of the model.

[0041] In the above scheme, 3D point cloud can provide rich geometric shape and scale information. With the support of technologies such as the Internet of Things, digital twins, and AI, 3D point cloud has become a key technical foundation for the evolution of the digital world. The computing system of the modeling computer processes the point cloud data obtained by the 3D scanner, removes noise and outliers to optimize data quality and improve the effect of 3D modeling.

[0042] In a preferred embodiment, the image acquisition device includes a supporting frame 1, a supporting chassis 5 and a computer frame 15 are provided at the upper end of the supporting frame 1, a modeling computer 16 is provided at the upper end of the computer frame 15, an image acquisition device 21 and a mobile power supply 17 are provided on one side of the computer frame 15, a supporting column 6 is integrally formed at the upper end of the supporting chassis 5, a top rotating cylinder 7 is rotatably provided at the upper end of the supporting column 6, and a 3D scanner 8 is integrally formed on the outer wall of the top rotating cylinder 7.

[0043] In the above scheme, the support stand serves to carry the 3D scanner, modeling computer, image collector and mobile power supply, which is convenient for carrying multiple devices required for image acquisition to any location. The scanning angle of the 3D scanner can be rotatably adjusted through the sleeve-shaped active connection between the top rotating cylinder and the supporting column, which is convenient for collecting pictures from different perspectives. In addition, the 3D scanner can also be removed from the support stand for use. The mobile power supply supplies power to multiple devices, ensuring the continuity of image acquisition outdoors.

[0044] In a preferred embodiment, a sealing baffle 2 is provided on one side of the supporting chassis 5 and the computer stand 15. The two sealing baffles 2 are an integral structure with the supporting stand 1. Base plates 3 are welded on the outer walls of both sides of the two sealing baffles 2. Flip plates 4 are provided on the upper ends of the two base plates 3. Hinges 18 are provided at the connecting positions of the two flip plates 4 and the two base plates 3. The flip plates 4 are movably connected to the base plates 3 through the hinges 18.

[0045] In the above scheme, two sealing baffles and two flap plates form an enclosure structure around the support frame, thereby protecting the equipment required for image acquisition and modeling. The flap plate is movably connected to the base plate through hinges, thereby facilitating the deployment and use of the image acquisition device.

[0046] In a preferred embodiment, a top cover plate 9 is installed on the upper ends of the two flap plates 4 and the two sealing baffles 2, and limiting end blocks 10 are welded on the outer walls on both sides of the top cover plate 9, and the two limiting end blocks 10 are respectively abutted against the two flap plates 4.

[0047] In the above scheme, the top cover plate serves to seal the two sealing baffles and the two flap plate enclosure structures, further protecting the equipment required for image acquisition and modeling, and the two limit blocks serve to restrain the two flap plates and prevent the flap plates from being opened.

[0048] In a preferred embodiment, two connecting rods 12 are integrally formed at the bottom of the top cover plate 9 , and assembly sockets 11 are provided at the plug-in connection positions of the two connecting rods 12 and the two sealing baffles 2 . The assembly sockets 11 and the sealing baffles 2 are an integral structure.

[0049] In the above scheme, the top cover plate is plug-connected with the sealing baffle plate through two connecting rods, which improves the stability of the installation connection of the top cover plate. After the installation connection of the top cover plate is completed, the protection effect is improved while positioning the enclosure structure of the two sealing baffle plates and the two flap plates.

[0050] In a preferred embodiment, four roller bottom grooves 19 are provided at the bottom of the support frame 1, and grounding rollers 20 are movably provided inside the four roller bottom grooves 19. A roller coupling shaft 22 is linked between two grounding rollers 20, and a generator 23 is provided on one side of the mobile power supply 17.

[0051] In the above scheme, the roller bottom groove plays the role of supporting the grounding roller, and the four grounding rollers are linked to each other through roller couplings. The generator plays the role of generating electricity and replenishing electric energy for the mobile power supply.

[0052] In a preferred embodiment, a driven pulley 25 is provided on the induction shaft of the generator 23, a driving pulley 24 is provided at the center position of the roller coupling 22, a transmission belt 26 is provided between the driving pulley 24 and the driven pulley 25, and the roller coupling 22 is connected to the induction shaft of the generator 23 through the transmission belt 26.

[0053] In the above scheme, the driven pulley and the driving pulley are connected through a transmission belt, so that the roller coupling shaft rotates synchronously during the rotation of the grounded roller. The rotation of the roller coupling shaft drives the driving pulley to rotate, so that the driven pulley rotates synchronously, and then triggers the generator to generate electricity.

[0054] In a preferred embodiment, an inverter 27 is provided inside the chassis of the mobile power supply 17, the output end of the generator 23 is electrically connected to the input end of the mobile power supply 17, the output end of the mobile power supply 17 is electrically connected to the input end of the inverter 27, and the output end of the inverter 27 is electrically connected to the input end of the image acquisition device 21, the 3D scanner 8 and the modeling computer 16.

[0055] In the above scheme, the inverter plays the role of converting the DC power of the mobile power supply into AC power. When the mobile power supply is needed, the DC power of the mobile power supply is converted by the inverter and used, and at the same time, it powers the image acquisition device, 3D scanner and modeling computer.

[0056] In a preferred solution, the output ends of the image collector 21 and the 3D scanner 8 are connected to the input end of the modeling computer 16 in a transmission manner.

[0057] In the above scheme, the pictures taken by the mobile device are uploaded to the image collector, the image collector stores and backs up the image data and then transmits it to the modeling computer, and the data scanned by the 3D scanner is transmitted to the modeling computer.

[0058] In a preferred embodiment, a trailer end 14 is welded to one end of the support frame 1 , a traction handle 13 is disposed above the trailer end 14 , and the traction handle 13 is welded to the support frame 1 .

[0059] In the above scheme, the end of the trailer serves to facilitate the towing of the support frame, and the movement of the traction handle serves to facilitate the pulling of the support frame.

[0060] Although the embodiments of the present invention have been disclosed as above, they are not limited to the applications listed in the specification and the implementation modes, and they can be fully applied to various fields suitable for the present invention. For those familiar with the art, additional modifications can be easily implemented. Therefore, without departing from the general concept defined by the claims and the scope of equivalents, the present invention is not limited to the specific details and the illustrations shown and described herein.

Claims

1. A method for quickly constructing a three-dimensional model using pictures based on generating AI, characterized in that: The following steps are involved: Step 1: Move the image acquisition device to the image acquisition position, then use the mobile device to capture the image to be modeled, and use the 3D scanner to scan the location where the image is captured. Then upload the image captured by the mobile device to the image acquisition device, and the image acquisition device will store and back up the image data and then transmit it to the modeling computer. The data scanned by the 3D scanner will be transmitted to the modeling computer; Step 2: Feature extraction: The system first analyzes the image data to extract information such as the edges and corners of the objects in the image data, and determines the position and structure of the objects in space. Step 3: Perform point cloud processing. The system processes the point cloud data obtained by the 3D scanner, removes noise and abnormal points, and optimizes data quality. Step 4: Perform triangulation. Using the point cloud data, the system generates a mesh model of the object through a triangulation algorithm. By connecting the points in the point cloud into triangles, the surface of the object is constructed. Step 5: Texture mapping: The system extracts texture information from the photo and maps it onto the mesh model, giving the model a realistic appearance. Step 6: Finally, optimize and refine the generated 3D model to enhance the accuracy and aesthetics of the model.

2. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 1, characterized in that: The image acquisition device includes a supporting frame, a supporting chassis and a computer frame are arranged on the upper end of the supporting frame, a modeling computer is arranged on the upper end of the computer frame, an image collector and a mobile power supply are arranged on one side of the computer frame, a bearing column is integrally formed on the upper end of the supporting chassis, a top rotating cylinder is rotatably sleeved on the upper end of the bearing column, and a 3D scanner is integrally formed on the outer wall of the top rotating cylinder.

3. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 2, characterized in that: A sealing baffle is provided on one side of the supporting chassis and the computer stand, and the two sealing baffles are an integral structure with the supporting stand. Base plates are welded on the outer walls of both sides of the two sealing baffles, and flip plates are provided on the upper ends of the two base plates. Hinges are provided at the connecting positions of the two flip plates and the two base plates, and the flip plates are movably connected to the base plates through the hinges.

4. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 3, characterized in that: The upper ends of the two flap plates and the two sealing baffles are both equipped with top cover plates, and the outer walls on both sides of the top cover plates are both welded with limit end blocks, and the two limit end blocks are respectively in contact with the two flap plates.

5. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 4, characterized in that: The bottom of the top cover plate is integrally formed with two connecting rods, and assembly sockets are arranged at the plug-in connection positions of the two connecting rods and the two sealing baffles, and the assembly sockets and the sealing baffles are an integral structure.

6. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 5, characterized in that: Four roller bottom grooves are arranged at the bottom of the support frame, ground rollers are movably arranged inside the four roller bottom grooves, a roller coupling is linked between two ground rollers, and a generator is arranged on one side of the mobile power supply.

7. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 6, characterized in that: A driven pulley is arranged on the induction shaft of the generator, a driving pulley is arranged at the center position of the roller coupling, a transmission belt is arranged between the driving pulley and the driven pulley, and the roller coupling is connected to the induction shaft of the generator through the transmission belt.

8. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 7, characterized in that: An inverter is arranged inside the chassis of the mobile power supply, the output end of the generator is electrically connected to the input end of the mobile power supply, the output end of the mobile power supply is electrically connected to the input end of the inverter, and the output end of the inverter is electrically connected to the input end of the image collector, the 3D scanner and the modeling computer.

9. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 8, characterized in that: The output ends of the image collector and the 3D scanner are connected to the input end of the modeling computer.

10. The method for rapidly constructing a three-dimensional model using pictures based on generating AI as claimed in claim 9, characterized in that: A trailer end is welded to one end of the support frame, a traction handle is arranged above the trailer end, and the traction handle is welded to the support frame.

Images