Building industry intelligent dialogue platform
By integrating deep learning processors and drone technology on the intelligent dialogue platform, efficient repair and three-dimensional modeling of damaged buildings is achieved, and the problems of single functions and low accuracy of existing platforms are solved, improving the efficiency of building repair and rescue and precision.
Patent Information
- Application Number
- CN202410986438.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-15
AI Technical Summary
The existing intelligent dialogue platform has single functions in handling the restoration and three-dimensional modeling of damaged buildings, poor practicality, and low image acquisition and repair accuracy, making it difficult to apply to rescue work.
An intelligent dialogue platform for the construction industry was designed, including human-computer interaction module, image acquisition module, data analysis module, three-dimensional modeling module and control management module, and the repair scheme analysis of damaged buildings was analyzed using deep learning processors and drones. Three-dimensional modeling, the parallel computing of multiple three-dimensional modeling units is realized through cloud servers, and supports users to adjust models and store and manage data.
It improves the convenience and accuracy of repairing damaged buildings, shortens the three-dimensional modeling time, and enhances rescue support for collapsed buildings in natural disasters.
Smart Images

Figure CN118965870A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intelligent dialogue platforms, and in particular to an intelligent dialogue platform for the construction industry. Background Art
[0002] The intelligent human-computer dialogue platform is an interactive system implemented using natural language processing and artificial intelligence technologies, designed to simulate human dialogue so that users can interact with computers through natural language.
[0003] Existing intelligent human-computer dialogue platforms, such as the intention recognition method, device, intelligent dialogue platform and storage medium disclosed in the invention patent with application number 202011626280.9 and the human-computer dialogue platform with hardware disclosed in the invention patent with application number 201610361085.5, can all realize human-computer dialogue and mutual communication.
[0004] However, it was found during use that the existing intelligent dialogue platform has relatively simple functions. It is not convenient to repair and perform three-dimensional modeling of buildings based on the photos of ruined buildings and texts uploaded by users. It is also not convenient to restore the collapse process of the building, resulting in poor practicality. A method for repairing cultural relics and ancient buildings based on BIM model technology disclosed in the invention patent with publication number CN114961322A and an information platform for digital protection and restoration of traditional buildings based on BIM disclosed in the invention patent with publication number CN108460833A can realize building restoration, but the accuracy of image acquisition and restoration is reduced, and it is more difficult to apply to rescue work. Therefore, there is an urgent need for an intelligent dialogue platform for the construction industry to improve the above problems. Summary of the invention
[0005] In order to solve the above technical problems, the present invention provides a kind of damaged building repair according to the damaged building pictures taken and the text data uploaded by the user, and draws a three-dimensional model. At the same time, the platform displays the reasons and concepts of the repair in text form. After that, the user adjusts the unsatisfactory positions on the three-dimensional model of the platform by uploading pictures and text, so as to facilitate people to repair the damaged ancient buildings, better protect the ancient buildings, or repair the buildings collapsed in natural disasters, so that the rescue personnel can understand the building structure as soon as possible and implement the rescue. Intelligent dialogue platform for the construction industry.
[0006] The intelligent dialogue platform for the construction industry of the present invention comprises: Human-computer interaction module: displays the captured images and transmits them to the data analysis module. The user inputs text data through the human-computer interaction module and displays or plays the analysis results. Image acquisition module: according to the user's command or direct manual operation of the user, the image of the specified position is captured, and the captured image is processed to be clear, and then the processed image is transmitted to the human-computer interaction module; Data analysis module: receiving the image data transmitted on the human-computer interaction module and the text data input by the user, and analyzing and predicting the image data transmitted on the human-computer interaction module and the text data input by the user, and formulating a repair plan for the damaged position of the building; 3D modeling module: draws a 3D model based on the analysis results of the data analysis module; Data storage module: stores the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Cloud server: provides computing resources for the 3D modeling module; Control management module: verify the identity information of the logged-in user, and centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module; The damaged buildings are repaired based on the pictures of the damaged buildings and the text data uploaded by the users, and a three-dimensional model is drawn. At the same time, the platform displays the reasons and concepts for the repair in text form. After that, the users can adjust the unsatisfactory positions on the three-dimensional model of the platform by uploading pictures and text, so that people can repair the damaged ancient buildings, better protect the ancient buildings, or repair the buildings collapsed in natural disasters, so that rescue workers can understand the building structure as soon as possible and carry out rescue.
[0007] Preferably, the human-computer interaction module includes: Display unit: displays the pictures uploaded by the image acquisition module, the text data uploaded by the user, the analysis results of the data analysis module and the control interface of the control management module; Text input unit: assists users to upload text data; Sound playback unit: plays the sound in the video.
[0008] Preferably, the data analysis module includes: Data processing module: process the clarity of the image; First deep learning processor: Based on the trained model, the damaged building pictures and text data uploaded by users are analyzed and predicted to determine the type of damage of the damaged building. At the same time, the model extracts key information from the text data, conducts a preliminary analysis of the cause of damage based on historical background and usage conditions, integrates the results of image analysis and text data analysis, comprehensively considers the characteristics of the damaged parts, the cause of damage and the repair requirements, and makes a repair plan for the damaged building; The second deep learning processor: Based on the trained model, it analyzes and predicts the photos of damaged buildings, the scattered building materials around the damaged buildings, and the text data uploaded by users, determines the type and damage of the buildings in the photos, and classifies the scattered building materials. The user then manually verifies the results of automatic recognition to ensure accuracy. At the same time, the model extracts key information from the text data, and then uses finite element analysis software to simulate the collapse process and make a video of the building collapse process to provide rescue reference for rescue workers. Database: stores the training data of the models of the first deep learning processor and the second deep learning processor.
[0009] Preferably, the three-dimensional modeling module includes: Data transmission unit: transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit, and then transmitting the drawn model to the model assembly unit; 3D modeling unit: Through the computing resources provided by the cloud server, multiple 3D modeling units can simultaneously model different locations of the building; Model assembly unit: Assemble the models at different locations of the building to form a complete building model.
[0010] Preferably, the data storage module includes: Data classification unit: classifies the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Data storage unit: The classified data is stored separately and for a limited period of time through multiple data storage units; Data management unit: Delete data that exceeds the storage period and restore the accidentally deleted data within the set recovery period.
[0011] Preferably, the control management module includes: Identity verification unit: Verify the identity information of logged-in users to ensure the security of user information; Control management unit: centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module.
[0012] Preferably, the image acquisition module includes multiple groups of shooting drones and a battery replacement mechanism, and the battery replacement mechanism performs battery replacement for the multiple groups of shooting drones; the multiple groups of drones are controlled by the platform according to the user's command to make the multiple groups of drones shoot designated locations, or the multiple groups of drones are manually controlled by the user to shoot designated locations, and when the battery of the drone is too low, the battery of the drone is replaced by the battery replacement mechanism to allow the drone to continue shooting, thereby improving the practicality of the image acquisition module.
[0013] Preferably, the battery exchange mechanism includes a storage box, multiple groups of screw rods, multiple groups of bases, a first electric cylinder, a push plate, a second electric cylinder, a driving motor, a lifting platform, a battery box, a limiting ring and a supporting seat, the storage box is provided with a chamber inside, the top of the storage box is provided with an opening, the left end of the storage box is provided with a discharge outlet, the rear end of the chamber in the storage box is provided with a rubber strip, the top of the storage box is provided with a sensor, the rear end of the battery is provided with a guide groove, the multiple groups of screw rods are all threadedly installed on the storage box, the multiple groups of bases are respectively installed on the bottom ends of the multiple groups of screw rods, the first electric cylinder is installed on the side end of the storage box, and one end of the first electric cylinder extends to the storage box Inside the storage box, the push plate is installed on one end of the first electric cylinder, the second electric cylinder is installed on the bottom of the storage box, and the second electric cylinder is located below the opening of the storage box, the drive motor is installed on the top of the second electric cylinder, the lifting platform is installed on the output shaft of the drive motor, and the lifting platform is located inside the storage box, a plurality of groups of electric protrusions are arranged on the top of the lifting platform, the battery box is installed on the drone, the limit ring is installed on the bottom end of the battery box, and the top of the battery box is provided with a power terminal, the inner wall of the limit ring is provided with a first thread, the support seat is rotatably installed on the bottom end of the battery, and the bottom end of the support seat is provided with a plurality of groups of reserved holes, the support seat The outer surface of the storage box is provided with a second thread; the horizontality of the storage box is adjusted by rotating multiple sets of screw rods, and multiple sets of batteries are placed inside the storage box through the opening of the storage box, and the reserved grooves of the batteries are stuck in the rubber strips. When the batteries in the drone are replaced later, the drone stops at the top of the storage box by detecting the position of the sensor at the top of the storage box, and aligns the bottom end of the limit ring with the opening of the storage box. The second electric cylinder is then extended to insert the electric protrusion on the lifting platform into the reserved hole of the support seat at the bottom of the drone. The motor is then driven to run in reverse to take out the batteries in the drone, and then the second electric cylinder is retracted. After reset, the electric protrusion on the lifting platform contracts to form a plane on the top of the lifting platform. The first electric cylinder extends to push the push plate to the left to push the multiple battery groups in the storage box, and the batteries just replaced on the lifting platform are discharged from the discharge port of the storage box through the multiple battery groups in the storage box. Then, a group of batteries is pushed to the top of the lifting platform, and then the electric protrusion on the lifting platform is extended to insert it into the reserved hole of the battery on the top of the lifting platform. Then, the second electric cylinder extends to push a group of batteries into the drone, and then the driving motor rotates forward to make the support seat and the limit ring threadedly connected to complete the battery replacement, thereby improving the practicality of the equipment.
[0014] Preferably, the data processing modules are in multiple groups and are located in multiple groups of drones respectively.
[0015] Preferably, an interactive method of a construction industry intelligent dialogue platform comprises the following steps: S1. The platform controls multiple groups of drones according to the user's command to make the multiple groups of drones take pictures of the designated location, or the user manually controls multiple groups of drones to take pictures of the designated location, and the data processing module processes the clarity of the picture; S2, displaying the photographed pictures through the human-computer interaction module, and transmitting the photographed pictures to the data analysis module, and the user inputs the location, type and characteristic data of the damaged building in text form through the human-computer interaction module; S3. Analyze and predict the damaged building pictures and text data uploaded by users according to the trained model through the first deep learning processor, and make a repair plan for the damaged building; or analyze and predict the damaged building pictures, building materials scattered around the damaged building, and text data uploaded by users according to the trained model through the second deep learning processor, and make a video of the building collapse process to provide rescue reference for rescue personnel; S4, transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit through the data transmission unit, and then transmitting the drawn model to the model assembly unit, and then using the computing resources provided by the cloud server to enable multiple three-dimensional modeling units to simultaneously model different positions of the building, and then transmitting the drawn model to the model assembly unit through the data transmission unit, and assembling the modeling of different positions of the building through the model assembly unit to form a complete building model; S5. Classify the acquired image data, text data uploaded by the user, analysis results and drawn three-dimensional models through the data classification unit, store the classified data separately for a limited period through multiple data storage units, delete the data that exceeds the storage period through the data management unit, and restore the accidentally deleted data within the set restoration period; S6. When the battery level of the drone is lower than the set value, the drone returns, stops at the top of the storage box by detecting the position of the sensor at the top of the storage box, and aligns the bottom end of the limit ring with the opening of the storage box. Then, the second electric cylinder is extended to insert the electric protrusion on the lifting platform into the reserved hole of the support seat at the bottom of the drone. Then, the drive motor runs in the reverse direction to take out the battery in the drone. Then, the second electric cylinder is retracted and reset, and the electric protrusion on the lifting platform is retracted to form a plane at the top of the lifting platform. The first electric cylinder is extended to push the push plate to the left to push the multiple groups of batteries in the storage box, and the batteries that have just been replaced on the lifting platform are discharged from the discharge port of the storage box through the multiple groups of batteries in the storage box. Then, a group of batteries is pushed to the top of the lifting platform, and then the electric protrusion on the lifting platform is extended to insert it into the reserved hole of the battery on the top of the lifting platform. Then, the second electric cylinder is extended to push a group of batteries into the drone. Then, the drive motor rotates forward to make the support seat and the limit ring threadedly connected, and the battery replacement is completed, so that the drone can continue to shoot.
[0016] Compared with the prior art, the present invention has the following beneficial effects: 1. Use drones to take images of damaged buildings, and make repair plans for damaged buildings based on text data uploaded by users, and draw a 3D model of the damaged building after repair, so that users can refer to the drawn 3D model to carry out building repair work; 2. Use drones to take images of damaged buildings, and based on the text data uploaded by users, restore the collapse process of the collapsed buildings and make videos, so that rescuers can refer to the videos and judge the structure of the collapsed buildings to carry out rescue operations; 3. Through the cloud server, multiple 3D modeling units can perform modeling work at the same time, and then assemble the models drawn by multiple 3D modeling units, which can shorten the modeling time and improve the modeling efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 It is a schematic diagram of the structure of the intelligent dialogue platform for the construction industry of the present invention; Figure 2 It is a structural schematic diagram of the human-computer interaction module of the present invention; Figure 3 It is a structural schematic diagram of the data analysis module of the present invention; Figure 4 It is a structural schematic diagram of the three-dimensional modeling module of the present invention; Figure 5 It is a structural schematic diagram of a data storage module of the present invention; Figure 6 It is a structural diagram of the control management module of the present invention; Figure 7 It is a schematic diagram of the axonometric structure of the power exchange mechanism of the present invention; Figure 8It is a front cross-sectional structural schematic diagram of the power exchange mechanism of the present invention; Fig. 9 It is a schematic diagram of the isometric structure of the battery box and the limiting ring of the present invention; Fig.10 It is a first isometric structural schematic diagram of the support base and the battery of the present invention; Fig.11 It is a second isometric structural schematic diagram of the support base and the battery of the present invention.
[0018] Markings in the attached drawings: 1. storage box; 2. screw; 3. base; 4. rubber strip; 5. first electric cylinder; 6. push plate; 7. second electric cylinder; 8. drive motor; 9. lifting platform; 10. battery box; 11. limit ring; 12. support base; 13. battery. DETAILED DESCRIPTION
[0019] In order to facilitate understanding of the present invention, the present invention will be described more fully below with reference to the relevant drawings. The present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thorough and comprehensive.
[0020] Example
[0021] according to Figures 1 to 11 As shown in the figure, the intelligent dialogue platform for the construction industry includes: Human-computer interaction module: displays the captured images and transmits them to the data analysis module. The user inputs text data through the human-computer interaction module and displays or plays the analysis results. Image acquisition module: according to the user's command or direct manual operation of the user, the image of the specified position is captured, and the captured image is processed to be clear, and then the processed image is transmitted to the human-computer interaction module; Data analysis module: receiving the image data transmitted on the human-computer interaction module and the text data input by the user, and analyzing and predicting the image data transmitted on the human-computer interaction module and the text data input by the user, and formulating a repair plan for the damaged position of the building; 3D modeling module: draws a 3D model based on the analysis results of the data analysis module; Data storage module: stores the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Cloud server: provides computing resources for the 3D modeling module; Control management module: verify the identity information of the logged-in user, and centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module; The human-computer interaction module comprises: Display unit: displays the pictures uploaded by the image acquisition module, the text data uploaded by the user, the analysis results of the data analysis module and the control interface of the control management module; Text input unit: assists users to upload text data; Sound playback unit: plays the sound in the video; The data analysis module includes: Data processing module: process the clarity of the image; First deep learning processor: According to the trained model, the damaged building pictures and text data uploaded by the user are analyzed and predicted to determine the type of damage (such as cracks, peeling, corrosion, etc.) of the damaged building. At the same time, the model extracts key information from the text data (such as the age, material, and purpose of the damaged building), and conducts a preliminary analysis of the cause of damage in combination with the historical background and usage status. The results of the image analysis and text data analysis are integrated, and the characteristics of the damaged parts, the cause of damage, and the repair requirements are comprehensively considered to make a repair plan for the damaged building. The model can refer to the ancient building repair method and related devices based on computer vision and deep learning disclosed in the invention patent with publication number CN115830238A; The second deep learning processor: according to the trained model, the damaged building pictures, the scattered building materials around the damaged building and the text data uploaded by the user are analyzed and predicted to determine the type and damage of the building in the picture, and classify the scattered building materials. After that, the user manually verifies the results of automatic recognition to ensure accuracy. At the same time, the model extracts key information from the text data (such as damaged buildings, collapse history, environmental factors, etc.), and then uses finite element analysis software to simulate the collapse process and make a video of the building collapse process to provide rescue reference for rescue personnel. The model can refer to the ancient building restoration method and related devices based on computer vision and deep learning disclosed in the invention patent with publication number CN115830238A; Database: storing training data of the models of the first deep learning processor and the second deep learning processor; The three-dimensional modeling module includes: Data transmission unit: transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit, and then transmitting the drawn model to the model assembly unit; 3D modeling unit: Through the computing resources provided by the cloud server, multiple 3D modeling units can simultaneously model different locations of the building; Model assembly unit: assemble the models at different locations of the building to form a complete building model; The data storage module comprises: Data classification unit: classifies the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Data storage unit: The classified data is stored separately and for a limited period of time through multiple data storage units; Data management unit: deletes data that exceeds the storage period and restores accidentally deleted data within the set recovery period; The control management module includes: Identity verification unit: Verify the identity information of logged-in users to ensure the security of user information; Control management unit: centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module; The image acquisition module includes multiple groups of shooting drones and a battery replacement mechanism, and the battery replacement mechanism performs battery replacement for the multiple groups of shooting drones; The battery exchange mechanism includes a storage box 1, multiple groups of screw rods 2, multiple groups of bases 3, a first electric cylinder 5, a push plate 6, a second electric cylinder 7, a drive motor 8, a lifting platform 9, a battery box 10, a limit ring 11 and a support seat 12. The storage box 1 is provided with a chamber inside, the top of the storage box 1 is provided with an opening, the left end of the storage box 1 is provided with a discharge port, the rear end of the inner chamber of the storage box 1 is provided with a rubber strip 4, the top of the storage box 1 is provided with a sensor, the rear end of the battery 13 is provided with a guide groove, the multiple groups of screw rods 2 are all threadedly installed on the storage box 1, the multiple groups of bases 3 are respectively installed at the bottom ends of the multiple groups of screw rods 2, the first electric cylinder 5 is installed at the side end of the storage box 1, and one end of the first electric cylinder 5 extends to the interior of the storage box 1, the push plate 6 It is installed on one end of the first electric cylinder 5, the second electric cylinder 7 is installed on the bottom of the storage box 1, and the second electric cylinder 7 is located below the opening of the storage box 1, the driving motor 8 is installed on the top of the second electric cylinder 7, the lifting platform 9 is installed on the output shaft of the driving motor 8, and the lifting platform 9 is located inside the storage box 1, and a plurality of groups of electric protrusions are arranged on the top of the lifting platform 9, the battery box 10 is installed on the drone, the limiting ring 11 is installed on the bottom end of the battery box 10, and the top of the battery box 10 is provided with an electric terminal, the inner wall of the limiting ring 11 is provided with a first thread, the support seat 12 is rotatably installed on the bottom end of the battery 13, and the bottom end of the support seat 12 is provided with a plurality of groups of reserved holes, and the outer surface of the support seat 12 is provided with a second thread; The data processing modules are in multiple groups and are respectively located in multiple groups of drones.
[0022] An interactive method for a construction industry intelligent dialogue platform comprises the following steps: S1. The platform controls multiple groups of drones according to the user's command to make the multiple groups of drones take pictures of the designated location, or the user manually controls multiple groups of drones to take pictures of the designated location, and the data processing module processes the clarity of the picture; S2, displaying the photographed pictures through the human-computer interaction module, and transmitting the photographed pictures to the data analysis module, and the user inputs the location, type and characteristic data of the damaged building in text form through the human-computer interaction module; S3. Analyze and predict the damaged building pictures and text data uploaded by users according to the trained model through the first deep learning processor, and make a repair plan for the damaged building; or analyze and predict the damaged building pictures, building materials scattered around the damaged building, and text data uploaded by users according to the trained model through the second deep learning processor, and make a video of the building collapse process to provide rescue reference for rescue personnel; S4, transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit through the data transmission unit, and then transmitting the drawn model to the model assembly unit, and then using the computing resources provided by the cloud server to enable multiple three-dimensional modeling units to simultaneously model different positions of the building, and then transmitting the drawn model to the model assembly unit through the data transmission unit, and assembling the modeling of different positions of the building through the model assembly unit to form a complete building model; S5. Classify the acquired image data, text data uploaded by the user, analysis results and drawn three-dimensional models through the data classification unit, store the classified data separately for a limited period through multiple data storage units, delete the data that exceeds the storage period through the data management unit, and restore the accidentally deleted data within the set restoration period; S6. When the power of the drone is lower than the set value, the drone returns to the home position, stops at the top of the storage box 1 by detecting the position of the sensor at the top of the storage box 1, and aligns the bottom end of the limit ring 11 with the opening of the storage box 1. Then, the second electric cylinder 7 is extended to insert the electric protrusion on the lifting platform 9 into the reserved hole of the bottom support seat 12 of the drone. Then, the driving motor 8 runs in the reverse direction to take out the battery 13 in the drone. Then, the second electric cylinder 7 is retracted and reset, and the electric protrusion on the lifting platform 9 is retracted to form a plane at the top of the lifting platform 9. Then, the first electric cylinder 5 is extended to make the push plate 6 The multiple groups of batteries 13 in the storage box 1 are pushed to the left, and the batteries 13 just replaced on the lifting platform 9 are discharged from the discharge port of the storage box 1 through the multiple groups of batteries 13 in the storage box 1. Then, a group of batteries 13 is pushed to the top of the lifting platform 9, and then extended through the electric protrusion on the lifting platform 9 to insert into the reserved hole of the battery 13 on the top of the lifting platform 9. Then, the second electric cylinder 7 is extended to push a group of batteries 13 into the interior of the drone, and then the driving motor 8 is rotated forward to make the support seat 12 threadedly connected with the limit ring 11, completing the battery replacement, so that the drone can continue to shoot.
[0023] The main functions achieved by the present invention are: improving work convenience, improving work efficiency, and improving drawing accuracy; 1. Improve work convenience: Use drones to take images of damaged buildings, and make damaged building repair plans based on text data uploaded by users, and draw a 3D model of the damaged building after repair, so that users can refer to the drawn 3D model for building repair work. Use drones to take images of damaged buildings, and restore the collapse process of collapsed buildings based on text data uploaded by users, and make a video, so that rescuers can refer to the video to judge the structure of the collapsed building and carry out rescue; 2. Improve work efficiency: Through the cloud server, multiple 3D modeling units can perform modeling work at the same time, and then assemble the models drawn by multiple 3D modeling units, shortening the modeling time and improving the modeling efficiency; 3. Improve drawing accuracy: Use the trained model through the deep learning processor to perform data analysis to improve drawing accuracy.
[0024] The installation method, connection method or setting method of the intelligent dialogue platform for the construction industry of the present invention are all common mechanical methods, and can be implemented as long as they can achieve their beneficial effects; the second deep model processor is provided with a video production unit, and the video production unit is used to produce a building collapse video according to the analysis results of the second deep model processor; the first electric cylinder 5, the second electric cylinder 7, the drive motor 8 and the lifting platform 9 of the intelligent dialogue platform for the construction industry of the present invention are purchased on the market, and technical personnel in the industry only need to install and operate them according to the accompanying instruction manual, without the need for technical personnel in this field to pay creative labor.
[0025] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. Intelligent dialogue platform for the construction industry, characterized by: include: Human-computer interaction module: displays the captured images and transmits them to the data analysis module. The user inputs text data through the human-computer interaction module and displays or plays the analysis results. Image acquisition module: according to the user's command or direct manual operation of the user, the image of the specified position is captured, and the captured image is processed to be clear, and then the processed image is transmitted to the human-computer interaction module; Data analysis module: receiving the image data transmitted on the human-computer interaction module and the text data input by the user, and analyzing and predicting the image data transmitted on the human-computer interaction module and the text data input by the user, and formulating a repair plan for the damaged position of the building; 3D modeling module: draws a 3D model based on the analysis results of the data analysis module; Data storage module: stores the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Cloud server: provides computing resources for the 3D modeling module; Control management module: verify the identity information of the logged-in user, and centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module.
2. The intelligent dialogue platform for the construction industry as claimed in claim 1, characterized in that: The human-computer interaction module comprises: Display unit: displays the pictures uploaded by the image acquisition module, the text data uploaded by the user, the analysis results of the data analysis module and the control interface of the control management module; Text input unit: assists users to upload text data; Sound playback unit: plays the sound in the video.
3. The intelligent dialogue platform for the construction industry as claimed in claim 1, characterized in that: The data analysis module includes: Data processing module: process the clarity of the image; First deep learning processor: Based on the trained model, the damaged building pictures and text data uploaded by users are analyzed and predicted to determine the type of damage of the damaged building. At the same time, the model extracts key information from the text data, conducts a preliminary analysis of the cause of damage based on historical background and usage conditions, integrates the results of image analysis and text data analysis, comprehensively considers the characteristics of the damaged parts, the cause of damage and the repair requirements, and makes a repair plan for the damaged building; The second deep learning processor: Based on the trained model, it analyzes and predicts the photos of damaged buildings, the scattered building materials around the damaged buildings, and the text data uploaded by users, determines the type and damage of the buildings in the photos, and classifies the scattered building materials. The user then manually verifies the results of automatic recognition to ensure accuracy. At the same time, the model extracts key information from the text data, and then uses finite element analysis software to simulate the collapse process and make a video of the building collapse process to provide rescue reference for rescue workers. Database: stores the training data of the models of the first deep learning processor and the second deep learning processor.
4. The intelligent dialogue platform for the construction industry as claimed in claim 1, characterized in that: The three-dimensional modeling module includes: Data transmission unit: transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit, and then transmitting the drawn model to the model assembly unit; 3D modeling unit: Through the computing resources provided by the cloud server, multiple 3D modeling units can simultaneously model different locations of the building; Model assembly unit: Assemble the models at different locations of the building to form a complete building model.
5. The intelligent dialogue platform for the construction industry as claimed in claim 1, characterized in that: The data storage module comprises: Data classification unit: classifies the acquired image data, text data uploaded by users, analysis results and drawn 3D models; Data storage unit: The classified data is stored separately and for a limited period of time through multiple data storage units; Data management unit: Delete data that exceeds the storage period and restore the accidentally deleted data within the set recovery period.
6. The intelligent dialogue platform for the construction industry as claimed in claim 1, characterized in that: The control management module includes: Identity verification unit: Verify the identity information of logged-in users to ensure the security of user information; Control management unit: centrally manage the human-computer interaction module, image acquisition module, data analysis module and data storage module.
7. The intelligent dialogue platform for the construction industry as claimed in claim 3, characterized in that: The image acquisition module includes multiple groups of shooting drones and a battery replacement mechanism, and the battery replacement mechanism performs battery replacement for the multiple groups of shooting drones.
8. The intelligent dialogue platform for the construction industry as claimed in claim 7, characterized in that: The battery replacement mechanism comprises a storage box (1), a plurality of sets of screw rods (2), a plurality of sets of bases (3), a first electric cylinder (5), a push plate (6), a second electric cylinder (7), a drive motor (8), a lifting platform (9), a battery box (10), a limit ring (11) and a support seat (12); a chamber is arranged inside the storage box (1); an opening is arranged at the top end of the storage box (1); a discharge port is arranged at the left end of the storage box (1); a rubber strip (4) is arranged at the rear end of the inner chamber of the storage box (1); a sensor is arranged at the top end of the storage box (1); a guide groove is arranged at the rear end of the battery (13); the plurality of sets of screw rods (2) are all threadedly mounted on the storage box (1); the plurality of sets of bases (3) are respectively mounted on the bottom ends of the plurality of sets of screw rods (2); the first electric cylinder (5) is mounted on the side end of the storage box (1); and one end of the first electric cylinder (5) extends to the interior of the storage box (1). The push plate (6) is mounted on one end of the first electric cylinder (5), the second electric cylinder (7) is mounted on the bottom of the storage box (1), and the second electric cylinder (7) is located below the opening of the storage box (1), the drive motor (8) is mounted on the top of the second electric cylinder (7), the lifting platform (9) is mounted on the output shaft of the drive motor (8), and the lifting platform (9) is located inside the storage box (1), and a plurality of groups of electric protrusions are arranged on the top of the lifting platform (9), the battery box (10) is mounted on the drone, the limit ring (11) is mounted on the bottom end of the battery box (10), and the top of the battery box (10) is provided with a power connection terminal, the inner wall of the limit ring (11) is provided with a first thread, the support seat (12) is rotatably mounted on the bottom end of the battery (13), and the bottom end of the support seat (12) is provided with a plurality of groups of reserved holes, and the outer surface of the support seat (12) is provided with a second thread.
9. The intelligent dialogue platform for the construction industry as claimed in claim 7, characterized in that: The data processing modules are in multiple groups and are respectively located in multiple groups of drones.
10. An interactive method for a construction industry intelligent dialogue platform, characterized in that: The following steps are involved: S1. The platform controls multiple groups of drones according to the user's command to make the multiple groups of drones take pictures of the designated location, or the user manually controls multiple groups of drones to take pictures of the designated location, and the data processing module processes the clarity of the picture; S2, displaying the photographed pictures through the human-computer interaction module, and transmitting the photographed pictures to the data analysis module, and the user inputs the location, type and characteristic data of the damaged building in text form through the human-computer interaction module; S3. Analyze and predict the damaged building pictures and text data uploaded by users according to the trained model through the first deep learning processor, and make a repair plan for the damaged building; or analyze and predict the damaged building pictures, building materials scattered around the damaged building, and text data uploaded by users according to the trained model through the second deep learning processor, and make a video of the building collapse process to provide rescue reference for rescue personnel; S4, transmitting the analysis result of the first deep learning processor or the analysis result of the second deep learning processor to the three-dimensional modeling unit through the data transmission unit, and then transmitting the drawn model to the model assembly unit, and then using the computing resources provided by the cloud server to enable multiple three-dimensional modeling units to simultaneously model different positions of the building, and then transmitting the drawn model to the model assembly unit through the data transmission unit, and assembling the modeling of different positions of the building through the model assembly unit to form a complete building model; S5. Classify the acquired image data, text data uploaded by the user, analysis results and drawn three-dimensional models through the data classification unit, store the classified data separately for a limited period through multiple data storage units, delete the data that exceeds the storage period through the data management unit, and restore the accidentally deleted data within the set restoration period; S6. When the battery level of the drone is lower than the set value, the drone returns, stops at the top of the storage box by detecting the position of the sensor at the top of the storage box, and aligns the bottom end of the limit ring with the opening of the storage box. Then, the second electric cylinder is extended to insert the electric protrusion on the lifting platform into the reserved hole of the support seat at the bottom of the drone. Then, the drive motor runs in the reverse direction to take out the battery in the drone. Then, the second electric cylinder is retracted and reset, and the electric protrusion on the lifting platform is retracted to form a plane at the top of the lifting platform. The first electric cylinder is extended to push the push plate to the left to push the multiple groups of batteries in the storage box, and the batteries that have just been replaced on the lifting platform are discharged from the discharge port of the storage box through the multiple groups of batteries in the storage box. Then, a group of batteries is pushed to the top of the lifting platform, and then the electric protrusion on the lifting platform is extended to insert it into the reserved hole of the battery on the top of the lifting platform. Then, the second electric cylinder is extended to push a group of batteries into the drone. Then, the drive motor rotates forward to make the support seat and the limit ring threadedly connected, and the battery replacement is completed, so that the drone can continue to shoot.
Citation Information
Patent Citations
Three-dimensional human head reconstruction system and method based on mobile phone camera and cloud server
CN106910241A
A method and device for manufacturing a three-dimensional building model
CN109408907A
Multi-directional repairing system and method for damaged ancient building column
CN111612907A
Portable unmanned aerial vehicle automatic inspection platform
CN112158122A
Hospital construction collaborative management platform based on BIM technology
CN113656868A
Cited By
Traditional village culture digital protection method and system
CN120876718A
