Intelligent pavement maintenance system based on BIM (Building Information Modeling) technology and maintenance robot
Through BIM technology and drone photography, road quality defect blocks are automatically analyzed and identified, maintenance strategies are formulated, and maintenance robots are used for automatic maintenance, solving the problems of low manual patrol efficiency and adapting to complex environments, and achieving efficient and accurate road surfaces Maintenance.
Patent Information
- Application Number
- CN202411333078.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-24
- Publication Date
- 2024-11-22
AI Technical Summary
In the prior art, manual patrol pavement quality defects are inefficient and subjective, making it difficult to adapt to complex terrain and extreme environments, resulting in untimely or inaccurate maintenance and poses safety risks.
Adopt intelligent road maintenance system based on BIM technology and drone photography, collect data through drones, establish three-dimensional models, automatically analyze and identify quality defect blocks, and formulate maintenance strategies, and use maintenance robots to perform automatic maintenance around the clock to avoid workers' intervention. .
It realizes efficient and accurate pavement maintenance, adapts to complex terrain and extreme environments, reduces safety risks, avoids missed and false alarms caused by manual patrols, and improves maintenance efficiency and quality.
Smart Images

Figure CN118996967A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of pavement maintenance, and in particular relates to an intelligent pavement maintenance system based on BIM technology and a maintenance robot. Background Art
[0002] Affected by the geological conditions, construction quality and operation time of the road surface, the road surface will have quality defects of varying degrees after a period of use. In order to ensure driving safety, comfort and smoothness, as well as to save transportation costs and transportation time, it is usually necessary to regularly inspect and maintain the road surface to repair the quality defects of the road surface.
[0003] In the prior art, the road surface is usually inspected manually by car. After a road section with quality defects is found, a construction team is arranged to maintain the road surface that needs maintenance. However, manual inspection is not only inefficient, but also has a high degree of subjectivity in judging road quality defects, which can easily lead to underreporting or false reporting of quality defects. In addition, the efficiency of maintaining the road surface through a construction team is low, and the construction period is difficult to control. At the same time, for road maintenance scenarios with complex terrain, landforms or environments, where manual inspection and construction pose great safety risks, such as road maintenance in large mining operating areas with the risk of falling rocks, road maintenance at large airports with frequent aircraft takeoffs and landings, and road maintenance under extreme climatic conditions, the method of combining manual inspection with construction team maintenance is difficult to apply. Summary of the invention
[0004] The technical problem solved by the present invention is: to provide an intelligent pavement maintenance system based on BIM technology and maintenance robots, which uses BIM technology and drone photography technology to automatically analyze and identify quality defective blocks that need maintenance, and formulate reasonable and scientific maintenance strategies to control the maintenance robots to perform all-weather intelligent maintenance on quality defective blocks efficiently and orderly, without the need for workers to intervene throughout the process, and can cope with various pavement maintenance scenarios with complex terrain or extreme environments and great safety risks.
[0005] The present invention is achieved through the following technical solutions.
[0006] The intelligent road maintenance system based on BIM technology and maintenance robots is characterized by comprising: a drone, a maintenance robot, a maintenance robot base, a batching tank, a BIM system, a maintenance analysis and scheduling module, and a human-computer interaction interface;
[0007] The drone is used to collect and obtain initial road surface data and real-time road surface data of the area to be maintained, and send them to the BIM system;
[0008] The maintenance robot base is connected to the road surface of the area to be maintained and is used to park the maintenance robot;
[0009] The batching tank is arranged at one side of the maintenance robot base, and is used to mix maintenance materials for maintaining quality defective blocks with different quality defect types;
[0010] The BIM system includes: for establishing an initial three-dimensional model of the road surface according to the initial road surface data and the geological data in the design drawing of the area to be maintained, and sending it to the maintenance analysis and scheduling module; for substituting the real-time road surface data into the initial three-dimensional model of the road surface, analyzing and calculating the difference between the actual road surface and the initial road surface, so as to obtain the coordinates, quality defect severity level and quality defect type of each quality defect block that needs to be maintained on the actual road surface, and sending them to the maintenance analysis and scheduling module; for receiving the real-time road surface image information of each quality defect block after maintenance sent by the maintenance robot, and updating the initial three-dimensional model of the road surface in real time according to the real-time road surface image information after maintenance;
[0011] The maintenance analysis and scheduling module includes, according to the coordinates of each quality defect block, the severity level of the quality defect and the type of quality defect, to analyze and formulate a maintenance strategy and send it to the human-computer interaction interface, the maintenance strategy includes determining the maintenance time period, dividing the maintenance area, assigning maintenance robots to perform maintenance tasks in each maintenance area one by one, and determining the maintenance order of each target quality defect block in each maintenance area; according to the maintenance strategy, a maintenance instruction is issued to the maintenance robot, and according to the quality defect type of each target quality defect block in the maintenance area corresponding to the maintenance robot, the maintenance robot is controlled to move to the batching tank to fill the required type of maintenance material, and then, according to the initial three-dimensional model of the road surface and the coordinates of each target quality defect block in the corresponding maintenance area, a driving route is generated with the maintenance robot base as the starting point and driving to each target quality defect block in the corresponding maintenance area in the maintenance order, and the driving route is sent to the corresponding maintenance robot;
[0012] The maintenance robot includes a driving component, a vehicle-mounted camera, a maintenance construction component and a maintenance control module arranged on the driving component; the driving component is used to drive the maintenance robot to move to each target quality defect block according to the driving route after receiving the driving route, and return to the maintenance robot base according to the driving route after completing the maintenance task; the maintenance construction component includes a material preparation tank for filling maintenance materials, and a maintenance work end for performing different maintenance actions on the target quality defect block; the vehicle-mounted camera is used to obtain real-time road surface image information of the target quality defect block, and transmit the real-time road surface image information to the vehicle-mounted camera. The maintenance control module is used to analyze and obtain the maintenance construction plan of the target quality defect block according to the real-time pavement image information before maintenance when the maintenance robot reaches the target quality defect block, so as to control the driving component to drive the maintenance robot to move and control the construction component to perform corresponding maintenance actions to maintain the target quality defect block according to the maintenance construction plan and the real-time pavement image information during maintenance;
[0013] The human-computer interaction interface includes a function for issuing instructions to control the UAV to update the initial road surface data of the area to be maintained or obtain real-time road surface data, a function for inputting geological data in the design drawing of the area to be maintained, and a function for real-time display of real-time maintenance image information obtained by each maintenance robot when performing maintenance tasks.
[0014] Preferably, the maintenance time period is the start and end time range for all assigned maintenance robots to complete maintenance tasks in the corresponding maintenance area, and the maintenance time period is within the time range when traffic in the maintenance area is not busy.
[0015] Preferably, the quality defect type data include road surface cracking, road surface bulging, road surface potholes and subsidence, road surface sanding, road surface peeling and road surface stone leakage. The maintenance material corresponding to road surface cracking is road surface caulking agent, and the maintenance material corresponding to road surface bulging, road surface potholes and subsidence and road surface sanding is road surface repair mortar. The corresponding batching tanks include road surface caulking agent batching tank and road surface repair mortar batching tank.
[0016] Preferably, the maintenance order of each target quality defect block in each maintenance area is to perform maintenance in the following order according to the type of quality defects of each target quality defect block: road potholes and subsidence, road bulging, road sanding, road peeling, road stone leakage, and road cracking. Among them, for target quality defect blocks with the same type of quality defects, the quality defect blocks with more serious quality defects are maintained first according to the severity level of the quality defects.
[0017] Preferably, the driving route complies with the traffic rules for the road surface in the area to be maintained and avoids each target quality defective block.
[0018] Preferably, the maintenance robot also includes an audible and visual alarm and a laser radar; the laser radar is used to detect and identify the information of moving objects around the maintenance robot and send it to the maintenance control module; the maintenance control module also includes a device for receiving the moving object information, and when the maintenance robot is in a stationary state, if the distance between the moving object and the maintenance robot is lower than a set threshold, controlling the audible and visual alarm to emit an audible and visual alarm, and when the maintenance robot is in a moving state, controlling the maintenance robot to move to avoid obstacles according to the moving object information.
[0019] Preferably, the system of the present invention also includes a cloud database; the road surface data collected by the drone and the real-time maintenance image information obtained by the maintenance robot performing the maintenance task are stored in real time in the cloud database.
[0020] Preferably, the human-machine interaction interface also includes a system for manually remotely controlling the movement of the maintenance robots and executing maintenance actions to maintain the target quality defective blocks based on real-time maintenance image information obtained by each maintenance robot performing maintenance tasks that is displayed in real time.
[0021] Preferably, the maintenance actions performed by the maintenance work end include crushing, excavating, compacting and cleaning the target quality defect blocks, and spraying or filling maintenance materials into the target quality defect blocks; the maintenance construction plan includes selecting appropriate maintenance actions and determining the execution order and parameters of each maintenance action.
[0022] Preferably, the initial pavement data is pavement data collected by a drone when the pavement in the area to be maintained is newly built but not put into use, or is pavement data collected by a drone after the pavement in the area to be maintained is in operation and maintenance is completed.
[0023] Compared with the prior art, the present invention has at least the following beneficial effects:
[0024] 1) The present invention uses BIM technology and drone photography technology to not only obtain the three-dimensional model of the sidewalk in real time, but also analyzes and calculates the difference between the actual road surface and the initial road surface by combining the real-time monitoring data of the road surface, so as to obtain information on the quality defect blocks that need to be maintained on the actual road surface, so as to provide a reliable basis for subsequent maintenance decisions. After completing the maintenance task, the system of the present invention can obtain the image information after maintenance in real time through the vehicle-mounted camera, and update the three-dimensional model of the sidewalk in real time through the BIM system, so as to ensure the quality and accuracy of the subsequent maintenance construction, and avoid the problems of low efficiency and great subjectivity of manual inspection, and easy false reporting or omission of road quality defects.
[0025] 2) In the present invention, the information of each quality defect block includes coordinates, quality defect severity level and quality defect type. The maintenance analysis and scheduling module can formulate a reasonable and scientific maintenance strategy based on the information of each quality defect block, and command the maintenance robot to automatically prepare materials according to the maintenance strategy, and intelligently navigate to each maintenance area according to the driving route; at the same time, the present invention uses the on-board camera of the maintenance robot to obtain maintenance images in real time, analyzes and formulates maintenance construction plans through the maintenance control module, and controls the maintenance construction components to perform corresponding maintenance actions, thereby ensuring safety and not affecting the normal traffic of vehicles in the maintenance area. , The orderly, efficient and all-weather intelligent maintenance of the road surface in the maintenance area can be achieved.
[0026] 3) The system of the present invention does not require the intervention of workers throughout the entire process, has high road maintenance efficiency, and can cope with road maintenance scenarios with complex terrain or extreme environments and high safety risks, and has good practical and promotion value. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 It is a structural schematic diagram of the system of the present invention;
[0028] Figure 2 A schematic diagram of a maintenance strategy generated by the system of the present invention;
[0029] Figure 3 Schematic diagram of the structure of the maintenance robot in the present invention;
[0030] Figure 4 is a functional principle diagram of the system of the present invention;
[0031] The meanings of the symbols in the above figure are: drone 1, maintenance robot 2, driving component 201, maintenance construction component 202, material preparation tank 2021, maintenance work end 2022, vehicle-mounted camera 203, sound and light warning device 204, laser radar 205, material preparation tank 206, maintenance robot base 3, material mixing tank 4, pavement caulking agent material mixing tank 401, pavement repair mortar material mixing tank 402, area to be maintained 5, pavement 6, quality defect block 7, maintenance area 8. DETAILED DESCRIPTION
[0032] To facilitate understanding of the present invention, the present invention will be described more comprehensively below with reference to the relevant drawings. Several embodiments of the present invention are given in the drawings, but the present invention can be implemented in different forms and is not limited to the embodiments described in the text. On the contrary, these embodiments are provided to make the content disclosed in the present invention more thorough and comprehensive.
[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field to which the present invention belongs. The terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.
[0034] The present invention is further described in detail below in conjunction with the accompanying drawings.
[0035] Example
[0036] Intelligent road maintenance system based on BIM technology and maintenance robots, please refer to Figures 1 to 4 , which includes: UAV 1, maintenance robot 2, maintenance robot base 3, batching tank 4, BIM system, maintenance analysis and scheduling module, and human-computer interaction interface;
[0037] The drone 1 is used to collect and obtain the initial road surface data and real-time road surface data of the area to be maintained 5, and send them to the BIM system;
[0038] The maintenance robot base 3 is connected to the road surface 6 of the area to be maintained 5, and is used to park the maintenance robot 2;
[0039] The batching tank 4 is arranged at one side of the maintenance robot base 3, and is used to mix maintenance materials for maintaining quality defective blocks with different quality defect types;
[0040] The BIM system includes: for establishing an initial three-dimensional model of the road surface according to the initial road surface data and the geological data in the design drawing of the area to be maintained, and sending it to the maintenance analysis and scheduling module; for substituting the real-time road surface data into the initial three-dimensional model of the road surface, analyzing and calculating the difference between the actual road surface and the initial road surface, so as to obtain the coordinates, quality defect severity level and quality defect type of each quality defect block that needs to be maintained on the actual road surface, and sending them to the maintenance analysis and scheduling module; for receiving the real-time road surface image information of each quality defect block after maintenance sent by the maintenance robot, and updating the initial three-dimensional model of the road surface in real time according to the real-time road surface image information after maintenance;
[0041] The maintenance analysis and scheduling module includes:
[0042] According to the coordinates of all quality defect blocks, the severity level of quality defects and the types of quality defects, a maintenance strategy is analyzed and formulated and sent to the human-computer interaction interface. The maintenance strategy includes determining the maintenance time period, dividing the maintenance area, assigning maintenance robots to perform maintenance tasks in each maintenance area one by one, and the maintenance order of each target quality defect block in each maintenance area; in this embodiment, please refer to Figure 2The maintenance area 5 is the operating area of a large mine. Through BIM system analysis and calculation, it is found that there are 17 quality defective blocks in the road surface of the maintenance area 5, namely quality defective blocks A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11, A12, A13, A14, A15, A16, and A17. The maintenance strategy formulated by the maintenance analysis and scheduling module is: the maintenance time period is from 10:00 p.m. to 5:00 a.m. the next day; The road surface of maintenance area 5 is divided into 6 maintenance areas Y1, Y2, Y3, Y4, Y5, and Y6. Maintenance area Y1 contains quality defect blocks A1, A2, and A3, maintenance area Y2 contains quality defect blocks A4, A5, and A6, maintenance area Y3 contains quality defect blocks A7, A8, and A9, maintenance area Y4 contains quality defect blocks A10 and A11, maintenance area Y5 contains quality defect blocks A12 and A13, and maintenance area Y6 contains quality defect block A14. , A15, A16, A17, in the present invention, usually according to the coordinate position of each quality defect block, the adjacent quality defect blocks are divided into a maintenance area; 6 maintenance robots Q1, Q2, Q3, Q4, Q5, Q6 are allocated to the maintenance areas Y1, Y2, Y3, Y4, Y5, Y6 respectively, to perform maintenance tasks on the quality defect blocks in the corresponding maintenance areas; the maintenance order of each target quality defect block in each maintenance area is as follows: maintenance area Y The maintenance order of the quality defective blocks in maintenance area Y1 is A1→A3→A2, the maintenance order of the quality defective blocks in maintenance area Y2 is A5→A4→A6, the maintenance order of the quality defective blocks in maintenance area Y3 is A7→A9→A8, the maintenance order of the quality defective blocks in maintenance area Y4 is A10→A11, the maintenance order of the quality defective blocks in maintenance area Y5 is A12→A13, and the maintenance order of the quality defective blocks in maintenance area Y6 is A15→A14→A16→A17;
[0043] According to the maintenance strategy, a maintenance instruction is issued to the maintenance robot 2, and according to the quality defect type of each target quality defect block in the maintenance area corresponding to the maintenance robot, the maintenance robot 2 is controlled to move to the batching tank 4 to fill the required type of maintenance materials, and then, according to the initial three-dimensional model of the road surface and the coordinates of each target quality defect block in the corresponding maintenance area, a driving route is generated starting from the maintenance robot base 3 and driving to each target quality defect block in the corresponding maintenance area in the order of maintenance, and the driving route is sent to the corresponding maintenance robot 2; in this embodiment, after determining the maintenance strategy, the maintenance analysis and scheduling module sends maintenance instructions to the maintenance robots Q1, Q2, Q3, Q4, Q5, and Q6 respectively. Since the maintenance robots Q1, Q2, Q3, Q4, Q5, and Q6 are for maintenance areas Y1 and Y2 respectively , Y3, Y4, Y5, and Y6 for maintenance. Therefore, the maintenance robot Q1 will move to the batching tank 4 to fill the required type of maintenance materials according to the quality defect types of the target quality defect blocks A1, A2, and A3 in the maintenance area Y1. Then, the maintenance analysis and scheduling module will generate a driving route L1 starting from the maintenance robot base 3 and driving to the target quality defect blocks A1, A3, and A2 in the maintenance order according to the initial three-dimensional model of the road surface and the coordinates of the target quality defect blocks A1, A2, and A3 in the maintenance area Y1, and send the driving route L1 to the corresponding maintenance robot Q1. Similar to the above, the maintenance analysis and scheduling module will also simultaneously control the maintenance robots Q2, Q3, Q4, Q5, and Q6 to prepare materials and generate corresponding driving routes after the preparation is completed.
[0044] The maintenance robot 2 includes a driving component 201, a vehicle-mounted camera 203, a maintenance construction component 202 and a maintenance control module arranged on the driving component 201; the driving component 201 is used to drive the maintenance robot to move to each target quality defect block according to the driving route after receiving the driving route, and return to the maintenance robot base 3 according to the driving route after completing the maintenance task; the maintenance construction component 202 includes a material preparation tank 2021 for filling maintenance materials, and a maintenance working end 2022 for performing different maintenance actions on the target quality defect block; the vehicle-mounted camera 203 can be set in plurality, at least one of which is set on the maintenance construction component 202, and the vehicle-mounted camera 203 is used to obtain The real-time pavement image information of the target quality defect block is obtained, and the real-time pavement image information is sent to the human-computer interaction interface, the real-time pavement image information before maintenance and the real-time pavement image information during maintenance are sent to the maintenance control module, and the real-time pavement image information after maintenance is sent to the BIM system; the maintenance control module is used to analyze and obtain the maintenance construction plan of the target quality defect block according to the real-time pavement image information before maintenance when the maintenance robot arrives at the target quality defect block, so as to control the driving component 201 to drive the maintenance robot to move and control the construction component 202 to perform corresponding maintenance actions to maintain the target quality defect block according to the maintenance construction plan and the real-time pavement image information during maintenance; in this embodiment In the example, after the maintenance robot Q1 receives the driving route L1, the driving component 201 drives the maintenance robot Q1 to first move to the target quality defect block A1 according to the driving route L1. After the maintenance robot Q1 reaches the position of the target quality defect block A1, the on-board camera 203 obtains the real-time road surface image information of the target quality defect block A1, and sends the real-time road surface image information to the human-computer interaction interface, and sends the real-time road surface image information before maintenance and the real-time road surface image information during maintenance to the maintenance control module. The maintenance control module analyzes and obtains the maintenance construction plan S1 of the target quality defect block according to the real-time road surface image information before maintenance, and controls the maintenance construction plan S1 according to the maintenance construction plan S1 and the real-time road surface image information during maintenance. The driving component 201 drives the maintenance robot to move and controls the construction component 202 to perform corresponding maintenance actions to maintain the target quality defect block; when the target quality defect block A1 is maintained, the onboard camera 203 obtains the real-time road surface image information of the target quality defect block A1 after maintenance and sends it to the BIM system, and the BIM system updates the initial three-dimensional model of the road surface; thereafter, the driving component 201 drives the maintenance robot Q1 to move to the next target quality defect block A3 according to the driving route L1, and maintains the target quality defect block A3 according to the similar process mentioned above, and updates the initial three-dimensional model of the road surface until the target quality defect blocks A1, A3, and A2 in the maintenance area Y1 are maintained in sequence;At the same time, the maintenance robots Q2, Q3, Q4, Q5, and Q6 also perform maintenance tasks in the above manner, which will not be described in detail here;
[0045] The human-machine interaction interface includes a function for issuing instructions to control the UAV 1 to update the initial road surface data of the area to be maintained or obtain real-time road surface data, a function for inputting geological data in the design drawing of the area to be maintained, and a function for real-time display of real-time maintenance image information obtained by each maintenance robot when performing maintenance tasks.
[0046] Furthermore, in a preferred embodiment, the drone 1 obtains initial road surface data and real-time road surface data of the area to be maintained through drone oblique photography technology, and the drone 1 collects data during the day when there are fewer vehicles passing through the road surface in the area to be maintained, so as to prevent the passing vehicles from interfering with the data collection; in actual applications, the real-time road surface data of the area to be maintained can be obtained through the drone at regular intervals, such as 15-30 days, to start the system to perform intelligent maintenance on the road surface at a certain period.
[0047] Furthermore, in a preferred embodiment, the maintenance time period is the start and end time range for all assigned maintenance robots to complete maintenance tasks in the corresponding maintenance area. In order to minimize the impact of the maintenance robots performing maintenance tasks on the traffic in the maintenance area, the maintenance time period is within the time range when the traffic in the maintenance area 5 is not busy.
[0048] Further, in a preferred embodiment, the quality defect type data includes road surface cracking, road surface bulging, road surface potholes and subsidence, road surface sanding, road surface peeling and road surface stone leakage, the maintenance material corresponding to road surface cracking is road surface sealant, and the maintenance material corresponding to road surface bulging, road surface potholes and subsidence and road surface sanding is road surface repair mortar, and the corresponding batching tanks 4 include road surface sealant batching tank 401 and road surface repair mortar batching tank 402.
[0049] Furthermore, in a preferred embodiment, the maintenance order of each target quality defect block in each maintenance area is as follows: maintenance is performed in the following order according to the type of quality defects of each target quality defect block: potholes and subsidence, blisters, sand on the road surface, peeling of the road surface, stone leakage on the road surface, and cracking of the road surface. Among them, for target quality defect blocks with the same type of quality defects, the quality defect blocks with more severe quality defects are maintained first according to the severity level of the quality defects. Generally, the severity level of quality defects can be divided into three levels: minor, general, and severe.
[0050] Furthermore, in a preferred embodiment, the driving route follows the traffic rules for the road surface in the area to be maintained 5 and avoids the target quality defect blocks, thereby ensuring the safety of the maintenance robot when moving along the driving route and preventing the maintenance robot from causing further damage to the target quality defect blocks.
[0051] Further, in a preferred embodiment, the maintenance robot 2 also includes an audible and visual alarm 204 and a laser radar 205; the laser radar 205 is used to detect and identify the information of moving objects around the maintenance robot and send it to the maintenance control module; the maintenance control module also includes a device for receiving the information of moving objects, and when the maintenance robot is in a stationary state, if the distance between the moving object and the maintenance robot is lower than a set threshold, controlling the audible and visual alarm 204 to send out an audible and visual alarm, and when the maintenance robot is in a moving state, controlling the maintenance robot to move to avoid obstacles according to the information of the moving object; in this embodiment, the moving objects include vehicles and pedestrians; based on the above settings, when the maintenance robot moves according to the driving route, the laser radar 205 is used to detect the information of moving objects near the maintenance robot, so that the maintenance robot can reasonably avoid obstacles to ensure that the maintenance robot safely reaches the target quality defect block position; when the maintenance robot is in a stationary state, when the target quality defect block is maintained, when a moving object approaches the maintenance robot, an audible and visual alarm can be actively sent out to remind nearby moving objects to avoid in advance.
[0052] Furthermore, in a preferred embodiment, the system of the present invention also includes a cloud database; the road surface data collected by the drone 1 and the real-time maintenance image information obtained by the maintenance robot performing maintenance tasks are stored in real time in the cloud database; based on the above settings, when encountering abnormal situations such as communication interruption or interference between the drone or maintenance robot and the BIM system, the data collected by the drone or robot can be stored in the cloud database for offline work and data backup, and at the same time, other communication methods or equipment can be used to restore the communication connection and data synchronization with the BIM system as soon as possible.
[0053] Furthermore, in a preferred embodiment, the human-computer interaction interface also includes a system for manually remotely controlling the movement of the maintenance robot 2 and executing maintenance actions to maintain the target quality defective blocks according to real-time maintenance image information obtained by each maintenance robot performing maintenance tasks that is displayed in real time; based on the above settings, the system operator can intuitively understand the maintenance process of the road surface through the real-time maintenance image information, and thus make real-time adjustments and decisions, and can directly manually remotely control the robot to perform maintenance operations when necessary; in addition, the system of the present invention can also be connected to virtual reality VR or augmented reality AR equipment to enable the system operator to understand and master the maintenance process more realistically and realistically.
[0054] Furthermore, in a preferred embodiment, the maintenance actions performed by the maintenance work end include crushing, excavating, compacting and cleaning the target quality defect block, and spraying or filling maintenance materials into the target quality defect block; the maintenance construction plan includes selecting appropriate maintenance actions and determining the execution order and parameters of each maintenance action; for example, when the quality defect type of the target quality defect block is pavement cracking, the maintenance work end only performs the action of filling the pavement sealant to inject the corresponding amount of pavement sealant in the maintenance construction plan into the pavement cracks; for example, when the quality defect type of the target quality defect block is pavement bulging, the maintenance work end sequentially performs crushing, excavating and cleaning actions to eliminate the bulging of the pavement, and then performs the action of filling the pavement repair mortar to inject the corresponding amount of pavement repair mortar in the maintenance construction plan into the pavement cracks.
[0055] Furthermore, in a preferred embodiment, the maintenance work end includes construction tools and mechanical arms for performing different maintenance actions, and a power system for providing power to the construction tools and mechanical arms; specifically, the construction tool is an impact breaker for performing crushing maintenance actions; the construction tool is a bucket for performing excavation maintenance actions; the construction tool is a rammer for performing compaction maintenance actions; the construction tool is a road sweeping shovel for performing cleaning maintenance actions; the construction tool is a slurry pump for performing maintenance actions of spraying or filling maintenance materials; the above-mentioned different construction tools can be connected to the same mechanical arm or to different mechanical arms according to their operating characteristics, for example, the impact breaker and the rammer can be installed on the same mechanical arm.
[0056] Furthermore, in a preferred embodiment, the maintenance control module also includes adjusting and optimizing the maintenance construction plan in real time according to the real-time maintenance image information during maintenance when the maintenance robot performs maintenance actions, and controlling the driving component 201 to drive the maintenance robot to move and controlling the construction component 202 to perform corresponding maintenance actions to maintain the target quality defective area according to the real-time adjusted and optimized maintenance construction plan.
[0057] Furthermore, in a preferred embodiment, the initial pavement data is pavement data collected by a drone when the pavement in the area to be maintained 5 is newly built but not put into use, or is pavement data collected by a drone after the pavement in the area to be maintained 5 is in operation and maintenance is completed; when using the system of the present invention to perform pavement maintenance, it usually includes the following two situations: one is that after the pavement in the area to be maintained is newly built, the pavement is maintained using the system of the present invention. At this time, the pavement data should be collected by a drone as the original pavement data when the pavement in the area to be maintained is newly built but not put into use. In this way, the original pavement data usually reflects the best quality state of the pavement; the second is that the pavement in the area to be maintained is already in operation, then the pavement data should be collected by a drone as the original pavement data after the pavement in the area to be maintained 5 is completed and maintenance is completed.
Claims
1. The intelligent road maintenance system based on BIM technology and maintenance robots is characterized by: include: UAV (1), maintenance robot (2), maintenance robot base (3), batching tank (4), BIM system, maintenance analysis and scheduling module, human-computer interaction interface; The drone (1) is used to collect initial road surface data and real-time road surface data of the area to be maintained (5), and send the data to the BIM system; The maintenance robot base (3) is connected to the road surface (6) of the area to be maintained (5) and is used to park the maintenance robot (2); The batching tank (4) is arranged at one side of the maintenance robot base (3) and is used to mix maintenance materials for maintaining quality defective blocks with different types of quality defects; The BIM system includes a module for establishing an initial three-dimensional model of the road surface based on the initial road surface data and the geological data in the design drawing of the area to be maintained, and sending it to the maintenance analysis and scheduling module; Used to substitute real-time road surface data into the initial three-dimensional model of the road surface, analyze and calculate the difference between the actual road surface and the initial road surface, so as to obtain the coordinates, severity level and type of quality defects of each quality defect block that needs maintenance on the actual road surface, and send them to the maintenance analysis and scheduling module; Used to receive the real-time road surface image information of each quality defective block after maintenance sent by the maintenance robot, and update the initial three-dimensional model of the road surface in real time according to the real-time road surface image information after maintenance; The maintenance analysis and scheduling module includes, according to the coordinates of each quality defect block, the severity level of the quality defect and the type of quality defect, analyzing and formulating a maintenance strategy and sending it to the human-computer interaction interface, the maintenance strategy includes determining the maintenance time period, dividing the maintenance area, assigning maintenance robots to perform maintenance tasks in each maintenance area one by one, and determining the maintenance order of each target quality defect block in each maintenance area; according to the maintenance strategy, issuing a maintenance instruction to the maintenance robot (2), and according to the quality defect type of each target quality defect block in the maintenance area corresponding to the maintenance robot, controlling the maintenance robot (2) to move to the batching tank (4) to fill the required type of maintenance material, and then generating a driving route starting from the maintenance robot base (3) and driving to each target quality defect block in the corresponding maintenance area in the maintenance order according to the initial three-dimensional model of the road surface and the coordinates of each target quality defect block in the corresponding maintenance area, and sending the driving route to the corresponding maintenance robot (2); The maintenance robot (2) comprises a driving component (201), an onboard camera (203), a maintenance construction component (202) and a maintenance control module arranged on the driving component (201); the driving component (201) is used to drive the maintenance robot to move to each target quality defect block according to the driving route after receiving the driving route, and return to the maintenance robot base (3) according to the driving route after completing the maintenance task; the maintenance construction component (202) comprises a material preparation tank (2021) for filling maintenance materials, and a maintenance working end (2022) for performing different maintenance actions on the target quality defect block; the onboard camera (203) is used to obtain real-time road surface image information of the target quality defect block, and send the real-time road surface image information to the human-computer interaction interface, send the real-time road surface image information before maintenance and the real-time road surface image information during maintenance to the maintenance control module, and send the real-time road surface image information after maintenance to the BIM system; The maintenance control module is used to analyze and obtain a maintenance construction plan for the target quality defect block based on the real-time road surface image information before maintenance when the maintenance robot reaches the target quality defect block position, and to control the driving component (201) to drive the maintenance robot to move and control the construction component (202) to perform corresponding maintenance actions to maintain the target quality defect block based on the maintenance construction plan and the real-time road surface image information during maintenance; The human-machine interaction interface includes a device for issuing instructions to control the drone (1) to update the initial road surface data of the area to be maintained or obtain real-time road surface data, a device for inputting geological data in the design drawing of the area to be maintained, and a device for real-time display of real-time maintenance image information obtained by each maintenance robot when performing a maintenance task.
2. The intelligent road maintenance system based on BIM technology and maintenance robot according to claim 1 is characterized in that: The maintenance time period is the start and end time range for all assigned maintenance robots to complete maintenance tasks in the corresponding maintenance area, and the maintenance time period is within the time range when traffic in the maintenance area (5) is not busy.
3. The intelligent road maintenance system based on BIM technology and maintenance robot according to claim 1, characterized in that: The quality defect type data include road surface cracking, road surface bulging, road surface potholes and subsidence, road surface sanding, road surface peeling and road surface stone leakage. The maintenance material corresponding to road surface cracking is road surface caulking agent, and the maintenance material corresponding to road surface bulging, road surface potholes and subsidence and road surface sanding is road surface repair mortar. The corresponding batching tanks (4) include road surface caulking agent batching tanks (401) and road surface repair mortar batching tanks (402).
4. The intelligent road maintenance system based on BIM technology and maintenance robots as claimed in claim 3 is characterized in that: The maintenance order of each target quality defect block in each maintenance area is as follows: maintenance is carried out in the following order according to the type of quality defects of each target quality defect block: road potholes and subsidence, road bulging, road sanding, road peeling, road stone leakage, and road cracking. Among them, for target quality defect blocks with the same type of quality defects, the quality defect blocks with more serious quality defects will be maintained first according to the severity level of the quality defects.
5. The intelligent road maintenance system based on BIM technology and maintenance robot according to claim 1, characterized in that: The driving route complies with the traffic rules for the road surface in the area to be maintained (5) and avoids each target quality defective block.
6. The intelligent road maintenance system based on BIM technology and maintenance robots as claimed in claim 5 is characterized in that: The maintenance robot (2) further comprises an audible and visual alarm (204) and a laser radar (205); the laser radar (205) is used to detect and identify information about moving objects around the maintenance robot, and transmit the information to the maintenance control module; the maintenance control module further comprises a device for receiving the moving object information, and when the maintenance robot is in a stationary state, if the distance between the moving object and the maintenance robot is lower than a set threshold, controlling the audible and visual alarm (204) to emit an audible and visual alarm, and when the maintenance robot is in a moving state, controlling the maintenance robot to move to avoid obstacles according to the moving object information.
7. The intelligent road maintenance system based on BIM technology and maintenance robots according to claim 1, characterized in that: It also includes a cloud database; the road surface data collected by the drone (1) and the real-time maintenance image information obtained by the maintenance robot performing the maintenance task are all stored in real time in the cloud database.
8. The intelligent road maintenance system based on BIM technology and maintenance robots as claimed in claim 1, characterized in that: The human-machine interaction interface also includes a method for manually remotely controlling the maintenance robot (2) to move and perform maintenance actions to maintain the target quality defective block based on real-time maintenance image information obtained by each maintenance robot performing the maintenance task that is displayed in real time.
9. The intelligent road maintenance system based on BIM technology and maintenance robots according to claim 1, characterized in that: The maintenance actions performed by the maintenance work end include crushing, excavating, compacting and cleaning the target quality defect block, and spraying or filling maintenance materials into the target quality defect block; the maintenance construction plan includes selecting appropriate maintenance actions and determining the execution order and parameters of each maintenance action.
10. The intelligent road maintenance system based on BIM technology and maintenance robot according to any one of claims 1 to 9, characterized in that: The initial road surface data is road surface data collected by drones when the road surface in the area to be maintained (5) is newly built but not yet put into use, or is road surface data collected by drones after the road surface in the area to be maintained (5) is in operation and maintenance is completed.
Citation Information
Cited By
Road maintenance road construction sequence determination method, system, equipment and medium
CN119809268A
