Engineering project remote command management and control method and system

Through a variety of inspection equipment, data is collected and three-dimensional point cloud data is generated, real-time construction maps are built, and risk analysis data is generated in combination with image data, which solves the problem that manual inspections in the existing technology are difficult to achieve comprehensive monitoring, and improves dynamic monitoring and safety at the construction site.

CN119887159APending Publication Date: 2025-04-25WUXI CONSTR SUPERVISION CONSULTING CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411879271.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-19
Publication Date
2025-04-25

AI Technical Summary

Technical Problem

The existing engineering project management model relies on manual inspection and on-site command, and there is a risk of judgment errors and information omissions, making it difficult to achieve comprehensive monitoring of the construction site.

Method used

A variety of inspection equipment (such as inspection robots and drones) are used to collect data. By analyzing the first inspection data and the second inspection data, three-dimensional point cloud data are generated, real-time construction maps are constructed, and risk analysis data is generated based on image data.

Benefits of technology

It has achieved more comprehensive on-site data collection, reduced the time and cost of manual inspection, improved the dynamic monitoring capabilities of the construction site, timely discovered potential problems, and improved construction safety and management efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119887159A_ABST
    Figure CN119887159A_ABST
Patent Text Reader

Abstract

The invention provides an engineering project remote command management and control method and system, and relates to the field of data processing. The method comprises the following steps: acquiring first inspection data sent by first inspection equipment and second inspection data sent by second inspection equipment; analyzing the first inspection data and the second inspection data to obtain three-dimensional point cloud data; according to the three-dimensional point cloud data, constructing a real-time construction map of the target engineering project; receiving a remote command control strategy sent by user equipment, wherein the user equipment is used for displaying a real-time construction map; sending a remote command management and control strategy to a third inspection device, wherein the third inspection device is any one of the plurality of inspection devices; receiving image data sent by the third inspection equipment, and generating risk research and judgment data for a target building in the target engineering project in combination with the three-dimensional point cloud data; and displaying the risk research and judgment data through the user equipment. By implementing the technical scheme provided by the invention, remote command control on the engineering project is more convenient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data processing, and in particular to a method and system for remote command and control of engineering projects. Background Art

[0002] With the rapid development of the global economy and the acceleration of urbanization, the engineering construction industry is facing unprecedented opportunities and challenges. Large-scale infrastructure, real estate development, and public facilities construction projects are constantly emerging, which puts forward higher requirements for the management efficiency and construction safety of engineering projects. Based on this requirement, it is necessary to conduct inspection, command and control of engineering projects.

[0003] In the existing management model, many engineering projects still rely on manual inspections and on-site command. First, manual inspections rely on the experience and judgment of on-site staff, which carries the risk of misjudgment and information omission. In addition, the frequency and coverage of manual inspections are limited by the availability of human resources, and it is often difficult to achieve comprehensive monitoring of the construction site. Therefore, the management and control model of manual inspections and on-site command has more disadvantages than advantages.

[0004] Therefore, there is an urgent need for a remote command and control method and system for an engineering project. Summary of the invention

[0005] The present application provides a method and system for remote command and control of engineering projects, which makes it easier to conduct remote command and control of engineering projects.

[0006] In a first aspect of the present application, a method for remote command and control of an engineering project is provided, the method comprising: obtaining first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, wherein the first inspection device and the second inspection device are any two inspection devices among multiple inspection devices that perform inspection tasks on a target engineering project; analyzing the first inspection data and the second inspection data to obtain three-dimensional point cloud data; constructing a real-time construction map of the target engineering project based on the three-dimensional point cloud data; receiving a remote command and control strategy sent by a user device, wherein the user device is used to display the real-time construction map; sending the remote command and control strategy to a third inspection device, wherein the third inspection device is any one of the multiple inspection devices; receiving image data sent by the third inspection device, and generating risk assessment data for a target building in the target engineering project in combination with the three-dimensional point cloud data; and displaying the risk assessment data through the user device.

[0007] By adopting the above technical solution, by using multiple inspection devices at the same time, more comprehensive on-site data collection can be achieved, reducing the time and cost of manual inspection. The data sent by the first inspection device and the second inspection device can be quickly obtained to ensure dynamic monitoring of the construction site and timely discover potential problems. By analyzing the data of multiple inspection devices, high-precision three-dimensional point cloud data is generated, which helps to form a detailed construction map. This three-dimensional representation can more intuitively reflect the construction progress and on-site conditions. The real-time updated construction map can help project managers fully understand the progress of the project and facilitate accurate management and scheduling. Combining image data and three-dimensional point cloud data, risk assessment data of the target building can be generated through intelligent algorithms. This risk assessment method based on data analysis is more scientific and accurate than traditional experience judgment. The generation and display of risk assessment data enables managers to quickly identify potential risks and take corresponding measures to improve on-site safety. Through the remote command and control strategy sent by the user device, the working mode and direction of the inspection equipment can be quickly adjusted to achieve flexible on-site management. The user device can display the construction map and risk data in real time, helping managers make faster and more effective decisions in centralized monitoring. Therefore, the above solution can make it easier to remotely command and control engineering projects.

[0008] Optionally, the obtaining of first inspection data sent by the first inspection device and second inspection data sent by the second inspection device specifically includes: receiving an inspection task start instruction for the target engineering project sent by the user device, the inspection task start instruction is used to ensure the inspection consistency of multiple inspection devices for the same inspection task; sending the inspection task start instruction to the first inspection device and the second inspection device respectively to control the first inspection device and the second inspection device to start performing the inspection task, the first inspection device is a inspection robot, and the second inspection device is a drone; receiving environmental perception data sent by the first inspection device and three-dimensional scanning data sent by the second inspection device; performing data processing on the environmental perception data and the three-dimensional scanning data to obtain the first inspection data and the second inspection data, the data processing including denoising, filtering, feature engineering and normalization.

[0009] By adopting the above technical solution, by receiving the inspection task start instruction sent by the user device, it is ensured that multiple inspection devices perform the inspection task at the same time and target. This consistency reduces the data loss and coverage problems that may be caused by equipment asynchrony, and improves the inspection efficiency. The inspection task start instruction is sent to different inspection devices separately, so that managers can flexibly control the working status of each device. This operation mode enables managers to dynamically adjust the inspection strategy according to the on-site conditions to ensure comprehensive monitoring of the construction site. By collecting environmental perception data by the inspection robot and three-dimensional scanning data obtained by the drone, the construction site can be fully understood from multiple dimensions. This diverse data source provides a richer information basis for subsequent analysis and helps to comprehensively evaluate the on-site conditions. The collected data is pre-processed by denoising, filtering, feature engineering and normalization to ensure that the final first inspection data and second inspection data are of higher quality. Through these processes, the noise and interference in the data can be reduced, and the accuracy and reliability of the data can be improved. Denoising can significantly improve the data quality, remove useless information, and make subsequent analysis more accurate. Through filtering, the data can be smoothed, making the analysis results easier to interpret, and removing instantaneous outliers caused by sensor errors. Feature engineering can provide more representative information in data analysis by extracting important features, making subsequent model training and prediction more effective. Normalization allows data from different sources to be compared under the same standard, eliminating analysis bias caused by different dimensions. After rigorous data processing, managers can obtain more reliable inspection data and provide scientific basis to support decision-making. This data-driven management method helps reduce decision-making risks and improve the scientific nature of construction management.

[0010] Optionally, the analyzing the first inspection data and the second inspection data to obtain three-dimensional point cloud data specifically includes: obtaining an initial alignment position of the environmental perception data and the three-dimensional scanning data; according to the initial alignment position, obtaining cracks, defects and local structures of the target building through the environmental perception data, and obtaining the global three-dimensional structure of the target building through the three-dimensional scanning data; aligning the cracks, defects and local structures with the global three-dimensional structure to obtain point cloud data to be fused; and fusing the point cloud data to be fused using a voxel grid method to obtain the three-dimensional point cloud data.

[0011] By adopting the above technical solution, the status of the target building can be fully understood by simultaneously acquiring environmental perception data and 3D scanning data. Environmental perception data can capture cracks, defects and local structural problems, while 3D scanning data provides the overall 3D structure of the building. The combination of the two ensures an accurate assessment of the overall and local status of the building. By obtaining the initial alignment position, spatial consistency in subsequent data processing is ensured. This consistency is a prerequisite for generating high-quality 3D point cloud data and helps reduce errors in data processing. By aligning the cracks and defects extracted from environmental perception data with the global structure of 3D scanning data, accurate identification of building defects can be achieved. This method helps construction managers to discover and locate potential problems in a timely manner, reducing safety hazards and maintenance costs caused by undiscovered defects. Cracks, defects and local structures are aligned with the global 3D structure to ensure that information from different data sources can be correctly combined. This scientific alignment method improves the accuracy of data analysis, so that the final generated 3D point cloud data can better reflect the actual situation. The voxel grid method is used to fuse the fused point cloud data, which effectively reduces the complexity of the data while retaining key information. This method not only improves the efficiency of data processing, but also generates clearer and more rationally structured 3D point cloud data, which is helpful for subsequent analysis and application. By generating high-quality 3D point cloud data, construction managers can make more scientific decisions. Visualized 3D data enables managers to intuitively understand the construction status and make accurate management decisions based on the data. By monitoring cracks and defects in buildings, safety hazards can be discovered in a timely manner to ensure construction safety. At the same time, efficient point cloud data processing improves the efficiency of inspections and reduces the need for manual inspections, thereby saving time and costs.

[0012] Optionally, constructing a real-time construction map of the target engineering project based on the three-dimensional point cloud data specifically includes: transforming the three-dimensional point cloud data using a triangular mesh reconstruction algorithm to obtain a three-dimensional surface model; converting the three-dimensional surface model into a standard coordinate system, and combining the first position data and the second position data to determine the real-time construction map, the first inspection data includes first position data for indicating the position of the first inspection equipment, the second inspection data includes second position data for indicating the position of the target engineering project, and the real-time construction map includes project progress, personnel deployment and construction status.

[0013] By adopting the above technical solution, the three-dimensional point cloud data is converted into a three-dimensional surface model by using a triangular mesh reconstruction algorithm. This conversion can transform sparse point cloud data into a continuous surface, which is convenient for subsequent analysis and visualization. The three-dimensional surface model is converted into a standard coordinate system to ensure the consistency and comparability of the data. This standardized process enables data from different sources to be processed under a unified framework, which is convenient for subsequent data fusion and analysis. By combining the first position data and the second position data, the position of each inspection device can be accurately identified in the real-time construction map. This position accuracy can provide a clear spatial reference for project management and help to grasp the overall layout of the construction site. The real-time construction map can dynamically display the progress of the project, allowing managers to monitor the implementation of the project in real time. This visual method enables managers to intuitively understand the construction progress, adjust the construction plan in time, and optimize resource allocation. By displaying the personnel deployment in the real-time construction map, managers can arrange human resources more reasonably and improve construction efficiency. Effective personnel management helps to avoid waste of human resources and ensure that various tasks are carried out on time. The real-time construction map can integrate various status information of the construction site, and managers can obtain comprehensive on-site information through the map, which is convenient for timely discovery and resolution of problems.

[0014] Optionally, the remote command and control strategy sent by the receiving user device specifically includes: displaying the real-time construction map to the user corresponding to the user device through the user device, and the user device is AR glasses; receiving the remote command and control strategy sent by the user through the user device, and the remote command and control strategy includes construction progress management, safety inspection management, construction equipment management, construction personnel management and construction plan management.

[0015] By adopting the above technical solution, AR glasses are used to display real-time construction maps, providing an intuitive and interactive user experience. Users can directly view relevant information on site, which improves the convenience and efficiency of information acquisition and makes the situation on the construction site clear at a glance. User devices can receive updated information of construction maps in real time to ensure that users obtain the latest construction dynamics. This real-time nature helps managers to adjust plans and strategies in a timely manner and respond quickly. Users send remote command and control strategies through devices, forming a good feedback mechanism. This mechanism enables managers to make decisions in a timely manner based on site conditions and user needs, thereby improving the flexibility and adaptability of construction management. Remote command and control strategies include construction progress management, safety inspection management, construction equipment management, construction personnel management, and construction plan management. Such comprehensive coverage ensures that all aspects of construction are under effective monitoring and enhances the systematic nature of management. Through the real-time data display of AR glasses, users can monitor the safety status of the construction site in real time and promptly discover and deal with potential safety hazards. This pre-emptive safety management can effectively reduce the risk of accidents and ensure the safety of construction workers. Using real-time construction maps, managers can clearly understand the progress of each construction link, which is convenient for effective management and adjustment of the construction progress. This transparency of progress helps to improve the execution efficiency of the overall project.

[0016] Optionally, the image data sent by the third inspection device is received and combined with the three-dimensional point cloud data to generate risk assessment data for the target building in the target engineering project, specifically including: obtaining historical inspection data and historical risk data; training the historical inspection data and the historical risk data through a convolutional neural network to obtain a preset risk model; and performing anomaly detection on the target building using the preset risk model based on the image data and the three-dimensional point cloud data to obtain the risk assessment data, wherein the risk assessment data includes the specific location and risk probability of the risk occurring in the target building.

[0017] By adopting the above technical solutions, historical inspection data and historical risk data are obtained to provide rich background information for risk assessment. These historical data can help the model identify potential risk patterns and improve the accuracy of risk assessment. By training historical data with convolutional neural networks, features in the data can be effectively extracted. This deep learning method can handle complex patterns better than traditional methods, improving the efficiency and accuracy of risk detection. Real-time reception of image data and three-dimensional point cloud data enables risk assessment to be carried out in real time. This real-time monitoring can help managers quickly identify potential problems and reduce safety hazards. The risk assessment data contains the specific location and risk probability of the target building, helping managers to accurately identify high-risk areas. The visualization of this information is crucial for formulating countermeasures and resource allocation. By using a preset risk model, the generation of risk assessment data is based on a large amount of data and the results of deep learning analysis, which enhances the scientificity and rationality of decision-making. This data-driven decision-making process can better cope with uncertainties in construction. Through the anomaly detection mechanism, potential risks in buildings can be discovered in a timely manner, which is crucial to protecting the safety of construction personnel and projects. Effective safety management can reduce the frequency of accidents and improve the safety of construction sites.

[0018] Optionally, the method also includes: receiving construction feedback data sent by construction personnel through the third inspection device, the construction feedback data being the data after the construction personnel have eliminated risks based on the risk assessment data; and sending the construction feedback data to the user device to display the construction feedback data to the user through the user device.

[0019] By adopting the above technical solution, managers can obtain the latest information on the construction site in real time by receiving construction feedback data. This timely information update can ensure that decision makers are aware of the latest construction dynamics and can respond in a timely manner. The feedback from construction personnel on risk assessment data can directly reflect the situation of risk elimination. This feedback mechanism enables managers to clearly understand the treatment effect of identified risks and provide a basis for subsequent risk management. Displaying construction feedback data through user devices enhances the transparency of management. Decision makers can clearly see the specific measures taken by construction personnel when facing risks, which helps to build trust and enhance team collaboration. Construction feedback data provides management with rich information to support data-based decision-making processes. This data-driven decision-making method can help managers better evaluate construction progress and the effectiveness of risk control. The transmission and display of construction feedback data promotes communication between construction personnel and management. This interactive mechanism can improve the efficiency of information sharing and enhance team cohesion. By collecting construction feedback data, managers can analyze which measures are effective and which measures need to be improved. This continuous feedback and improvement mechanism can improve the quality and efficiency of construction management and promote the optimization of the construction process. The situation of risk elimination in the construction feedback data can provide managers with specific safety information. In this way, the management can clearly understand the safety status of the site and take necessary measures in time to protect the safety of construction workers. Construction feedback data can help managers understand the actual situation on site and optimize the allocation and configuration of resources. This dynamic adjustment can improve construction efficiency and reduce resource waste. By displaying construction feedback data in a timely manner, managers can quickly understand the construction status and make corresponding adjustments to improve construction progress and efficiency. An efficient feedback mechanism can shorten the decision-making cycle and ensure smooth construction.

[0020] In a second aspect of the present application, a remote command and control system for an engineering project is provided, the remote command and control system for an engineering project comprises an acquisition module and a processing module, wherein the acquisition module is used to acquire first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, wherein the first inspection device and the second inspection device are any two inspection devices among a plurality of inspection devices that perform inspection tasks on a target engineering project; the processing module is used to analyze the first inspection data and the second inspection data to obtain three-dimensional point cloud data; the processing module is also used to construct the target engineering project according to the three-dimensional point cloud data. The real-time construction map of the target engineering project; the acquisition module is also used to receive the remote command and control strategy sent by the user device, and the user device is used to display the real-time construction map; the processing module is also used to send the remote command and control strategy to the third inspection device, and the third inspection device is any one of the multiple inspection devices; the acquisition module is also used to receive the image data sent by the third inspection device, and combine with the three-dimensional point cloud data to generate risk assessment data for the target building in the target engineering project; the processing module is also used to display the risk assessment data through the user device.

[0021] In the third aspect of the present application, an electronic device is provided, which includes a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are both used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device performs the method described above.

[0022] In a fourth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed, the method described above is executed.

[0023] In summary, one or more technical solutions provided in this application have at least the following technical effects or advantages: By using multiple inspection devices at the same time, more comprehensive on-site data collection can be achieved, reducing the time and cost of manual inspections. The data sent by the first inspection device and the second inspection device can be quickly obtained to ensure dynamic monitoring of the construction site and timely discover potential problems. By analyzing the data of multiple inspection devices, high-precision three-dimensional point cloud data is generated, which helps to form a detailed construction map. This three-dimensional representation can more intuitively reflect the construction progress and on-site conditions. The real-time updated construction map can help project managers fully understand the progress of the project and facilitate accurate management and scheduling. Combining image data and three-dimensional point cloud data, risk assessment data of the target building can be generated through intelligent algorithms. This risk assessment method based on data analysis is more scientific and accurate than traditional experience judgment. The generation and display of risk assessment data enables managers to quickly identify potential risks and take corresponding measures to improve on-site safety. Through the remote command and control strategy sent by the user device, the working mode and direction of the inspection equipment can be quickly adjusted to achieve flexible on-site management. The user device can display the construction map and risk data in real time, helping managers make faster and more effective decisions in centralized monitoring. Therefore, the above solution can make it easier to remotely command and control engineering projects. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A flowchart of a method for remote command and control of an engineering project provided in an embodiment of the present application.

[0025] Figure 2 Another flowchart of a method for remote command and control of an engineering project provided in an embodiment of the present application.

[0026] Figure 3 A module diagram of a remote command and control system for an engineering project provided in an embodiment of the present application.

[0027] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0028] Explanation of the reference numerals: 31, acquisition module; 32, processing module; 41, processor; 42, communication bus; 43, user interface; 44, network interface; 45, memory. DETAILED DESCRIPTION

[0029] In order to enable technicians in this field to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0030] In the description of the embodiments of the present application, words such as "for example" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "for example" or "for example" is intended to present related concepts in a specific way.

[0031] In the description of the embodiments of the present application, the meaning of the term "multiple" refers to two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0032] With the rapid development of the global economy and the acceleration of urbanization, the engineering construction industry is facing unprecedented opportunities and challenges. Large-scale infrastructure construction, real estate development and public facilities construction projects are emerging in an endless stream, which puts higher requirements on the management efficiency and construction safety of engineering projects. In this context, inspection command and control of engineering projects are particularly important.

[0033] However, the existing management model still relies heavily on manual inspections and on-site command. First, manual inspections often rely on the experience and judgment of on-site staff, which can easily lead to misjudgments and information omissions. In addition, the frequency and coverage of manual inspections are limited by human resources, making it difficult to achieve comprehensive monitoring of the construction site. Therefore, the management model that relies on manual inspections and on-site command has obvious drawbacks, and there is an urgent need to find a more efficient and reliable solution.

[0034] In order to solve the above technical problems, this application provides a remote command and control method for an engineering project, referring to Figure 1 , Figure 1 A flowchart of a remote command and control method for an engineering project provided in an embodiment of the present application. The remote command and control method for an engineering project is applied to a server, and includes steps S110 to S170, which are as follows: S110, obtaining first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, where the first inspection device and the second inspection device are any two inspection devices among a plurality of inspection devices that perform inspection tasks on a target engineering project.

[0035] Specifically, in an embodiment of the present application, the server acts as a central processing unit, which is responsible for receiving, storing and processing data from different inspection devices. The server can be a computer system or a server cluster, and the stability and performance of the server are crucial to the speed and accuracy of data processing. The first inspection device and the second inspection device can be various types of devices, including inspection robots, drones, sensors, etc. These devices are responsible for performing inspection tasks at the construction site and collecting relevant data. These devices can be of different types or of the same type, as long as they perform inspection tasks in the same engineering project. In an embodiment of the present application, it is preferred that the inspection robot and the drone are combined to perform the inspection task. The first inspection data and the second inspection data are sent by the first inspection device and the second inspection device respectively. The content of the data includes environmental perception information, image data, three-dimensional scanning data, etc., and the specific content depends on the respective inspection tasks and the functions of the equipment. The transmission of data is usually carried out through wireless networks, Bluetooth or other communication protocols to ensure real-time and reliability. The target engineering project refers to a specific construction or construction project that is undergoing an inspection task, such as a bridge, road, building, etc. The task of the inspection equipment is to monitor the construction of the project to ensure safety and progress.

[0036] In a possible implementation, obtaining first inspection data sent by a first inspection device and second inspection data sent by a second inspection device specifically includes: receiving an inspection task start instruction for a target engineering project sent by a user device, the inspection task start instruction is used to ensure the inspection consistency of multiple inspection devices for the same inspection task; sending inspection task start instructions to the first inspection device and the second inspection device respectively to control the first inspection device and the second inspection device to start performing the inspection task, the first inspection device is an inspection robot, and the second inspection device is a drone; receiving environmental perception data sent by the first inspection device and three-dimensional scanning data sent by the second inspection device; performing data processing on the environmental perception data and the three-dimensional scanning data to obtain first inspection data and second inspection data, the data processing including denoising, filtering, feature engineering and normalization.

[0037] Specifically, a user device, such as a mobile phone, tablet or computer, can issue a command to start an inspection task for a target project. The purpose of this command is to ensure that all devices involved in the inspection, such as inspection robots and drones, can start working at the same time to avoid monitoring blind spots or data inconsistencies caused by asynchrony between devices. The server sends a start command to the first inspection device and the second inspection device respectively to ensure that both devices can start their respective inspection tasks synchronously. This instruction is sent through a wireless network, such as Wi-Fi, Bluetooth or other communication protocols. For example, the command may be a simple "start inspection" signal to notify the two devices to start their scheduled inspection routes and tasks. After the device starts the inspection, the first inspection device, as a ground inspection device, will send environmental perception data, including information such as temperature, humidity, and gas concentration, while the second inspection device, as an aerial inspection device, will send three-dimensional scanning data, such as a three-dimensional model of a building structure. These data will be sent to the central server for further processing and analysis.

[0038] Among them, the received environmental perception data and three-dimensional scanning data will be processed. This process includes: removing possible noise interference in the data to improve data quality. For example, using a filtering algorithm to remove accidental fluctuations in environmental data. Smoothing the data to obtain a more stable signal. For example, applying a low-pass filter to reduce high-frequency noise. Extracting important features from the original data for subsequent analysis and modeling. For example, identifying specific patterns in environmental perception data, such as high-temperature areas, or extracting structural features such as edges and faces from three-dimensional data. Converting data into a unified standard format so that data from different sources can be compared and analyzed with each other. For example, standardizing temperature data to a range of 0 to 1. After the above processing, the first inspection data and the second inspection data will eventually be generated. These data will become an important basis for subsequent analysis and decision-making.

[0039] S120: Analyze the first inspection data and the second inspection data to obtain three-dimensional point cloud data.

[0040] Specifically, the first inspection data comes from the inspection robot, including environmental perception data, such as temperature, humidity, gas concentration, crack images, etc. These data can describe the state of the construction environment. The second inspection data comes from the drone, mainly three-dimensional scanning data, to generate a three-dimensional model of the building. These data provide information on the shape, structure and spatial distribution of the target building. The server extracts useful information by comprehensively analyzing the first inspection data and the second inspection data, and finally generates three-dimensional point cloud data. The specific analysis steps include: the server fuses the environmental perception data and the three-dimensional scanning data to obtain more comprehensive spatial information. For example, the server combines the crack data obtained by the robot with the three-dimensional model of the building provided by the drone. The server ensures that data from different devices are analyzed in the same coordinate system, so that information from different sources can be accurately combined. The server extracts three-dimensional point coordinates from the three-dimensional scanning data to generate point cloud data. Point cloud data consists of a series of three-dimensional coordinate points, representing the geometric shape of the target building or environment. Three-dimensional point cloud data is a collection of a large number of three-dimensional coordinate points, used to represent objects or scenes in space. These data can be used for further subsequent analysis and processing, such as visualization, defect detection and modeling.

[0041] In a possible implementation, the first inspection data and the second inspection data are analyzed to obtain three-dimensional point cloud data, specifically including: obtaining an initial alignment position of environmental perception data and three-dimensional scanning data; according to the initial alignment position, obtaining cracks, defects and local structures of the target building through environmental perception data, and obtaining the global three-dimensional structure of the target building through three-dimensional scanning data; aligning the cracks, defects and local structures with the global three-dimensional structure to obtain point cloud data to be fused; and fusing the point cloud data to be fused using a voxel grid method to obtain three-dimensional point cloud data.

[0042] Specifically, the initial alignment position refers to determining the relative position of the environmental perception data and the three-dimensional scanning data in space before starting data analysis. This step usually involves coordinate transformation of the data to ensure that different data sources are processed in the same coordinate system. By analyzing the environmental perception data obtained by the inspection robot, cracks, defects and other local structures of the target building can be identified. For example, the inspection robot finds a crack somewhere during the inspection process and records its location and characteristics. The drone provides the global three-dimensional structure of the building. These data depict the overall appearance of the building, including shape, size and spatial relationship. The server registers the identified cracks, defects and their local structures with the global three-dimensional structure obtained by the drone to ensure that they are accurately aligned in the same space. This process requires the use of a registration algorithm to match the features of different data sources for subsequent fusion. After registration, the obtained point cloud data can be regarded as the point cloud data to be fused. These data contain information such as cracks and defects, while also retaining the overall structural information of the building. The voxel grid method is used to fuse the point cloud data to be fused. This method simplifies the data and reduces noise by dividing the point cloud data into multiple small cubes, i.e. voxels, and calculating the distribution of points within these voxels, ultimately generating a set of clear and coherent 3D point cloud data. The final result is the generated 3D point cloud data that can provide detailed 3D geometric information about the target building, including local defects and overall structural characteristics.

[0043] For example, suppose that in a commercial building under construction, inspection robots and drones are used for inspection. The inspection robot moves around the exterior and interior of the building, using sensors to detect environmental data. It detects several cracks on the wall of a certain floor of the building and records the following data: the coordinates of a crack on a certain floor (X1, Y1, Z1), as well as the width and depth of the crack. The drone flies over the building and uses laser scanning technology to obtain a 3D model of the entire building, generating millions of 3D coordinate points to form point cloud data. This data represents the overall structure of the building, including walls, windows, roofs, etc. Before data analysis begins, the server determines the initial alignment position of the inspection robot and drone to ensure that their coordinate data is processed in the same coordinate system. Through the environmental perception data obtained by the inspection robot, the server identifies the recorded crack locations. The 3D scanning data generated by the drone provides global 3D structural information of the building. The server aligns the coordinates of the cracks with the 3D model obtained by the drone to ensure that the cracks are correctly located in the global 3D model. After alignment, the point cloud data to be fused is obtained, including detailed information about the cracks and the overall structure of the building. The server uses the voxel grid method to process the fused point cloud data, simplify and denoise it, and finally generate a set of clear three-dimensional point cloud data.

[0044] S130. Construct a real-time construction map of the target engineering project based on the three-dimensional point cloud data.

[0045] Specifically, a real-time construction map is a dynamically updated map that reflects the current status of a project, including completed construction parts, ongoing construction activities, and areas that require attention, such as parts that are defective or require rectification. By analyzing and processing three-dimensional point cloud data, the server can generate a clear three-dimensional model that displays every detail of the construction site, helping managers and construction personnel to grasp the progress of the site in real time. The server needs to convert the three-dimensional point cloud data into a format suitable for building a map. The method involved in the embodiment of the present application is to use a triangular mesh reconstruction algorithm to convert the point cloud data into a three-dimensional surface model. The server converts the generated three-dimensional surface model into a standard coordinate system to ensure the consistency of different data sources. Combined with other information, such as construction progress, personnel deployment, equipment status, etc., a comprehensive real-time construction map is constructed. This map not only displays the physical structure, but also contains additional information about the construction status.

[0046] In one possible implementation, a real-time construction map of a target engineering project is constructed based on the three-dimensional point cloud data, specifically including: transforming the three-dimensional point cloud data using a triangular mesh reconstruction algorithm to obtain a three-dimensional surface model; converting the three-dimensional surface model into a standard coordinate system, and combining the first position data and the second position data to determine the real-time construction map, the first inspection data including first position data for indicating the position of the first inspection equipment, the second inspection data including second position data for indicating the position of the target engineering project, and the real-time construction map including project progress, personnel deployment and construction status.

[0047] Specifically, the purpose of the server using the triangular mesh reconstruction algorithm is to convert the scattered point cloud data into a more visual three-dimensional surface model. This model is composed of multiple triangles, which can better represent the surface and structural features of the building. The server converts the generated three-dimensional surface model into a standard coordinate system to ensure that all data and models are in the same reference frame, which makes it easier to perform subsequent data analysis and visualization. The first position data refers to the data indicating the location of the inspection robot, that is, its coordinate information at the construction site. The second position data refers to the data indicating the location of the entire target project, that is, the geographical location or specific coordinate information of the construction site. Combining these two types of position data, the three-dimensional surface model can be correctly placed in the construction map to ensure the accuracy of its spatial position. The final real-time construction map will include multiple information levels: project progress: showing the current status and completion of the construction; personnel deployment: identifying the location of the staff currently at the construction site; construction status: providing real-time information on equipment usage, material storage location, etc.

[0048] For example, imagine an ongoing bridge construction project where the management team wants to monitor construction progress and safety in real time. Inspection robots patrol the interior of the bridge, using sensors to collect data and record the status of each structural part, such as cracks in the piers. Drones monitor the overall structure of the bridge from the air, acquiring its 3D point cloud data to capture the external shape of the bridge and the surrounding environment. The collected 3D point cloud data contains the 3D coordinate information of each part of the bridge. The server uses a triangular mesh reconstruction algorithm to convert these point cloud data into a 3D surface model that shows the shape and structural details of the bridge. The 3D surface model is converted to a standard coordinate system to ensure that all data is in the same reference frame. For example, all coordinates are referenced to a fixed point, such as the starting position of the bridge. Combining the first position data obtained by the inspection robot, such as the coordinates of the robot at a specific position on the bridge, and the second position data of the project, such as the geographic coordinates of the entire bridge, the 3D model is correctly placed in the construction map. The generated real-time construction map will show: Project progress: indicating the currently completed bridge sections and areas under construction; Personnel deployment: identifying the locations of workers currently on the construction site for easy safety management; Construction status: providing information on the working conditions of equipment, such as the location of cranes, material stacking locations, and other information.

[0049] S140: Receive a remote command and control strategy sent by a user device, where the user device is used to display a real-time construction map.

[0050] Specifically, user devices refer to the hardware used by users to access and control the system, such as smartphones, tablets, computers, or AR glasses. Its main function is to display real-time construction maps and allow users to send instructions and receive feedback. Remote command and control strategies refer to specific instructions or strategies formulated by users during the monitoring and management of the construction site. These strategies may include: adjustments to the construction progress, requirements for safety inspections, allocation of resources, and countermeasures to potential risks. These strategies are decisions made based on the data and information on the real-time construction map. The main role of the server in this process is to receive the command and control strategies from the user device, and then process and communicate them to relevant construction equipment, such as inspection equipment, or systems. The server also needs to update and return the real-time construction map to the user device so that the user can view the progress of the construction and the effect of the execution at any time. The real-time construction map is a dynamic map generated based on the three-dimensional point cloud data and other sensor data mentioned above. It not only shows the current status of the construction site, but may also include information about the progress of the project, personnel deployment, and equipment status.

[0051] In a possible implementation, receiving a remote command and control strategy sent by a user device specifically includes: displaying a real-time construction map to a user corresponding to the user device through the user device, where the user device is an AR glasses; receiving a remote command and control strategy sent by the user through the user device, where the remote command and control strategy includes construction progress management, safety inspection management, construction equipment management, construction personnel management, and construction plan management.

[0052] Specifically, AR glasses can display real-time construction maps in the user's field of vision and provide intuitive information display, so that users can view information directly on the construction site without using traditional screen devices. The real-time construction map displayed by the user's device through AR glasses is a dynamic map generated based on real-time data. This map may contain various information on the construction site, such as completed work, ongoing construction, the location and status of construction equipment, etc. The display of real-time construction maps helps users quickly understand the on-site situation, enabling them to make more accurate decisions. Users can send remote command and control strategies directly to the server through AR glasses. The command and control strategy includes multiple aspects: construction progress management: monitoring and adjusting the progress of the project; safety inspection management: ensuring on-site safety and preventing accidents through regular inspections and data feedback; construction equipment management: monitoring the use of equipment, arranging equipment maintenance and scheduling; construction personnel management: managing the arrangement and working status of on-site workers; construction plan management: formulating and adjusting the overall construction plan to deal with possible delays or problems.

[0053] For example, in a large bridge construction project, the project manager uses AR glasses in the office to monitor and remotely direct the project in real time. The project manager puts on the AR glasses, starts the application, and a real-time construction map appears in front of him. The map clearly shows the completed bridge sections, the areas under construction, and the locations of various equipment. The project manager noticed that the progress of a certain section of the bridge was significantly behind schedule. He used the touch function of the AR glasses to select the area, and the system quickly popped up relevant information, including the number of construction workers, the status of the equipment in use, and the progress data. Based on the observed problems, the project manager decided to increase the number of workers in the area and dispatch more concrete mixer trucks. He entered instructions on the interface of the AR glasses and sent remote command and control strategies, including: adjust the construction progress: require to speed up the progress in this area; increase safety inspections: arrange special personnel to check the safety status of the area; increase equipment and personnel: instruct to deploy more workers and equipment to the site. These instructions are sent to the back-end server through the AR glasses, and the server processes and forwards them to the corresponding construction equipment and management system. Once the relevant personnel and equipment are in place, the AR glasses can update the construction map in real time, displaying the real-time status of the newly deployed workers and equipment, and the project manager can immediately see the effect of the adjustment. As construction progresses, the project manager constantly monitors the construction status through AR glasses and makes adjustments based on new real-time data. He can quickly respond to unexpected problems, such as equipment failures, weather changes, etc. to keep the construction on schedule.

[0054] S150. Send a remote command and control strategy to a third inspection device, where the third inspection device is any one of the multiple inspection devices.

[0055] Specifically, the third inspection device refers to any one device selected from multiple inspection devices, such as inspection robots, drones, etc. This device is responsible for performing specific inspection tasks or collecting data for a specific area. When selecting the third inspection device, you can make a selection based on the distance from the target building. For example, if the first inspection device is closest to the target building, then the first inspection device is determined to be the third inspection device. Among them, the third inspection device can be the first inspection device or the second inspection device. The specific selection is determined according to the specific situation, but the purpose is to quickly issue remote command and control strategies and complete the monitoring of the target building.

[0056] S160, receiving image data sent by the third inspection device, combining it with the three-dimensional point cloud data, and generating risk assessment data for the target building in the target engineering project.

[0057] Specifically, real-time images of the target building taken by the inspection equipment. These images can show information such as the surface status, potential defects, and construction progress of the building. The generated 3D scanning data provides 3D structural information of the target building, including shape, size, and spatial distribution. Combining these two types of data helps to achieve a more comprehensive risk assessment. Risk assessment data is the result of the analysis, providing specific information about the potential risks of the target building. This includes safety hazards, structural defects, construction quality issues, etc. of the building. Risk assessment data can be presented in the form of charts, reports, or visualizations to facilitate decision-making by project managers.

[0058] In a possible implementation, image data sent by a third inspection device is received and combined with three-dimensional point cloud data to generate risk assessment data for a target building in a target engineering project, specifically including: obtaining historical inspection data and historical risk data; training the historical inspection data and historical risk data through a convolutional neural network to obtain a preset risk model; and performing anomaly detection on the target building using a preset risk model based on the image data and three-dimensional point cloud data to obtain risk assessment data, the risk assessment data including the specific location and risk probability of the target building having a risk.

[0059] Specifically, historical inspection data is relevant data collected during previous inspections, including information such as previously detected defects, cracks, structural problems, etc. Historical risk data is risk assessment information associated with previous inspection results, including identified risk types, frequency of occurrence, and severity. Convolutional neural network is a deep learning algorithm that is particularly suitable for processing image data. By learning a large number of images, convolutional neural networks can extract features from images and perform classification or detection. In an embodiment of the present application, a convolutional neural network is used to train historical inspection data and historical risk data to establish a preset risk model that can identify and predict potential risks. Anomaly detection refers to identifying situations that are different from the normal mode. In this scenario, it is to detect possible risks and abnormal conditions in a building. Using the preset risk model, the server inputs the newly received image data and three-dimensional point cloud data into the model for analysis to identify potential problems in the building. Risk assessment data includes the specific location of the identified risk and the corresponding risk probability. For example, the model may identify the presence of cracks in a certain area and assess the probability of their occurrence.

[0060] For example, when risk assessment data is generated, the report shows the specific location of the crack, the possible risk type, such as structural risk, and the risk probability assessed by the model, such as 70%. For example, the system may point out that "a crack was detected on the west wall with a depth of 3 cm, the predicted risk level is medium, and the probability of structural instability is 70%."

[0061] S170. Display risk assessment data through user equipment.

[0062] Specifically, the display process means presenting risk assessment data to users in a visual form. Through clear and easy-to-understand graphics or charts, users can intuitively understand the current building status and potential risks through AR glasses.

[0063] In one possible implementation, refer to Figure 2 , Figure 2 Another flow chart of a method for remote command and control of an engineering project provided in an embodiment of the present application. Specifically comprising steps S210 to S220, the steps are as follows: S210, receiving construction feedback data sent by construction personnel through a third inspection device, the construction feedback data being data after the construction personnel eliminate the risk based on the risk assessment data; S220, sending the construction feedback data to a user device, so as to display the construction feedback data to the user through the user device.

[0064] Specifically, feedback data is the response of construction personnel to previously generated risk assessment data, indicating how they have taken measures or solutions to the identified risks. Feedback data contains specific measures implemented by construction personnel, such as repairing cracks, reinforcing structures, adjusting construction methods, etc. This data shows that these measures have effectively eliminated or mitigated the risks previously identified. The server transmits the construction feedback data to the user device so that managers and other relevant personnel can obtain the latest information in real time. Through the user device, the construction feedback data is presented in a visual form to ensure that users can quickly understand the construction progress and risk treatment. This presentation appears in the form of graphics, text, and interactive elements. Among them, the information displayed on the user device may include: before and after repair comparison photos, intuitively showing the effect of crack repair. Text description, a detailed description of the measures taken by the construction personnel. Risk status update, indicating that the risk of the area has been reduced or eliminated. Through this information, the project manager confirms that the construction personnel's measures are effective and decides to continue monitoring the area or arrange follow-up inspections to ensure that there are no other potential problems.

[0065] This application also provides a remote command and control system for engineering projects, referring to Figure 3 , Figure 3A module schematic diagram of a remote command and control system for an engineering project provided in an embodiment of the present application. The remote command and control system for an engineering project is a server, and the server includes an acquisition module 31 and a processing module 32, wherein the acquisition module 31 acquires first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, and the first inspection device and the second inspection device are any two inspection devices among multiple inspection devices that perform inspection tasks on a target engineering project; the processing module 32 analyzes the first inspection data and the second inspection data to obtain three-dimensional point cloud data; the processing module 32 constructs a real-time construction map of the target engineering project based on the three-dimensional point cloud data; the acquisition module 31 receives a remote command and control strategy sent by a user device, and the user device is used to display a real-time construction map; the processing module 32 sends a remote command and control strategy to a third inspection device, and the third inspection device is any one of the multiple inspection devices; the acquisition module 31 receives image data sent by the third inspection device, and generates risk assessment data for a target building in the target engineering project in combination with the three-dimensional point cloud data; the processing module 32 displays the risk assessment data through the user device.

[0066] In a possible implementation, the acquisition module 31 acquires first inspection data sent by the first inspection device and second inspection data sent by the second inspection device, specifically including: the acquisition module 31 receives an inspection task start instruction for a target engineering project sent by a user device, and the inspection task start instruction is used to ensure the inspection consistency of multiple inspection devices for the same inspection task; the processing module 32 sends an inspection task start instruction to the first inspection device and the second inspection device respectively to control the first inspection device and the second inspection device to start performing the inspection task, the first inspection device is an inspection robot, and the second inspection device is a drone; the acquisition module 31 receives environmental perception data sent by the first inspection device and three-dimensional scanning data sent by the second inspection device; the processing module 32 performs data processing on the environmental perception data and the three-dimensional scanning data to obtain the first inspection data and the second inspection data, and the data processing includes denoising, filtering, feature engineering and normalization processing.

[0067] In a possible implementation, the processing module 32 analyzes the first inspection data and the second inspection data to obtain three-dimensional point cloud data, specifically including: the acquisition module 31 acquires the initial alignment position of the environmental perception data and the three-dimensional scanning data; the processing module 32 acquires the cracks, defects and local structures of the target building through the environmental perception data according to the initial alignment position, and acquires the global three-dimensional structure of the target building through the three-dimensional scanning data; the processing module 32 aligns the cracks, defects and local structures with the global three-dimensional structure to obtain the point cloud data to be fused; the processing module 32 uses the voxel grid method to fuse the point cloud data to be fused to obtain the three-dimensional point cloud data.

[0068] In one possible implementation, a real-time construction map of a target engineering project is constructed based on the three-dimensional point cloud data, specifically including: the processing module 32 uses a triangular mesh reconstruction algorithm to transform the three-dimensional point cloud data to obtain a three-dimensional surface model; the processing module 32 converts the three-dimensional surface model into a standard coordinate system, and combines the first position data and the second position data to determine the real-time construction map, the first inspection data includes first position data for indicating the position of the first inspection equipment, the second inspection data includes second position data for indicating the position of the target engineering project, and the real-time construction map includes project progress, personnel deployment and construction status.

[0069] In a possible implementation, receiving a remote command and control strategy sent by a user device specifically includes: a processing module 32 displays a real-time construction map to a user corresponding to the user device through the user device, and the user device is an AR glasses; an acquisition module 31 receives a remote command and control strategy sent by the user through the user device, and the remote command and control strategy includes construction progress management, safety inspection management, construction equipment management, construction personnel management, and construction plan management.

[0070] In a possible implementation, the acquisition module 31 receives image data sent by the third inspection device, combines it with the three-dimensional point cloud data, and generates risk assessment data for the target building in the target engineering project, specifically including: the acquisition module 31 acquires historical inspection data and historical risk data; the processing module 32 trains the historical inspection data and historical risk data through a convolutional neural network to obtain a preset risk model; the processing module 32 uses a preset risk model to perform anomaly detection on the target building based on the image data and the three-dimensional point cloud data to obtain risk assessment data, and the risk assessment data includes the specific location and risk probability of the risk occurring in the target building.

[0071] In a possible implementation, the acquisition module 31 receives construction feedback data sent by construction personnel through a third inspection device, where the construction feedback data is data after the construction personnel have eliminated risks based on the risk assessment data; the processing module 32 sends the construction feedback data to the user device to display the construction feedback data to the user through the user device.

[0072] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0073] The present application also provides an electronic device, referring to Figure 4, Figure 4 The electronic device may include: at least one processor 41 , at least one network interface 44 , a user interface 43 , a memory 45 , and at least one communication bus 42 .

[0074] The communication bus 42 is used to realize the connection and communication between these components.

[0075] The user interface 43 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 43 may also include a standard wired interface and a wireless interface.

[0076] The network interface 44 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0077] Among them, the processor 41 may include one or more processing cores. The processor 41 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 45, and calling data stored in the memory 45. Optionally, the processor 41 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 41 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 41, and it can be implemented separately through a chip.

[0078] Among them, the memory 45 may include a random access memory (RAM) or a read-only memory (Read-Only Memory). Optionally, the memory 45 includes a non-transitory computer-readable storage medium. The memory 45 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 45 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned method embodiments, etc.; the data storage area may store data involved in the above-mentioned method embodiments, etc. The memory 45 may also be optionally at least one storage device located away from the aforementioned processor 41. As Figure 4 As shown, the memory 45 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for a method for remote command and control of an engineering project.

[0079] exist Figure 4 In the electronic device shown, the user interface 43 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 41 can be used to call an application program for a remote command and control method of an engineering project stored in the memory 45. When executed by one or more processors, the electronic device executes one or more methods such as those in the above-mentioned embodiments.

[0080] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0081] The present application also provides a computer-readable storage medium, which stores instructions. When executed by one or more processors, the electronic device executes one or more of the methods described in the above embodiments.

[0082] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0084] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0085] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0086] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0087] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the disclosure of the specification and the truth of practice, it will be easy for those skilled in the art to think of other embodiments of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field that are not recorded in the present disclosure. The description and examples are regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A remote command and control method for an engineering project, characterized in that: The method comprises: Acquire first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, wherein the first inspection device and the second inspection device are any two inspection devices among a plurality of inspection devices that perform inspection tasks on a target engineering project; Analyze the first inspection data and the second inspection data to obtain three-dimensional point cloud data; Constructing a real-time construction map of the target engineering project based on the three-dimensional point cloud data; Receiving a remote command and control strategy sent by a user device, wherein the user device is used to display the real-time construction map; Sending the remote command and control strategy to a third inspection device, where the third inspection device is any one of the plurality of inspection devices; Receiving the image data sent by the third inspection device, and combining it with the three-dimensional point cloud data to generate risk assessment data for the target building in the target engineering project; The risk assessment data is displayed via the user device.

2. The remote command and control method for an engineering project according to claim 1, characterized in that: The obtaining of the first inspection data sent by the first inspection device and the second inspection data sent by the second inspection device specifically includes: Receiving an inspection task start instruction for the target engineering project sent by the user equipment, wherein the inspection task start instruction is used to ensure inspection consistency of multiple inspection devices for the same inspection task; Sending the inspection task start instruction to the first inspection device and the second inspection device respectively to control the first inspection device and the second inspection device to start performing the inspection task, wherein the first inspection device is an inspection robot and the second inspection device is a drone; Receiving the environmental perception data sent by the first inspection device and the three-dimensional scanning data sent by the second inspection device; The environmental perception data and the three-dimensional scanning data are processed to obtain the first inspection data and the second inspection data, wherein the data processing includes denoising, filtering, feature engineering and normalization processing.

3. The remote command and control method for an engineering project according to claim 2, characterized in that: The analyzing the first inspection data and the second inspection data to obtain three-dimensional point cloud data specifically includes: Acquire an initial alignment position of the environmental perception data and the three-dimensional scanning data; According to the initial alignment position, cracks, defects and local structures of the target building are acquired through the environmental perception data, and the global three-dimensional structure of the target building is acquired through the three-dimensional scanning data; Registering the cracks, defects and local structures with the global three-dimensional structure to obtain point cloud data to be fused; The voxel grid method is used to fuse the point cloud data to be fused to obtain the three-dimensional point cloud data.

4. The remote command and control method for an engineering project according to claim 1, characterized in that: The step of constructing a real-time construction map of the target engineering project according to the three-dimensional point cloud data specifically includes: The three-dimensional point cloud data is transformed by using a triangular mesh reconstruction algorithm to obtain a three-dimensional surface model; The three-dimensional surface model is converted into a standard coordinate system, and the real-time construction map is determined by combining the first position data and the second position data, wherein the first inspection data includes first position data for indicating the position of the first inspection equipment, and the second inspection data includes second position data for indicating the position of the target engineering project, and the real-time construction map includes project progress, personnel deployment and construction status.

5. The remote command and control method for engineering projects according to claim 1, characterized in that: The receiving of the remote command and control strategy sent by the user equipment specifically includes: Displaying the real-time construction map to a user corresponding to the user device through the user device, where the user device is an AR glasses; A remote command and control strategy is received, which is sent by the user through the user device. The remote command and control strategy includes construction progress management, safety inspection management, construction equipment management, construction personnel management, and construction plan management.

6. The remote command and control method for an engineering project according to claim 1, characterized in that: The receiving of the image data sent by the third inspection device and combining the three-dimensional point cloud data to generate risk assessment data for the target building in the target engineering project specifically includes: Obtain historical inspection data and historical risk data; The historical inspection data and the historical risk data are trained by a convolutional neural network to obtain a preset risk model; According to the image data and the three-dimensional point cloud data, the preset risk model is used to perform abnormality detection on the target building to obtain the risk assessment data, which includes the specific location and risk probability of the risk occurring in the target building.

7. The remote command and control method for an engineering project according to claim 1, characterized in that: The method further comprises: receiving construction feedback data sent by the construction personnel through the third inspection device, wherein the construction feedback data is data after the construction personnel eliminate the risk according to the risk assessment data; The construction feedback data is sent to the user device, so as to display the construction feedback data to the user through the user device.

8. A remote command and control system for an engineering project, characterized in that: The engineering project remote command and control system comprises an acquisition module (31) and a processing module (32), wherein: The acquisition module (31) is used to acquire first inspection data sent by a first inspection device and second inspection data sent by a second inspection device, wherein the first inspection device and the second inspection device are any two inspection devices among a plurality of inspection devices that perform inspection tasks on a target engineering project; The processing module (32) is used to analyze the first inspection data and the second inspection data to obtain three-dimensional point cloud data; The processing module (32) is further used to construct a real-time construction map of the target engineering project based on the three-dimensional point cloud data; The acquisition module (31) is further used to receive a remote command and control strategy sent by a user device, and the user device is used to display the real-time construction map; The processing module (32) is further used to send the remote command and control strategy to a third inspection device, wherein the third inspection device is any one of the plurality of inspection devices; The acquisition module (31) is further used to receive the image data sent by the third inspection device, and generate risk assessment data for the target building in the target engineering project in combination with the three-dimensional point cloud data; The processing module (32) is also used to display the risk assessment data through the user device.

9. An electronic device, characterized in that: The electronic device comprises a processor (41), a memory (45), a user interface (43) and a network interface (44), wherein the memory (45) is used to store instructions, the user interface (43) and the network interface (44) are both used to communicate with other devices, and the processor (41) is used to execute the instructions stored in the memory (45) so that the electronic device executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 7 is performed.

Citation Information

Patent Citations

  • Unmanned routing inspection method, system and device based on video fusion and storage medium

    CN111083438A

  • Railway engineering unmanned aerial vehicle intelligent inspection system

    CN118890438A