Building construction image processing method and device, equipment and storage medium

Abstract

The invention discloses a building construction image processing method, device and equipment and a storage medium, and the method comprises the steps: continuously collecting construction images of a building construction site through a high-altitude camera of the building construction site, carrying out the analysis and processing of the construction images, which are collected by the high-altitude camera and comprise time frames, at a first time interval, and carrying out the analysis and processing of the construction images; and obtaining a plurality of target results, determining a first time frame corresponding to the construction image when the target result is the first result and a second time frame corresponding to the construction image when the target result is the second result according to the plurality of target results, and determining current construction progress information of the building construction site based on the first time frame and the second time frame. By adopting the embodiment of the invention, automatic and efficient counting of building floors can be realized, so that the management efficiency of the floor construction progress is improved.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a construction image processing method, device, equipment and storage medium. Background Art

[0002] In recent years, with the rapid development of technologies such as artificial intelligence, big data, and cloud computing, digital technology has made great progress in the field of construction and has been successfully applied in many scenarios, especially in management, such as personnel safety management, construction progress management, etc. At present, most construction fields are still using a more traditional management method: manually recording the construction progress of each floor during the construction process, including the construction date, the number of completed floors, etc.

[0003] However, the management method of floor construction progress in related technologies has extremely low efficiency and is difficult to perform automated data analysis. In order to improve the management efficiency in the field of construction, taking the path of sustainable and high-quality development of digital construction is the inevitable direction for the transformation and upgrading of the construction industry.

[0004] Therefore, how to improve the management efficiency of floor construction progress is a technical problem that needs to be solved urgently. Summary of the invention

[0005] The purpose of the embodiments of the present invention is to provide a construction image processing method, device, equipment and storage medium to solve the technical problem of low management efficiency in the management method of floor construction progress in the related art.

[0006] In a first aspect, to achieve the above-mentioned purpose, an embodiment of the present invention provides a construction image processing method, comprising:

[0007] Continuously collecting construction images of the construction site through a high-altitude camera at the construction site;

[0008] At every first time interval, analyzing and processing the construction image including the time frame collected by the high-altitude camera to obtain multiple target results;

[0009] According to the plurality of target results, determining a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result;

[0010] Based on the first time frame and the second time frame, current construction progress information of the construction site is determined.

[0011] In an embodiment of the present invention, the step of analyzing and processing the construction image containing the time frame collected by the aerial camera at every first time interval to obtain multiple target results includes:

[0012] At every first time interval, acquiring the construction image including the time frame collected by the high-altitude camera;

[0013] The trained target detection model is called to detect the target object in the construction image of each time frame to obtain multiple detection results, and the detection results are used as target results.

[0014] In the embodiment of the present invention, the step of detecting and processing the target object in the construction image of each time frame to obtain multiple detection results includes:

[0015] The target object in the construction image of each time frame is detected and processed to obtain a first result indicating that the construction image contains the target object and a second result indicating that the construction image does not contain the target object.

[0016] In an embodiment of the present invention, before the step of calling the trained target detection model to detect the target object in the construction image of each time frame to obtain multiple detection results, the construction image processing method further includes:

[0017] Acquire a target detection data set, wherein the target detection data set includes a plurality of training images and annotation data, wherein the training images are construction images of a construction site taken from a high altitude, and the annotation data are data after the target objects in the training images are annotated;

[0018] The target detection data set is used to train the detection model to be trained until convergence, thereby obtaining a trained target detection model.

[0019] In an embodiment of the present invention, the step of determining the current construction progress information of the construction site based on the first time frame and the second time frame includes:

[0020] determining a first number of consecutive first time frames and a second number of consecutive second time frames based on the first time frame and the second time frame;

[0021] Determine the construction information of the number of floors of the current floor of the construction site that has been completed according to the first number, the second number, and the sequence relationship between the first time frame and the second time frame;

[0022] The construction information is added to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site.

[0023] In the embodiment of the present invention, the step of determining the construction information of the number of floors of the current floor of the construction site completed according to the first number, the second number, and the chronological relationship between the first time frame and the second time frame includes:

[0024] When all of the second time frames are before the first time frame and a second number of consecutive second time frames is not less than a target threshold, detecting a first number of consecutive first time frames;

[0025] In a case where the first number is not less than the target threshold, construction information of the number of floors of the current floor of the construction site having been completed is determined.

[0026] In an embodiment of the present invention, after the step of adding the construction information to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site, the construction image processing method further includes:

[0027] Within the preset target time, stop using the high-altitude camera to collect construction images of the construction site, stop calling the trained target detection model, and detect and process the target objects in the construction images of each time frame.

[0028] In a second aspect, in order to solve the same technical problem, an embodiment of the present invention provides a construction image processing device, comprising:

[0029] A collection module, used to continuously collect construction images of the construction site through a high-altitude camera at the construction site;

[0030] An analysis module, configured to analyze and process the construction image including the time frame collected by the aerial camera at every first time interval to obtain a plurality of target results;

[0031] A first determination module, configured to determine, based on the plurality of target results, a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result;

[0032] The second determining module is used to determine the current construction progress information of the construction site based on the first time frame and the second time frame.

[0033] In the third aspect, in order to solve the same technical problem, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the memory is coupled to the processor, and when the processor executes the computer program, the steps in the construction image processing method described in any one of the above items are implemented.

[0034] In the fourth aspect, in order to solve the same technical problem, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to perform the steps in any one of the above-mentioned construction image processing methods.

[0035] The embodiments of the present invention provide a construction image processing method, device, equipment and storage medium. The method continuously collects construction images of a construction site through a high-altitude camera at the construction site, analyzes and processes the construction images to obtain multiple target results, and at the same time, based on the multiple target results, determines a first time frame of the construction image corresponding to a first result, and a second time frame of the construction image corresponding to a second result. Therefore, based on the first time frame and the second time frame, the current construction progress information of the construction site can be determined, automatic and efficient counting of building floors can be achieved, and the management efficiency of the floor construction progress can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a flow chart of a construction image processing method provided by an embodiment of the present invention;

[0037] Figure 2 It is a schematic diagram of a construction process provided by an embodiment of the present invention;

[0038] Figure 3 is a schematic diagram of the labeling data provided by an embodiment of the present invention;

[0039] Figure 4 It is a flow chart of a method for determining construction progress information provided by an embodiment of the present invention;

[0040] Figure 5 is a structural schematic diagram of a construction image processing device provided by an embodiment of the present invention;

[0041] Figure 6 is a structural schematic diagram of an electronic device provided by an embodiment of the present invention;

[0042] Figure 7 This is another structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0043] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0045] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0046] Among the related technologies, in recent years, with the rapid development of technologies such as artificial intelligence, big data, and cloud computing, digital technology has made great progress in the field of construction and has been successfully applied in many scenarios, especially in management, such as personnel safety management, construction progress management, etc. At present, most construction fields are still using a more traditional management method: manually recording the construction progress of each floor during the construction process, including the construction date, the number of completed floors, etc.

[0047] However, the management method of floor construction progress in related technologies has extremely low efficiency and is difficult to perform automated data analysis. In order to improve the management efficiency in the field of construction, taking the path of sustainable and high-quality development of digital construction is the inevitable direction for the transformation and upgrading of the construction industry.

[0048] Therefore, how to improve the management efficiency of floor construction progress is a technical problem that needs to be solved urgently.

[0049] In order to solve the technical problems existing in the related art, this embodiment provides a construction image processing method, see Figure 1 , Figure 1 is a flow chart of a construction image processing method provided by an embodiment of the present invention. Figure 1 As shown, the construction image processing method provided by the embodiment of the present invention includes steps 101 to 104, which are specifically as follows:

[0050] Step 101: continuously collect construction images of the construction site through a high-altitude camera at the construction site.

[0051] In this embodiment, in order to improve the management efficiency of the construction site, this embodiment uses a high-altitude camera installed at the construction site to collect construction images of the construction site, thereby reducing the number of times the construction images of the construction site are collected, thereby effectively improving the management efficiency of the construction site.

[0052] The high-altitude camera provided in this embodiment can be set on an object with a preset height in or around the construction site, such as a tower crane at the construction site, a high-rise building with a preset height around the construction site, or a drone with a preset flight height, etc., as long as the camera's shooting angle is at the preset height. The preset height can be set according to the image captured by the high-altitude camera, as long as the construction site in the captured image can be clearly visible in the captured image, and the specific height value of the preset height is not limited here.

[0053] Step 102: Analyze and process the construction image including the time frame collected by the aerial camera at every first time interval to obtain multiple target results.

[0054] In this embodiment, the first time interval provided in this embodiment can be a preset value, such as 0.5 hours, 1 hour, 3 hours or 6 hours, etc. The specific time interval can be set according to the actual management needs of the construction site and is not specifically limited here.

[0055] The construction images captured by the high-altitude camera provided in this embodiment include the time frame information of the capture time of the high-altitude camera, so as to distinguish the construction images captured at different time moments. The target result provided in this embodiment includes a first result and a second result. Specifically, the first result may be the result corresponding to the case where the construction image meets the preset requirements, and the second result may be the result corresponding to the case where the construction image does not meet the preset requirements.

[0056] In this example, see Figure 2 , Figure 2 is a schematic diagram of a construction process provided by an embodiment of the present invention, such as Figure 2 As shown, in this embodiment, the construction site is constructed on each floor according to Figure 2The processes 1 to 6 shown in the figure are executed sequentially. Therefore, this embodiment can determine whether the construction image meets the preset requirements by analyzing whether the construction image collected by the high-altitude camera is in the target process. The target process can be a pre-set process, specifically one or more of the processes 1 to 6. The actual setting can be selected according to the on-site construction requirements, and is not specifically limited here.

[0057] Step 103 : determining, based on the plurality of target results, a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result.

[0058] After obtaining the plurality of target results after analyzing the construction image, the first time frame when the construction image corresponds to the first result and the second time frame when the construction image corresponds to the second result can be determined according to the first result and the second result corresponding to the target result. Specifically, the first time frame and the second time frame can be specific to minutes and seconds, such as xx year xx month xx day xx hour xx minute xx second.

[0059] Step 104: Determine current construction progress information of the construction site based on the first time frame and the second time frame.

[0060] After obtaining the first time frame when each construction image corresponds to the first result, and the second time frame when each construction image corresponds to the second result, the present embodiment can sort the first result and the second result of the construction image according to the time relationship between the first time frame and the second time frame, so as to obtain time series information about the first result and the second result. Then, the present embodiment can detect whether the number of adjacent first results and the number of adjacent second results in the time series information meet the preset conditions to determine the current construction progress information of the construction site.

[0061] Specifically, the preset condition provided in this embodiment may be: after the target process in which the construction image is located is not detected for N consecutive times, the target process in which the construction image is located is detected for N consecutive times, and then it is determined that the preset condition is met. In this way, through the preset condition provided in this embodiment, it can be determined whether the construction process of the construction site has completed a round, so as to determine whether the construction site has completed the construction of the current floor, and when it is determined that the construction of the current floor is completed, the information is recorded, which is convenient for the management of the construction site.

[0062] In an embodiment of the present invention, in order to improve the processing efficiency of analyzing and processing construction images, the embodiment provides the step of analyzing and processing the construction images containing time frames collected by the aerial camera at every first time interval to obtain multiple target results. Specifically, the step may be: obtaining the construction images containing time frames collected by the aerial camera at every first time interval; calling the trained target detection model to detect and process the target objects in the construction images of each time frame to obtain multiple detection results, and using the detection results as the target results.

[0063] Specifically, the step of detecting and processing the target object in the construction image of each time frame to obtain multiple detection results provided in the present embodiment is specifically: detecting and processing the target object in the construction image of each time frame to obtain a first result that the construction image contains the target object, and a second result that the construction image does not contain the target object.

[0064] Among them, the target object provided in this embodiment can be Figure 2 The marker object of any process in process 1 to process 6, such as the stairs in process 1, the vertical prefabricated components such as vertical prefabricated walls in process 2, the exterior wall formwork in process 3, the horizontal formwork in process 4, the horizontal steel bars in process 5, the concrete pouring in process 6, etc., as long as the target object can be determined Figure 2 Therefore, this embodiment determines the first result and the second result corresponding to the construction image by detecting whether the construction image contains the target object.

[0065] In this embodiment, in order to improve the processing efficiency of analyzing and processing the construction images, before analyzing and processing the construction images, this embodiment also needs to train a target detection model to complete the analysis and processing of the construction images. Specifically, before the step of calling the trained target detection model, detecting and processing the target objects in the construction images of each time frame, and obtaining multiple detection results, the construction image processing method provided by this embodiment may also include: obtaining a target detection data set, the target detection data set includes multiple training images and annotation data, the training images are construction images of the construction site taken from a high altitude, and the annotation data are the data after the target objects in the training images are annotated; using the target detection data set, the detection model to be trained is trained until convergence, and a trained target detection model is obtained.

[0066] Optionally, in this embodiment, the vertical prefabricated wall can be used as the target object, and the installation image of the vertical prefabricated wall on the working surface can be collected by the high-altitude camera as the training image, and the vertical prefabricated wall in the training image can be annotated, for example, by providing an annotation frame, so as to obtain annotation data. The annotation data is specifically as follows: Figure 3 As shown, Figure 3 It is a schematic diagram of the labeled data provided by an embodiment of the present invention, which is used to construct a target detection data set.

[0067] After obtaining the target detection data set, the detection model to be trained can be trained through the target detection data set to obtain the target detection model for detecting vertical prefabricated walls. Since the features of vertical prefabricated walls are obvious and easy to identify, the Precision is 0.972, the Recall is 0.916, and the mAP50 is 0.967 under the 224 small sample image data. After the training is completed, the optimal model is saved as the target detection model. The Precision value represents the accuracy, the Recall value represents the recall rate, and the mAP50 value represents the average accuracy of the model when the IoU (intersection over union) threshold is 0.5.

[0068] It should be noted that the detection model to be trained provided in this embodiment may be a YOLO detection model, such as a TPH-YOLOv5 model, a PP-YOLOE-SOD model, a YOLOv10 or other detection models.

[0069] As an alternative embodiment, see Figure 4 , Figure 4 : is a flow chart of a method for determining construction progress information provided by an embodiment of the present invention, such as Figure 4 As shown, the step of determining the current construction progress information of the construction site based on the first time frame and the second time frame provided in this embodiment may include steps 401 to 403;

[0070] Step 401: determining a first number of consecutive first time frames and a second number of consecutive second time frames based on the first time frame and the second time frame.

[0071] In this embodiment, since this embodiment collects construction images once every first time interval, the adjacent first time frames or second time frames provided in this embodiment are separated by the first time interval. It should be noted that in the continuous first time frames and the continuous second time frames defined in this embodiment, each time frame is adjacent to each other and there are no other time frames, that is, there is no second time frame in the continuous first time frame, and there is no first time frame in the continuous second time frame.

[0072] Step 402: Determine the construction information of the number of floors completed for the current floor of the construction site according to the first number, the second number, and the chronological relationship between the first time frame and the second time frame.

[0073] Optionally, step 402 may specifically be: when all of the second time frames are before the first time frame, and the second number of consecutive second time frames is not less than a target threshold, detecting the first number of consecutive first time frames; and when the first number is not less than the target threshold, determining the construction information of the number of floors of the current floor of the construction site that indicates the completion of construction.

[0074] In this embodiment, the target threshold value can be N, and this embodiment can be based on the preset conditions provided in the above embodiment: after the target process in which the construction image is located is not detected for N consecutive times, the target process in which the construction image is located is detected for N consecutive times, and then the construction information of the number of floors of the current floor of the construction site is determined to be completed. Among them, N can be a value such as 3 times, 4 times or 5 times, and can be set according to the time required for the actual process, and no specific limitation is made here. In this way, through the method provided by this embodiment, it can be determined whether the construction process of the construction site has completed a round, so as to determine whether the construction site has completed the construction of the current floor, and record this information when it is determined that the construction of the current floor is completed, so as to facilitate the management of the construction site.

[0075] Step 403, adding the construction information to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site.

[0076] Specifically, the historical construction information provided in this embodiment may be the cumulative number of completed floors M, and the construction information may be the number of the currently completed floor, and the current construction progress information is the number of floors M+1.

[0077] In this way, by cyclically repeating the construction image processing method provided in this embodiment, the floor count of the construction site can be managed continuously, efficiently and accurately. No manual recording is required during the process. Only with the help of high-altitude cameras, the floor changes can be recorded continuously, quickly and accurately, providing important data support and analysis for construction management.

[0078] As an optional embodiment, in order to prevent erroneous updates of floors, this embodiment can stop the preset target time each time after obtaining the current construction progress information of the construction site, and then re-execute the construction image processing method provided by this embodiment. Specifically, after the step of adding the construction information to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site, the construction image processing method provided by this embodiment can also include: within the preset target time, stop using the high-altitude camera to collect construction images of the construction site, and stop calling the trained target detection model to detect and process the target objects in the construction images of each time frame.

[0079] It should be noted that the preset target time provided in this embodiment can be 12 hours, 24 hours, 36 hours, etc. The specific time value can be set according to the time required to complete a specific process, and no specific limitation is made here.

[0080] At this point, the entire description of the construction image processing method provided by this embodiment is completed.

[0081] In summary, the construction image processing method provided by this embodiment includes continuously collecting construction images of the construction site through a high-altitude camera at the construction site, analyzing and processing the construction images containing time frames collected by the high-altitude camera at first time intervals, obtaining multiple target results, and determining the first time frame corresponding to the construction image when the target result is the first result and the second time frame corresponding to the construction image when the target result is the second result according to the multiple target results, and determining the current construction progress information of the construction site based on the first time frame and the second time frame. By adopting the embodiment of the present invention, it is possible to realize automatic and efficient counting of building floors, thereby improving the management efficiency of the floor construction progress.

[0082] According to the method described in the above embodiment, this embodiment will be further described from the perspective of a construction image processing device. The construction image processing device can be implemented as an independent entity or integrated into an electronic device, such as a terminal. The terminal may include a mobile phone, a tablet computer, etc.

[0083] In order to solve the same technical problem, this embodiment also provides a construction image processing device. Figure 5 , Figure 5 is a schematic diagram of a structure of a construction image processing device provided by an embodiment of the present invention, such as Figure 5 As shown, the construction image processing device 500 specifically includes: a collection module 501, a sharing module 502, a first determination module 503 and a second determination module 504;

[0084] The acquisition module 501 is used to continuously acquire construction images of the construction site through a high-altitude camera at the construction site.

[0085] The analysis module 502 is used to analyze and process the construction image containing the time frame collected by the aerial camera at every first time interval to obtain multiple target results.

[0086] In this embodiment, the analysis module 502 provided in this embodiment is specifically used to: obtain the construction image containing the time frame captured by the aerial camera at every first time interval; call the trained target detection model to detect the target object in the construction image of each time frame, obtain multiple detection results, and use the detection results as the target results.

[0087] Among them, the analysis module 502 provided in this embodiment is specifically used to: detect and process the target object in the construction image of each time frame to obtain a first result that the construction image contains the target object and a second result that the construction image does not contain the target object.

[0088] The first determination module 503 is used to determine, based on the multiple target results, a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result.

[0089] The second determining module 504 is used to determine the current construction progress information of the construction site based on the first time frame and the second time frame.

[0090] In this embodiment, the second determination module 504 provided in this embodiment is specifically used to: determine a first number of consecutive first time frames and a second number of consecutive second time frames based on the first time frame and the second time frame; determine the construction information of the number of floors of the current floor of the construction site that has been completed according to the first number, the second number, and the sequence relationship between the first time frame and the second time frame; add the construction information to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site.

[0091] Specifically, the second determination module 504 provided in this embodiment is also specifically used for: when all of the second time frames are before the first time frame, and the second number of consecutive second time frames is not less than the target threshold, detecting the first number of consecutive first time frames; and when the first number is not less than the target threshold, determining the construction information of the number of floors of the current floor of the construction site that has been completed.

[0092] Optionally, the construction image processing device provided in this embodiment further includes a training module and a prevention module;

[0093] Among them, the training module is used to obtain a target detection data set, which includes multiple training images and annotation data. The training images are construction images of construction sites taken from high altitudes, and the annotation data are data after the target objects in the training images are annotated; the target detection data set is used to train the detection model to be trained until convergence, so as to obtain a trained target detection model.

[0094] The prevention module is used to stop using the high-altitude camera to collect construction images of the construction site within a preset target time, and stop calling the trained target detection model to detect and process the target objects in the construction images of each time frame.

[0095] During specific implementation, the above modules and / or units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above modules and / or units can refer to the previous method embodiments. The specific beneficial effects that can be achieved can also refer to the beneficial effects in the previous method embodiments, which will not be repeated here.

[0096] Also, see Figure 6 , Figure 6 1 is a schematic diagram of a structure of an electronic device provided by an embodiment of the present invention, and the electronic device may be a mobile terminal such as a smart phone, a tablet computer, or the like. Figure 6 As shown, the electronic device 600 includes a processor 601 and a memory 602. The processor 601 is electrically connected to the memory 602.

[0097] The processor 601 is the control center of the electronic device 600. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device 600 and processes data by running or loading applications stored in the memory 602 and calling data stored in the memory 602, thereby monitoring the electronic device 600 as a whole.

[0098] In this embodiment, the processor 601 in the electronic device 600 will load the instructions corresponding to the processes of one or more applications into the memory 602 according to the following steps, and the processor 601 will run the applications stored in the memory 602, thereby realizing the various functions that can be realized in the above embodiments.

[0099] The electronic device 600 can implement the steps in any embodiment of the construction image processing method provided in the embodiments of the present invention. Therefore, it can achieve the beneficial effects that can be achieved by any construction image processing method provided in the embodiments of the present invention. Please refer to the previous embodiments for details and will not be repeated here.

[0100] See also Figure 7 , Figure 7 is another structural diagram of an electronic device provided by an embodiment of the present invention, such as Figure 7 As shown, Figure 7 The electronic device 700 is a block diagram of a specific structure of an electronic device provided by an embodiment of the present invention, and the electronic device can be used to implement the construction image processing method provided in the above embodiment. The electronic device 700 can be a mobile terminal such as a smart phone or a laptop computer.

[0101] The RF circuit 710 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The RF circuit 710 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity module (SIM) cards, memories, etc. The RF circuit 710 can communicate with various networks such as the Internet, corporate intranets, wireless networks, or communicate with other devices through wireless networks. The above-mentioned wireless networks may include cellular telephone networks, wireless local area networks, or metropolitan area networks. The above-mentioned wireless networks can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (such as Institute of Electrical and Electronics Engineers standards IEEE 802.11a, IEEE 802.11b, IEEE802.11g and / or IEEE802.11n), Voice over Internet Protocol (VoIP), Worldwide Interoperability for Microwave Access (Wi-Max), other protocols for email, instant messaging and short messages, and any other suitable communication protocols, even those that have not yet been developed.

[0102] The memory 720 can be used to store software programs and modules, such as the program instructions / modules corresponding to the construction image processing method in the above-mentioned embodiment. The processor 780 executes various functional applications and construction image processing by running the software programs and modules stored in the memory 720, that is, realizes the various functions that can be realized in the above-mentioned embodiment.

[0103] The memory 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 720 may further include a memory remotely arranged relative to the processor 780, and these remote memories may be connected to the electronic device 700 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0104] The input unit 730 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 730 may include a touch-sensitive surface 731 and other input devices 732. The touch-sensitive surface 731, also known as a touch display screen or touch pad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 731), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 731 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 780, and can receive and execute commands sent by the processor 780. In addition, the touch-sensitive surface 731 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 731, the input unit 730 may further include other input devices 732. Specifically, the other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0105] The display unit 740 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device 700, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 740 may include a display panel 741, and optionally, the display panel 741 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 731 may cover the display panel 741, and when the touch-sensitive surface 731 detects a touch operation on or near it, it is transmitted to the processor 780 to determine the type of the touch event, and then the processor 780 provides corresponding visual output on the display panel 741 according to the type of the touch event. Although in the figure, the touch-sensitive surface 731 and the display panel 741 are implemented as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface 731 and the display panel 741 can be integrated to implement input and output functions.

[0106] The electronic device 700 may also include at least one sensor 750, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 741 according to the brightness of the ambient light, and the proximity sensor may generate an interrupt when the flip cover is closed or closed. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the electronic device 700, they will not be repeated here.

[0107] The audio circuit 760, the speaker 761, and the microphone 762 can provide an audio interface between the user and the electronic device 700. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, which is converted into a sound signal for output; on the other hand, the microphone 762 converts the collected sound signal into an electrical signal, which is received by the audio circuit 760 and converted into audio data, and then the audio data is output to the processor 780 for processing, and then sent to another terminal through the RF circuit 710, or the audio data is output to the memory 720 for further processing. The audio circuit 760 may also include an earplug jack to provide communication between an external headset and the electronic device 700.

[0108] The electronic device 700 can help the user receive requests, send information, etc. through the transmission module 770 (such as a Wi-Fi module), which provides the user with wireless broadband Internet access. Although the transmission module 770 is shown in the figure, it is understandable that it is not a necessary component of the electronic device 700 and can be omitted as needed without changing the essence of the invention.

[0109] The processor 780 is the control center of the electronic device 700. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 720, and calling data stored in the memory 720, it executes various functions of the electronic device 700 and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 780 may include one or more processing cores; in some embodiments, the processor 780 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 780.

[0110] The electronic device 700 also includes a power supply 790 (such as a battery) for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 780 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 790 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0111] Although not shown, the electronic device 700 also includes a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the display unit of the electronic device is a touch screen display, and the mobile terminal also includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors to include various functions that can be implemented in the above embodiments.

[0112] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0113] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. To this end, an embodiment of the present invention provides a storage medium, which stores multiple instructions, and the instructions can be loaded by a processor to execute the steps of any embodiment of the construction image processing method provided in the embodiment of the present invention.

[0114] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0115] Since the instructions stored in the storage medium can execute the steps in any embodiment of the construction image processing method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any construction image processing method provided in the embodiments of the present invention can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0116] The above is a detailed introduction to a construction image processing method, device, equipment and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application. Moreover, for those of ordinary skill in the art, without departing from the principles of the present invention, several improvements and modifications can be made, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A construction image processing method, characterized in that: include: Continuously collecting construction images of the construction site through a high-altitude camera at the construction site; At every first time interval, analyzing and processing the construction image including the time frame collected by the high-altitude camera to obtain multiple target results; According to the plurality of target results, determining a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result; Based on the first time frame and the second time frame, current construction progress information of the construction site is determined.

2. The construction image processing method according to claim 1, characterized in that: The step of analyzing and processing the construction image containing the time frame collected by the aerial camera at every first time interval to obtain multiple target results includes: At every first time interval, acquiring the construction image including the time frame collected by the high-altitude camera; The trained target detection model is called to detect the target object in the construction image of each time frame to obtain multiple detection results, and the detection results are used as target results.

3. The construction image processing method according to claim 2, characterized in that: The step of detecting and processing the target object in the construction image of each time frame to obtain multiple detection results includes: The target object in the construction image of each time frame is detected and processed to obtain a first result indicating that the construction image contains the target object and a second result indicating that the construction image does not contain the target object.

4. The construction image processing method according to claim 2, characterized in that: Before the step of calling the trained target detection model to detect the target object in the construction image of each time frame to obtain a plurality of detection results, the construction image processing method further includes: Acquire a target detection data set, wherein the target detection data set includes a plurality of training images and annotation data, wherein the training images are construction images of a construction site taken from a high altitude, and the annotation data are data after the target objects in the training images are annotated; The target detection data set is used to train the detection model to be trained until convergence, thereby obtaining a trained target detection model.

5. The construction image processing method according to claim 3, characterized in that: The step of determining the current construction progress information of the construction site based on the first time frame and the second time frame includes: determining a first number of consecutive first time frames and a second number of consecutive second time frames based on the first time frame and the second time frame; Determine the construction information of the number of floors of the current floor of the construction site that has been completed according to the first number, the second number, and the sequence relationship between the first time frame and the second time frame; The construction information is added to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site.

6. The construction image processing method according to claim 5, characterized in that: The step of determining the construction information of the number of floors of the current floor of the construction site completed according to the first number, the second number, and the sequence relationship between the first time frame and the second time frame includes: When all of the second time frames are before the first time frame and a second number of consecutive second time frames is not less than a target threshold, detecting a first number of consecutive first time frames; In a case where the first number is not less than the target threshold, construction information of the number of floors of the current floor of the construction site having been completed is determined.

7. The construction image processing method according to claim 5, characterized in that: After the step of adding the construction information to the historical construction information corresponding to the number of floors completed at the construction site to obtain the current construction progress information of the construction site, the construction image processing method further includes: Within the preset target time, stop using the high-altitude camera to collect construction images of the construction site, stop calling the trained target detection model, and detect and process the target objects in the construction images of each time frame.

8. A construction image processing device, characterized in that: include: A collection module, used to continuously collect construction images of the construction site through a high-altitude camera at the construction site; An analysis module, configured to analyze and process the construction image including the time frame collected by the aerial camera at every first time interval to obtain a plurality of target results; A first determination module, configured to determine, based on the plurality of target results, a first time frame corresponding to the construction image when the target result is a first result, and a second time frame corresponding to the construction image when the target result is a second result; The second determining module is used to determine the current construction progress information of the construction site based on the first time frame and the second time frame.

9. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the memory is coupled to the processor, and when the processor executes the computer program, the steps in the construction image processing method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the steps in the construction image processing method according to any one of claims 1 to 7.

Images