Inspection quality monitoring method and system for movable sentry robot

Abstract

The invention discloses an inspection quality monitoring method and system for a movable sentinel robot, and the method comprises the steps: firstly obtaining a current construction image shot by the movable sentinel robot in a project detection region and a timestamp of the current construction image; secondly, matching a construction type according to the current construction image; then, according to the construction type corresponding to the current construction image, obtaining a construction completion image corresponding to the construction type; and finally, obtaining the construction progress and the construction quality according to the difference between the current construction image and the completion construction image. According to the invention, an image processing part is integrated in the movable sentinel robot, and the real-time construction progress of each region of the construction site can be known by using the real-time image shot by the movable sentinel robot, so that the manpower of construction supervision can be effectively saved, the workload of a project manager is reduced, and the construction efficiency is improved. And the efficiency of construction management and supervision is improved.

Description

Technical Field

[0001] The present invention relates to the field of information processing technology, and in particular to a patrol quality monitoring method and system for a mobile sentinel robot. Background Art

[0002] With the development of informatization, modern and advanced technologies are also used to manage construction project sites. At present, most construction sites have mobile sentinel robots, which generally shuttle around the project site and are responsible for some basic tasks such as attendance of workers on the site.

[0003] In the project, the progress and quality of the project are also an important checkpoint that needs to be strictly checked. These often require the project manager to personally go to each project port to verify and then determine the construction progress of the project. Obviously, the construction progress obtained in this way is less efficient, and requires the project manager to have sufficient time and extensive and exquisite skills. At the same time, it is impossible to guarantee the real-time progress follow-up, resulting in inefficiency. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a patrol quality monitoring method and system for a mobile sentinel robot in view of the deficiencies in the above-mentioned prior art, so as to solve the problems raised in the above-mentioned background technology.

[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is: a patrol quality monitoring method of a mobile sentinel robot, comprising the following steps:

[0006] Step 1: Obtain a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image;

[0007] Step 2: Matching the construction type according to the current construction image;

[0008] Step 3: According to the construction type corresponding to the current construction image, obtain a completed construction image corresponding to the construction type;

[0009] Step 4: Obtain construction progress and construction quality according to the difference between the current construction image and the completed construction image.

[0010] Further, in step 2, matching the construction type according to the current construction image includes:

[0011] According to the current construction image, extracting the construction objects therein in advance by using an image object extraction method;

[0012] According to the construction object, determining the construction type corresponding to the current construction image by querying a construction type database;

[0013] The construction type database is used to store construction types and construction items corresponding to the construction types.

[0014] Further, in step 3, obtaining the completed construction image corresponding to the construction type according to the construction type corresponding to the current construction image includes:

[0015] In the pre-built BIM model, it is divided into various construction sub-items, and the construction type corresponding to the construction sub-item is obtained according to the construction items in each of the construction sub-items;

[0016] Retrieving the completed construction images of each of the construction sub-items after the project is completed in the pre-built BIM model, and making each of the construction sub-items correspond to the completed construction images;

[0017] According to the construction type corresponding to the current construction image, the corresponding construction sub-item and the completed construction image corresponding to the construction sub-item are obtained.

[0018] Further, in step 4, obtaining the construction progress and construction quality according to the difference between the current construction image and the completed construction image includes:

[0019] The construction achievements in the current construction image and the completed construction image are respectively extracted by an image object extraction method;

[0020] Comparing the construction results in the current construction image and the completed construction image to obtain a result difference;

[0021] The construction progress is obtained according to the difference in the results;

[0022] The shape and color of the construction results in the current construction image are recognized to obtain the construction quality.

[0023] Furthermore, the construction results in the current construction image and the completed construction image are compared to obtain the result difference, including:

[0024] Extracting the shape and color of the construction results in the current construction image, and extracting the shape and color of the construction results in the completed construction image;

[0025] Comparing the shape of the construction result in the current construction image with the shape of the construction result in the completed construction image to obtain a shape difference therebetween;

[0026] Comparing the color of the construction results in the current construction image with the color of the construction results in the completed construction image to obtain a color difference therebetween;

[0027] The shape difference and the color difference are output as the result difference.

[0028] Furthermore, obtaining the construction progress according to the achievement difference includes:

[0029] Decomposing the result difference into the shape difference and the color difference;

[0030] Obtaining a construction progress range according to the shape differences;

[0031] The construction progress is determined within the progress range according to the color difference.

[0032] Further, after step 4, the method further includes:

[0033] The construction progress and construction quality are sent to the client for display.

[0034] Based on the same inventive concept, the present invention also proposes a patrol quality monitoring system of a mobile sentinel robot, comprising:

[0035] An image acquisition module, used to acquire a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image;

[0036] A construction type module, used for matching the construction type according to the current construction image;

[0037] A completion image module, used for obtaining a completion image of a construction type corresponding to the construction type corresponding to the current construction image;

[0038] The construction progress module is used to obtain the construction progress and construction quality according to the difference between the current construction image and the completed construction image.

[0039] Compared with the prior art, the present invention has the following advantages:

[0040] The present invention provides a patrol quality monitoring method and system of a mobile sentinel robot, which processes images taken by the mobile sentinel robot to obtain the construction type, and combines the current taken image with the image after the construction is completed to compare, thereby obtaining the construction progress and construction quality. Therefore, the present invention integrates an image processing part in the mobile sentinel robot, and utilizes the real-time images taken by the mobile sentinel robot to understand the real-time construction progress of various areas on the construction site, which can effectively save manpower for construction supervision, reduce the workload of project managers, and improve the efficiency of construction management and supervision.

[0041] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic block diagram of the overall process of an inspection quality monitoring method for a mobile sentinel robot provided by the present invention.

[0043] Figure 2 A schematic diagram of the overall structure of an inspection quality monitoring system for a mobile sentinel robot provided by the present invention. DETAILED DESCRIPTION

[0044] like Figure 1 As shown, the present invention provides a patrol quality monitoring method of a mobile sentinel robot, comprising the following steps:

[0045] Step 1: Obtain a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image;

[0046] Step 2: Matching the construction type according to the current construction image;

[0047] Step 3: According to the construction type corresponding to the current construction image, obtain a completed construction image corresponding to the construction type;

[0048] Step 4: Obtain construction progress and construction quality according to the difference between the current construction image and the completed construction image.

[0049] In step 1, when the mobile sentinel robot is inspecting the construction site, because it has a camera, the camera will continuously shoot, obtain the images taken at each moment, and stamp them with timestamps. Therefore, step 1 directly extracts the current construction image taken by the mobile sentinel robot in the project detection area and the timestamp of the current construction image, and the current image of the project detection area can be obtained.

[0050] The project detection area in the present invention is the area where the construction progress report is to be conducted, such as the main body construction of the house, the ground cement hardening construction, etc.

[0051] In step 2, matching the construction type according to the current construction image includes:

[0052] According to the current construction image, extracting the construction objects therein in advance by using an image object extraction method;

[0053] According to the construction object, determining the construction type corresponding to the current construction image by querying a construction type database;

[0054] The construction type database is used to store construction types and construction items corresponding to the construction types.

[0055] Step 2 of the present invention is to obtain the type of construction, that is, to determine which project site is photographed by the mobile robot in the construction site, and to determine it by the construction type. The above-mentioned main body construction of the house, ground cement hardening construction, etc. all belong to the construction type described in the present invention.

[0056] The present invention extracts objects from the image and determines the construction type according to the objects. Construction objects are some necessary devices and objects during construction, such as the structure of the house when the main body of the house is under construction. In other words, the construction objects of the present invention are equivalent to the characteristics of the construction site, such as the structure of the house, the number of floors the house has been built to, etc.

[0057] In step 3, obtaining a completed construction image corresponding to the construction type according to the construction type corresponding to the current construction image includes:

[0058] In the pre-built BIM model, it is divided into various construction sub-items, and the construction type corresponding to the construction sub-item is obtained according to the construction items in each of the construction sub-items;

[0059] Retrieving the completed construction images of each of the construction sub-items after the project is completed in the pre-built BIM model, and making each of the construction sub-items correspond to the completed construction images;

[0060] According to the construction type corresponding to the current construction image, the corresponding construction sub-item and the completed construction image corresponding to the construction sub-item are obtained.

[0061] In step 3, the present invention uses a pre-built BIM model, which is a model composed of the status of the entire project site at different time nodes. Therefore, the present invention divides the BIM model into multiple construction sub-items, each of which corresponds to the above-mentioned current construction image according to the construction type, and extracts the construction sub-items corresponding to each construction type and the construction completion image corresponding to the construction sub-item, and then corresponds the current construction image to the expected construction image, so that the image of the current construction type after the construction is completed can be obtained for subsequent comparison.

[0062] In step 4, obtaining the construction progress and construction quality according to the difference between the current construction image and the completed construction image includes:

[0063] The construction achievements in the current construction image and the completed construction image are respectively extracted by an image object extraction method;

[0064] Comparing the construction results in the current construction image and the completed construction image to obtain a result difference;

[0065] The construction progress is obtained according to the difference in the results;

[0066] The shape and color of the construction results in the current construction image are recognized to obtain the construction quality.

[0067] The present invention uses two images, namely the current construction image and the completed construction image. By comparing the two images, the construction progress can be obtained, and by processing the current image, the construction quality can be obtained.

[0068] The step of comparing the construction results in the current construction image and the completed construction image to obtain a result difference includes:

[0069] Extracting the shape and color of the construction results in the current construction image, and extracting the shape and color of the construction results in the completed construction image;

[0070] Comparing the shape of the construction result in the current construction image with the shape of the construction result in the completed construction image to obtain a shape difference therebetween;

[0071] Comparing the color of the construction results in the current construction image with the color of the construction results in the completed construction image to obtain a color difference therebetween;

[0072] The shape difference and the color difference are output as the result difference.

[0073] When obtaining the difference in results, the present invention makes full use of the before-after comparison of the construction results, determines the range of progress from the shape, such as 0-10%, and determines the specific value by color, such as 8% of 0-10%, so that the progress of the construction can be accurately obtained.

[0074] Therefore, the construction progress obtained according to the difference in the results includes:

[0075] Decomposing the result difference into the shape difference and the color difference;

[0076] Obtaining a construction progress range according to the shape differences;

[0077] The construction progress is determined within the progress range according to the color difference.

[0078] When the present invention recognizes the shape and color of the construction results in the current construction image and obtains the construction quality, the shape and color of the construction results in the current construction image are compared with the standard of the current degree, so that the quality of the construction can be obtained. The current degree of construction is obtained according to the progress of the construction, and the current degree and the construction progress are in a positive linear relationship.

[0079] After step 4, the present invention further comprises:

[0080] The construction progress and construction quality are sent to the client for display.

[0081] This method of the present invention displays the progress of the construction on the client, which can be placed on the mobile client of the project manager or displayed in the central control monitored by the company, so that the project managers can quickly obtain the construction status and progress.

[0082] Based on the inventive concept of the above method, the present invention also provides a patrol quality monitoring system of a mobile sentinel robot based on the above method, such as Figure 2 As shown, including:

[0083] An image acquisition module, used to acquire a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image;

[0084] A construction type module, used for matching the construction type according to the current construction image;

[0085] A completion image module, used for obtaining a completion image of a construction type corresponding to the construction type corresponding to the current construction image;

[0086] The construction progress module is used to obtain the construction progress and construction quality according to the difference between the current construction image and the completed construction image.

[0087] The above modules cooperate with each other to complete the steps of the above method. Among them, the steps after step 4 are executed by the user display module.

[0088] The user display module is used to send the construction progress and construction quality to the client for display.

[0089] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any way. Any simple modification, change and equivalent structural change made to the above embodiment based on the technical essence of the present invention still falls within the protection scope of the technical solution of the present invention.

Claims

1. A method for monitoring the inspection quality of a mobile sentinel robot, characterized in that: The following steps are involved: Step 1: Obtain a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image; Step 2: Matching the construction type according to the current construction image; Step 3: According to the construction type corresponding to the current construction image, obtain a completed construction image corresponding to the construction type; Step 4: Obtain construction progress and construction quality according to the difference between the current construction image and the completed construction image.

2. A patrol quality monitoring method for a mobile sentinel robot according to claim 1, characterized in that: In step 2, matching the construction type according to the current construction image includes: According to the current construction image, extracting the construction objects therein in advance by using an image object extraction method; According to the construction object, determining the construction type corresponding to the current construction image by querying a construction type database; The construction type database is used to store construction types and construction items corresponding to the construction types.

3. The inspection quality monitoring method of a mobile sentinel robot according to claim 1, characterized in that: In step 3, obtaining a completed construction image corresponding to the construction type according to the construction type corresponding to the current construction image includes: In the pre-built BIM model, it is divided into various construction sub-items, and the construction type corresponding to the construction sub-item is obtained according to the construction items in each of the construction sub-items; Retrieving the completed construction images of each of the construction sub-items after the project is completed in the pre-built BIM model, and making each of the construction sub-items correspond to the completed construction images; According to the construction type corresponding to the current construction image, the corresponding construction sub-item and the completed construction image corresponding to the construction sub-item are obtained.

4. A method for monitoring inspection quality of a mobile sentinel robot according to claim 1, characterized in that: In step 4, obtaining the construction progress and construction quality according to the difference between the current construction image and the completed construction image includes: The construction achievements in the current construction image and the completed construction image are respectively extracted by an image object extraction method; Comparing the construction results in the current construction image and the completed construction image to obtain a result difference; The construction progress is obtained according to the difference in the results; The shape and color of the construction results in the current construction image are recognized to obtain the construction quality.

5. A method for monitoring inspection quality of a mobile sentinel robot according to claim 4, characterized in that: The comparing the construction results in the current construction image and the completed construction image to obtain the result difference includes: Extracting the shape and color of the construction results in the current construction image, and extracting the shape and color of the construction results in the completed construction image; Comparing the shape of the construction result in the current construction image with the shape of the construction result in the completed construction image to obtain a shape difference therebetween; Comparing the color of the construction results in the current construction image with the color of the construction results in the completed construction image to obtain a color difference therebetween; The shape difference and the color difference are output as the result difference.

6. A method for monitoring the inspection quality of a mobile sentinel robot according to claim 6, characterized in that: The construction progress is obtained according to the difference in the results, including: Decomposing the result difference into the shape difference and the color difference; Obtaining a construction progress range according to the shape differences; The construction progress is determined within the progress range according to the color difference.

7. A method for monitoring inspection quality of a mobile sentinel robot according to claim 1, characterized in that: After step 4, it also includes: The construction progress and construction quality are sent to the client for display.

8. A patrol quality monitoring system for a mobile sentinel robot, characterized in that: include: An image acquisition module, used to acquire a current construction image taken by the mobile sentinel robot in the project detection area and a timestamp of the current construction image; A construction type module, used for matching the construction type according to the current construction image; A completion image module, used for obtaining a completion image of a construction type corresponding to the construction type corresponding to the current construction image; The construction progress module is used to obtain the construction progress and construction quality according to the difference between the current construction image and the completed construction image.

Images