Construction scene deviation determination method and device

Abstract

The embodiment of the application provides a construction scene deviation determination method and device, the method comprises the following steps: acquiring a panoramic image of a target construction site and a building design drawing of the target construction site; determining a first feature point set on the building design drawing, and determining a second feature point set on the panoramic image; processing the panoramic image according to the first feature point set, the second feature point set and the building design drawing to generate an orthographic panoramic image; comparing the orthographic panoramic image with the building design drawing to determine a construction scene deviation. It can be seen that, by implementing this embodiment, the construction scene deviation can be automatically determined according to the construction image log and the building design drawing, so that the determination error of the construction scene deviation is reduced, and the determination efficiency of the construction scene deviation is improved.

Description

Technical Field

[0001] This application relates to the field of building construction, and more specifically, to a method and apparatus for determining deviations in construction scenarios. Background Technology

[0002] With the rapid development of the construction industry, more and more technologies are being applied to the construction field, providing great convenience for workers. Among these, the combination of surveillance video and architectural design drawings allows workers to more easily and accurately grasp the current construction situation. However, in practice, it has been found that there is usually a significant discrepancy between the scene information captured by surveillance video and the architectural design drawings. This forces workers to spend a considerable amount of time and energy confirming the construction situation, resulting in increased errors and decreased efficiency. Summary of the Invention

[0003] The purpose of this application is to provide a method and apparatus for determining construction scene deviations, which can automatically determine construction scene deviations based on construction image logs and architectural design drawings, thereby reducing the error in determining construction scene deviations and improving the efficiency of determining construction scene deviations.

[0004] The first aspect of this application provides a method for determining deviations in a construction scenario, including:

[0005] Obtain panoramic images of the target construction site and architectural design drawings of the target construction site;

[0006] A first set of feature points is determined on the architectural design drawings, and a second set of feature points is determined on the panoramic image;

[0007] The panoramic image is processed based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panoramic image.

[0008] In the above implementation process, this method can first collect construction image logs daily using image acquisition devices at the construction site, forming historical construction image log data; then, it generates panoramic images based on this historical construction image log data, allowing the method to compare the panoramic images with the architectural construction drawings to determine the deviation between the construction scene and the architectural construction drawings. It is evident that implementing this method can reduce the error in determining the deviation of the construction scene and improve the efficiency of determining the deviation.

[0009] Furthermore, the step of acquiring the panoramic image of the target construction site and the architectural design drawings of the target construction site includes:

[0010] Obtain the image logs of the target construction site and the architectural design drawings of the target construction site;

[0011] The image log is processed to obtain a panoramic image.

[0012] Further, the step of processing the panoramic image based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panorama includes:

[0013] The panoramic image is processed based on the first feature point set and the second feature point set to generate a panoramic orthorectified image;

[0014] The panoramic orthorectified image is processed according to the architectural design drawings to obtain an orthorectified panoramic image.

[0015] Further, the step of processing the panoramic orthorectified image based on the architectural design drawings to obtain the orthorectified panoramic image includes:

[0016] Calculate the reference scale of the architectural design drawings;

[0017] Calculate the calibration ratio of the panoramic orthophoto calibration map;

[0018] The panoramic orthophoto calibration image is processed according to the reference scale and the calibration scale to obtain an orthophoto panoramic image.

[0019] Further, the step of calculating the calibration ratio of the panoramic orthophoto calibration map includes:

[0020] Determine the first target line segment;

[0021] Determine the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map;

[0022] Calculate the length of the first target line segment in three-dimensional space;

[0023] The calibration ratio of the panoramic orthophoto calibration image is calculated based on the target line segment length and the first pixel coordinates.

[0024] Further, the two line segment endpoints include a first endpoint and a second endpoint, wherein the step of determining the first pixel coordinates of the two line segment endpoints of the first target line segment on the panoramic orthophoto calibration map includes:

[0025] A first wide-angle image containing the first endpoint and a second wide-angle image containing the second endpoint are determined based on the panoramic orthophoto calibration image.

[0026] Calculate the pixel coordinates of the first endpoint on the first wide-angle image;

[0027] Calculate the pixel coordinates of the second endpoint on the second wide-angle image;

[0028] Obtain the first transformation matrix from the first wide-angle image to the panoramic orthorectified image;

[0029] Obtain the second transformation matrix from the second wide-angle image to the panoramic orthorectified image;

[0030] Based on the first transformation matrix and the pixel coordinates of the first endpoint, calculate the first pixel coordinates of the first endpoint on the panoramic orthophoto calibration map;

[0031] Based on the second transformation matrix and the pixel coordinates of the second endpoint, calculate the first pixel coordinates of the second endpoint on the panoramic orthophoto calibration map.

[0032] Furthermore, after processing the panoramic image based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panorama, the process further includes:

[0033] By comparing the orthophoto panoramic image with the architectural design drawings, the deviation of the construction scene is determined.

[0034] A second aspect of this application provides a construction scene deviation determination device, the construction scene deviation determination device comprising:

[0035] The acquisition unit is used to acquire a panoramic image of the target construction site and the architectural design drawings of the target construction site;

[0036] A determining unit is used to determine a first set of feature points on the architectural design drawings and a second set of feature points on the panoramic image;

[0037] The calibration unit is used to process the panoramic image based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panoramic image.

[0038] In the above implementation process, the device can prioritize acquiring panoramic images, and then compare the panoramic images with the architectural construction drawings to obtain the construction scene deviation. It is evident that implementing this method can automatically determine the construction scene deviation between the construction scene and the architectural construction drawings during the construction process, thereby reducing the error in determining the construction scene deviation and improving the efficiency of determining the construction scene deviation.

[0039] A third aspect of this application provides an electronic device, including a memory and a processor. The memory stores a computer program, and the processor runs the computer program to cause the electronic device to perform the construction scene deviation determination method described in any one of the first aspects of this application.

[0040] The fourth aspect of this application provides a computer-readable storage medium storing computer program instructions, which, when read and executed by a processor, perform the construction scene deviation determination method described in any one of the first aspects of this application. Attached Figure Description

[0041] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 A flowchart illustrating a method for determining deviations in a construction scenario, provided in an embodiment of this application;

[0043] Figure 2 A flowchart illustrating another method for determining construction scenario deviations provided in this application embodiment;

[0044] Figure 3 This is a schematic diagram of the structure of a construction scene deviation determination device provided in an embodiment of this application;

[0045] Figure 4 This is a schematic diagram of another construction scenario deviation determination device provided in an embodiment of this application;

[0046] Figure 5 This is a schematic diagram illustrating the generation process of an orthophoto panoramic image provided in an embodiment of this application. Detailed Implementation

[0047] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0048] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0049] Example 1

[0050] Please refer to Figure 1 , Figure 1 This application provides a flowchart illustrating a method for determining construction scene deviations. The method includes:

[0051] S101. Obtain panoramic images of the target construction site and architectural design drawings of the target construction site.

[0052] As an optional implementation, this method can pre-acquire image logs of the target construction site, and use image algorithms to stitch together multiple wide-angle images from the site image logs to form a panoramic image. This panoramic image can be labeled M0.

[0053] As another optional implementation, this method can pre-acquire original images of the target construction site captured by an ultra-wide-angle camera, and then use image algorithms to perform distortion correction and other processing on the original images to form a panoramic image M0. This application does not limit the method of acquiring the panoramic image.

[0054] In this embodiment, the architectural design drawings are the CAD design drawings of the target construction site.

[0055] S102. Determine the first set of feature points on the architectural design drawings and the second set of feature points on the panoramic image.

[0056] In this embodiment, the first feature point set and the second feature point set correspond to each other.

[0057] For example, this method can calculate the A0, B0, C0, and D0 feature points in a CAD design drawing based on a pre-defined feature point extraction method, and simultaneously determine the corresponding A, B, C, and D feature points in the panoramic image M0.

[0058] S103. Process the panoramic image based on the first feature point set, the second feature point set, and the architectural design drawings to generate an orthophoto panoramic image.

[0059] In this embodiment, the method performs a first calibration on the panoramic image based on a first set of feature points and a second set of feature points to obtain a panoramic orthorectified image. This panoramic orthorectified image can be labeled M1. Then, the panoramic orthorectified image is calibrated a second time based on the architectural design drawings to obtain an orthorectified panoramic image.

[0060] In this embodiment, during the first calibration, the panoramic image M0 is calibrated using the correspondence between the CAD design drawings and multiple feature points in the panoramic image M0. The resulting panoramic orthorectified calibration image M1 eliminates the horizontal errors in the panoramic image caused by factors such as the non-horizontal installation posture of the image acquisition device and the posture estimation error of the panoramic image synthesis algorithm, and aligns the orientation of the panoramic orthorectified calibration image M1 with that of the CAD design drawings. However, the above steps may also cause a large error in the ratio of pixels to physical size in the panoramic orthorectified calibration image M1. Therefore, a second calibration is needed to obtain the orthorectified panoramic image based on the reference ratio of the CAD design drawings. The orthorectified panoramic image and the CAD design drawings have the same ratio and the same orientation.

[0061] S104. Compare the orthophoto panoramic view with the architectural design drawings to determine the deviation of the construction scene.

[0062] In this embodiment, the method can overlay panoramic orthophotos and CAD design drawings to compare the construction scene deviations between the construction scene and the CAD design drawings.

[0063] In this embodiment, the method can move and make transparent architectural design drawings, and then overlay and compare the processed architectural design drawings with the orthophoto panoramic image to obtain the construction scene deviation.

[0064] In this embodiment, the subject executing the method can be a computing device such as a computer or server, and no limitation is made in this embodiment.

[0065] In this embodiment, the subject executing the method can also be a smart device such as a smartphone or tablet, and no limitation is made in this embodiment.

[0066] As can be seen, the construction scene deviation determination method described in this embodiment can firstly collect construction image logs daily using image acquisition devices at the construction site, forming historical construction image log data; then, a panoramic image is generated based on this historical construction image log data, allowing the method to compare the panoramic image with the architectural construction drawings to determine the construction scene deviation between the two. Therefore, implementing this method can reduce the error in determining construction scene deviations and improve the efficiency of determining construction scene deviations.

[0067] Example 2

[0068] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating a method for determining deviations in a construction scenario, as provided in an embodiment of this application. Figure 2 As shown, the method for determining the deviation in this construction scenario includes:

[0069] S201. Obtain the image logs and architectural design drawings of the target construction site.

[0070] In this embodiment, the architectural design drawings are CAD design drawings.

[0071] In this embodiment, the image log consists of wide-angle images taken by a fixed-installed video measurement device at multiple pan-tilt angles of the target area of ​​the construction site. Each wide-angle image has a corresponding laser landing point, and each laser landing point can be represented by the pan-tilt angle and laser distance of the video measurement device.

[0072] S202. Process the construction site image log to obtain a panoramic image.

[0073] In this embodiment, the method uses a panoramic image synthesis algorithm to synthesize the wide-angle images contained in the above-mentioned construction site image log according to preset synthesis parameters to obtain a panoramic image M0.

[0074] S203. Determine the first set of feature points on the architectural design drawings and the second set of feature points on the panoramic image.

[0075] In this embodiment, the method first adjusts and scales the architectural design drawings to obtain adjusted architectural design drawings; then, it exports a CAD image based on the adjusted architectural design drawings. At this time, a first set of feature points is selected in the CAD image, and this first set of feature points corresponds to a second set of feature points in the panoramic image.

[0076] In this embodiment, the selection of the first set of feature points in the CAD image can be achieved using an image feature point extraction algorithm or by manual extraction, without any limitation.

[0077] In this embodiment, the second set of feature points can be determined on the panoramic image using an image feature point extraction algorithm or manually, without any limitation.

[0078] S204. Process the panoramic image based on the first feature point set and the second feature point set to generate a panoramic orthorectified image.

[0079] In this embodiment, the method uses a first set of feature points and a second set of feature points to calculate the homography matrix from the panoramic image to the CAD image, and applies the homography matrix to the panoramic image to complete the first orthophoto calibration, thereby obtaining a panoramic orthophoto calibration image.

[0080] In this embodiment, the panoramic orthorectification map eliminates the error of the orthorectified image being horizontal caused by factors such as the non-horizontal installation posture of the video measurement equipment and the posture estimation error of the panoramic image synthesis algorithm, and aligns the orientation of the panoramic orthorectification map with the CAD design drawing.

[0081] S205. Calculate the reference scale for architectural design drawings.

[0082] In this embodiment, the reference ratio is the "length / pixel" ratio of the architectural design drawings. This ratio can be calculated by the pixel distance between any two feature points on the CAD image and the spatial distance between the two feature points on the design drawings.

[0083] S206. Calculate the calibration ratio of the panoramic orthophoto calibration map.

[0084] In this embodiment, the calibration ratio is a "length / pixel" ratio, which includes the x-axis ratio fx and the y-axis ratio fy of the panoramic orthophoto calibration map.

[0085] As an optional implementation, the step of calculating the calibration scale of the panoramic orthorectified map includes:

[0086] Determine the first target line segment;

[0087] Determine the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map;

[0088] Calculate the length of the first target line segment in three-dimensional space;

[0089] The calibration ratio of the panoramic orthophoto calibration image is obtained by calculating the target line segment length and the coordinates of the first pixel.

[0090] In this embodiment, the first target line segment can be multiple line segments.

[0091] In this embodiment, the two endpoints of any first target line segment include a first endpoint and a second endpoint. As a feasible implementation, the line connecting any two laser impact points within the area contained in the architectural design drawing is selected as the first target line segment, and the two laser impact points are designated as the first endpoint and the second endpoint.

[0092] In this embodiment, the three-dimensional spatial distance between the endpoints of the two line segments can be calculated using the laser distance between the two laser landing points and the gimbal angle, and is denoted as the target line segment length of the first target line segment in three-dimensional space.

[0093] In this embodiment, the method can identify the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthorectification map and calculate the length of the first target line segment in three-dimensional space. Then, the method can calculate the "length / pixel" ratio of the panoramic orthorectification map based on the target line segment length and the first pixel coordinates of the panoramic orthorectification map. This ratio is the calibration ratio.

[0094] As a further optional implementation, the step of determining the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map includes:

[0095] Based on the panoramic orthophoto calibration map, determine a first wide-angle map containing the first endpoint and a second wide-angle map containing the second endpoint;

[0096] Calculate the pixel coordinates of the first endpoint on the first wide-angle image;

[0097] Calculate the pixel coordinates of the second endpoint on the second wide-angle image;

[0098] Obtain the first transformation matrix from the first wide-angle image to the panoramic orthorectified image;

[0099] Obtain the second transformation matrix from the second wide-angle image to the panoramic orthorectified image;

[0100] Based on the first transformation matrix and the pixel coordinates of the first endpoint, calculate the first pixel coordinates of the first endpoint on the panoramic orthophoto calibration map;

[0101] Based on the second transformation matrix and the pixel coordinates of the second endpoint, calculate the first pixel coordinates of the second endpoint on the panoramic orthophoto calibration map.

[0102] In this embodiment, the first endpoint and the second endpoint are the laser landing points when acquiring the first wide-angle image and the second wide-angle image, respectively. The pixel coordinates of the laser landing point on the wide-angle image can be calculated using existing publicly available methods for calculating the pixel coordinates of the center point of a laser spot, which will not be elaborated here.

[0103] In this embodiment, the transformation matrix from wide-angle image to panoramic image can be obtained first through a panoramic image synthesis algorithm, and then multiplied with the homography matrix from panoramic image to CAD image obtained in step S204 to obtain the transformation matrix from wide-angle image to panoramic orthorectified image.

[0104] S207. Process the panoramic orthorectified calibration map according to the reference scale and calibration scale to obtain the orthorectified panoramic map.

[0105] In this embodiment, the calibration is a secondary calibration based on the "length / pixel" ratio.

[0106] In this embodiment, the calibration scale of the panoramic orthorectified image may differ from the reference scale of the CAD design drawing. Therefore, it is necessary to scale the panoramic orthorectified image along both the x-axis and y-axis according to the reference scale to obtain the orthorectified panoramic image. The orthorectified panoramic image and the CAD design drawing have the same scale and orientation.

[0107] Please see Figure 5 , Figure 5 A schematic diagram illustrating the generation process of an orthophoto panoramic image is shown. The diagram illustrates the aforementioned embodiment, and the two complement each other.

[0108] S208. Compare the orthophoto panoramic view with the architectural design drawings to determine the deviation of the construction scene.

[0109] As can be seen, the construction scenario deviation determination method described in this embodiment can compare the construction situation on-site through a remote system; it can also automatically retrieve relevant CAD drawings for comparison based on the on-site conditions; and it can overlay CAD design drawings and on-site construction scenario diagrams using a combined algorithm to determine whether the construction conforms to the design. Therefore, implementing this method can reduce the error in determining construction scenario deviations and improve the efficiency of deviation determination.

[0110] Example 3

[0111] Please refer to Figure 3 , Figure 3 This is a structural schematic diagram of a construction scene deviation determination device provided in an embodiment of this application. Figure 3 As shown, the construction scene deviation determination device includes:

[0112] The acquisition unit 310 is used to acquire panoramic images of the target construction site and architectural design drawings of the target construction site.

[0113] The determining unit 320 is used to determine a first set of feature points on the architectural design drawings and a second set of feature points on the panoramic image;

[0114] The calibration unit 330 is used to process the panoramic image based on the first feature point set, the second feature point set, and the architectural design drawings to generate an orthophoto panoramic image.

[0115] As an optional implementation, the construction scenario deviation determination device further includes:

[0116] The comparison unit 340 is used to compare the orthophoto panoramic image with the architectural design drawings to determine the deviation of the construction scene.

[0117] In this embodiment, the explanation of the construction scene deviation determination device can be referred to the description in Embodiment 1 or Embodiment 2, and will not be repeated here.

[0118] As can be seen, the construction scene deviation determination device described in this embodiment can prioritize acquiring panoramic images, and then compare the panoramic images with the architectural construction drawings to obtain the construction scene deviation. Therefore, implementing this method can automatically determine the construction scene deviation between the construction scene and the architectural construction drawings during the construction process, thereby reducing the error in determining the construction scene deviation and improving the efficiency of determining the construction scene deviation.

[0119] Example 4

[0120] Please refer to the following: Figure 4 , Figure 4 This is a structural schematic diagram of a construction scene deviation determination device provided in an embodiment of this application. Figure 4 The construction scene deviation determination device shown is composed of Figure 3 The deviation determination device for the construction scenario shown is optimized. Figure 4 As shown, the acquisition unit 310 includes:

[0121] Acquisition subunit 311 is used to acquire the image logs and architectural design drawings of the target construction site;

[0122] The synthesis subunit 312 is used to process the image log to obtain a panoramic image.

[0123] As an optional implementation, the calibration unit 330 includes:

[0124] The first calibration subunit 331 is used to process the panoramic image according to the first feature point set and the second feature point set to generate a panoramic orthorectified image.

[0125] The second calibration subunit 332 is used to process the panoramic orthophoto calibration map according to the architectural design drawings to obtain the orthophoto panoramic map.

[0126] As an optional implementation, the second calibration subunit 332 includes:

[0127] The calculation module is used to calculate the reference scale of architectural design drawings;

[0128] The calculation module is also used to calculate the calibration ratio of the panoramic orthophoto calibration map;

[0129] The calibration module is used to process the panoramic orthorectified calibration map according to the reference scale and calibration scale to obtain the orthorectified panoramic map.

[0130] As an optional implementation, the calculation module is specifically used to determine the first target line segment;

[0131] Determine the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map;

[0132] Calculate the length of the first target line segment in three-dimensional space;

[0133] The calibration ratio of the panoramic orthophoto calibration image is obtained by calculating the target line segment length and the coordinates of the first pixel.

[0134] As an optional implementation, the two line segment endpoints include a first endpoint and a second endpoint, wherein the step of determining the first pixel coordinates of the two line segment endpoints of the first target line segment on the panoramic orthophoto calibration map includes:

[0135] Based on the panoramic orthophoto calibration map, determine a first wide-angle map containing the first endpoint and a second wide-angle map containing the second endpoint;

[0136] Calculate the pixel coordinates of the first endpoint on the first wide-angle image;

[0137] Calculate the pixel coordinates of the second endpoint on the second wide-angle image;

[0138] Obtain the first transformation matrix from the first wide-angle image to the panoramic orthorectified image;

[0139] Obtain the second transformation matrix from the second wide-angle image to the panoramic orthorectified image;

[0140] Based on the first transformation matrix and the pixel coordinates of the first endpoint, calculate the first pixel coordinates of the first endpoint on the panoramic orthophoto calibration map;

[0141] Based on the second transformation matrix and the pixel coordinates of the second endpoint, calculate the first pixel coordinates of the second endpoint on the panoramic orthophoto calibration map.

[0142] In this embodiment, the explanation of the construction scene deviation determination device can be referred to the description in Embodiment 1 or Embodiment 2, and will not be repeated here.

[0143] As can be seen, the construction scene deviation determination device described in this embodiment can prioritize acquiring panoramic images, and then compare the panoramic images with the architectural construction drawings to obtain the construction scene deviation. Therefore, implementing this method can automatically determine the construction scene deviation between the construction scene and the architectural construction drawings during the construction process, thereby reducing the error in determining the construction scene deviation and improving the efficiency of determining the construction scene deviation.

[0144] This embodiment provides an electronic device, including a memory and a processor. The memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to perform any one of the construction scenario deviation determination methods in Embodiment 1 or Embodiment 2 of this application.

[0145] This embodiment provides a computer-readable storage medium storing computer program instructions. When the computer program instructions are read and executed by a processor, they perform any one of the construction scenario deviation determination methods in Embodiment 1 or Embodiment 2 of this application.

[0146] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0147] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0148] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0149] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0150] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0151] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A method for determining deviations in a construction scenario, characterized in that, The method includes: Obtain panoramic images of the target construction site and architectural design drawings of the target construction site; A first set of feature points is determined on the architectural design drawings, and a second set of feature points is determined on the panoramic image; The panoramic image is processed based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panoramic image. The step of processing the panoramic image based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panorama includes: The panoramic image is processed based on the first feature point set and the second feature point set to generate a panoramic orthorectified image; Calculate the reference scale of the architectural design drawings; Determine the first target line segment; Determine the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map; Calculate the length of the first target line segment in three-dimensional space; The calibration ratio of the panoramic orthophoto calibration image is calculated based on the target line segment length and the first pixel coordinates. The panoramic orthophoto calibration image is processed according to the reference scale and the calibration scale to obtain an orthophoto panoramic image.

2. The method for determining construction scenario deviations according to claim 1, characterized in that, The steps of acquiring the panoramic image of the target construction site and the architectural design drawings of the target construction site include: Obtain the image logs of the target construction site and the architectural design drawings of the target construction site; The image log is processed to obtain a panoramic image.

3. The method for determining construction scenario deviations according to claim 1, characterized in that, The two line segment endpoints include a first endpoint and a second endpoint, wherein the step of determining the first pixel coordinates of the two line segment endpoints of the first target line segment on the panoramic orthophoto calibration map includes: A first wide-angle image containing the first endpoint and a second wide-angle image containing the second endpoint are determined based on the panoramic orthophoto calibration image. Calculate the pixel coordinates of the first endpoint on the first wide-angle image; Calculate the pixel coordinates of the second endpoint on the second wide-angle image; Obtain the first transformation matrix from the first wide-angle image to the panoramic orthorectified image; Obtain the second transformation matrix from the second wide-angle image to the panoramic orthorectified image; Based on the first transformation matrix and the pixel coordinates of the first endpoint, calculate the first pixel coordinates of the first endpoint on the panoramic orthophoto calibration map; Based on the second transformation matrix and the pixel coordinates of the second endpoint, calculate the first pixel coordinates of the second endpoint on the panoramic orthophoto calibration map.

4. The method for determining construction scenario deviations according to claim 1, characterized in that, After processing the panoramic image based on the first set of feature points, the second set of feature points, and the architectural design drawings to generate an orthophoto panoramic image, the process further includes: By comparing the orthophoto panoramic image with the architectural design drawings, the deviation of the construction scene is determined.

5. A device for determining deviations in a construction scenario, characterized in that, The construction scenario deviation determination device includes: The acquisition unit is used to acquire a panoramic image of the target construction site and the architectural design drawings of the target construction site; A determining unit is used to determine a first set of feature points on the architectural design drawings and a second set of feature points on the panoramic image; The calibration unit is used to process the panoramic image based on the first feature point set, the second feature point set, and the architectural design drawings to generate an orthophoto panoramic image. The calibration unit includes: The first calibration subunit is used to process the panoramic image based on the first feature point set and the second feature point set to generate a panoramic orthorectified image. The second calibration subunit is used to process the panoramic orthorectified calibration map according to the architectural design drawings to obtain the orthorectified panoramic map. The second calibration subunit includes: The calculation module is used to calculate the reference scale of architectural design drawings; The calculation module is also used to calculate the calibration ratio of the panoramic orthophoto calibration map; The calibration module is used to process the panoramic orthorectified calibration map according to the reference scale and calibration scale to obtain the orthorectified panoramic map. Specifically, the calculation module is used to determine the first target line segment; Determine the first pixel coordinates of the two endpoints of the first target line segment on the panoramic orthophoto calibration map; Calculate the length of the first target line segment in three-dimensional space; The calibration ratio of the panoramic orthophoto calibration image is obtained by calculating the target line segment length and the coordinates of the first pixel.

6. An electronic device, characterized in that, The electronic device includes a memory and a processor, the memory being used to store a computer program, and the processor running the computer program to cause the electronic device to perform the construction scene deviation determination method according to any one of claims 1 to 4.

7. A readable storage medium, characterized in that, The readable storage medium stores computer program instructions, which are read and executed by a processor to perform the construction scene deviation determination method according to any one of claims 1 to 4.

Images