Monitoring Method, System, Device and Storage Medium for Building Curtain Wall

Abstract

The present invention discloses a monitoring method, system, device and storage medium for a building curtain wall. The method includes: acquiring the image information of the curtain wall to be measured collected by a camera and the angle information of the camera; performing image preprocessing operations on the basis of the image information of the curtain wall to be measured to obtain a standard image of the curtain wall to be measured; performing a comparison operation with a 3D model according to the angle information of the camera and the standard image of the curtain wall to be measured to obtain a 3D image of the curtain wall to be measured, and further performing a displacement monitoring operation to obtain displacement data of adjacent curtain walls, and obtaining warping data within the plane of the curtain wall to be measured through displacement monitoring; calculating stress according to the warping data within the plane of the curtain wall to be measured to obtain temperature stress data and further obtaining 3D warping data; obtaining a warning message according to the 3D warping data in combination with the standard information value of the data center. This method can detect various parameters of the curtain wall to be measured, and at the same time avoid causing slight changes to the structure of the curtain wall to be detected, improving the detection effect.

Description

Technical Field

[0001] The present invention relates to the technical field of monitoring methods, and particularly to a monitoring method, system, device and storage medium for building curtain walls. Background Art

[0002] A curtain wall is the exterior wall enclosure of a building, which is not load-bearing and is hung like a curtain, so it is also called a suspended wall. It is a lightweight wall with a decorative effect commonly used in modern large-scale and high-rise buildings. It consists of a structural frame and inlaid plates, and does not bear the load and action of the main structure. It has the dual functions of easy installation and disassembly, protection and decoration, and is generally fixed to the structural wall through connectors. Curtain wall monitoring is a method to ensure the exterior decoration effect, service function and structural safety of a building. By monitoring and controlling the key parts of the building's exterior enclosure structure, evaluating and analyzing the key technical parameters, and guiding the construction based on this. At present, the monitoring of building curtain walls mainly detects the force, deformation and displacement data of curtain wall connectors through relevant instruments and equipment.

[0003] In an existing technology, a building curtain wall monitoring system includes a data acquisition end, a data center and a data analysis end. Among them, multiple data acquisition ends are distributed at multiple positions around the building to be tested. Each data acquisition end includes a pressure or tension sensor group. Each pressure or tension sensor group includes at least three pressure or tension sensors, and each pressure or tension sensor is connected to a component in the building to be tested in a one-to-one correspondence; the data acquisition end transmits the collected data to the data analysis end through the data center for analysis. By arranging the sensor groups at different positions, the pressure and tension data of each component are respectively detected. Through the data center, the pressure and / or tension data of the components are collected and transmitted to the data analysis end. The data analyzer is used to analyze the pressure and / or tension data of the components, so as to determine the deformation data of the curtain wall to be detected, and obtain the deformation law and deformation amount of the curtain wall deformation, as well as the force data of the connectors.

[0004] In the prior art, only a single part can be monitored, and various parameters of the curtain wall to be tested cannot be comprehensively detected. Moreover, due to the setting of sensors, a slight change is caused to the structure of the curtain wall to be detected, affecting the overall detection effect. Summary of the Invention

[0005] The present invention provides a monitoring method, system, device and storage medium for building curtain walls, which can comprehensively detect various parameters of the curtain wall to be tested, and at the same time avoid causing slight changes to the structure of the curtain wall to be detected, improving the curtain wall detection effect.

[0006] In a first aspect, in order to solve the above technical problems, the present invention provides a monitoring method for building curtain walls, including:

[0007] Obtain the image information of the measured curtain wall collected by the camera and the angle information of the camera;

[0008] Perform image preprocessing operations based on the image information of the measured curtain wall to obtain a standard image of the measured curtain wall;

[0009] Perform a comparison operation with the 3D model based on the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall;

[0010] Perform displacement monitoring operations based on the 3D image of the measured curtain wall to obtain displacement data of adjacent curtain walls;

[0011] Perform data conversion based on the displacement data of the adjacent curtain walls to obtain planar warping data within the plane of the measured curtain wall;

[0012] Perform stress calculation based on the planar warping data and the angle information of the camera to obtain temperature stress data of the measured curtain wall;

[0013] Perform strain calculation based on the temperature stress data to obtain 3D warping data;

[0014] Make a judgment based on the 3D warping data in combination with the standard information value of the data center to obtain a warning message.

[0015] As an optional implementation manner, the obtaining the image information of the measured curtain wall collected by the camera and the angle information of the camera includes:

[0016] Based on the curtain wall image, cause a change in the internal resistance value of the camera to obtain internal voltage change data;

[0017] Perform analog-to-digital conversion based on the internal voltage change data to obtain the image information of the measured curtain wall collected by the camera;

[0018] Obtain the position information between the camera and the measured curtain wall during the installation process, where the position information includes the horizontal distance and the vertical distance between the camera and the measured curtain wall;

[0019] Perform angle calculation based on the horizontal distance and the vertical distance to obtain the angle information of the camera.

[0020] As an optional implementation manner, the performing image preprocessing operations based on the image information of the measured curtain wall to obtain a standard image of the measured curtain wall includes:

[0021] Perform image conversion based on the image information of the measured curtain wall to obtain RGB three-color channel information;

[0022] Calculate the gray level value based on the RGB three-color channel information to obtain the gray level information of the product image;

[0023] Perform two-dimensional Gaussian filtering based on the grayscale information of the product image to obtain curtain wall data information;

[0024] Among them, the process of the two-dimensional Gaussian filtering includes calculating the Gaussian filtering function corresponding to the pixels on the image information:

[0025]

[0026] In the formula, represents the abscissa value of the pixel in the two-dimensional coordinate system, represents the ordinate value of the pixel coordinate in the two-dimensional coordinate system, is the preset Gaussian standard deviation, represents the Gaussian filtering function value at the coordinate point;

[0027] Among them, according to the Gaussian filtering function value, perform a convolution operation with the image to obtain image filtering information; the convolution operation process is as follows:

[0028]

[0029] In the formula, is the image filtering information at the coordinate, is the Gaussian filtering function value at the coordinate, is the grayscale information at the coordinate, is half of the difference between the maximum value and the minimum value of the abscissa of the established coordinate system.

[0030] As an alternative implementation, the comparing operation of the 3D model with the angle information of the camera and the standard image of the measured curtain wall to obtain the 3D image of the measured curtain wall includes:

[0031] Calculate the distance information of the measured curtain wall according to the angle information of the camera and the standard image of the measured curtain wall;

[0032] Extract feature points according to the distance information of the measured curtain wall to obtain the three-dimensional coordinate position of the measured curtain wall;

[0033] Obtain the 3D image of the measured curtain wall according to the three-dimensional coordinate position of the measured curtain wall and compare it with the standard 3D model.

[0034] As an alternative implementation, the data conversion according to the displacement data of the adjacent curtain walls to obtain the plane warping data within the plane of the measured curtain wall includes:

[0035] Calculate based on the displacement data of the adjacent curtain walls and the angle information of the camera to obtain the horizontal distance value between the measured curtain wall and its adjacent curtain wall;

[0036] Calculate based on the horizontal distance value and the vertical distance value obtained during the installation process to obtain the angle value between the measured curtain wall and the adjacent curtain wall;

[0037] Based on the angle value, combined with the size of the curtain wall, calculate the corner data to obtain the plane warping data within the plane of the measured curtain wall.

[0038] As an alternative implementation, the stress calculation based on the plane warping data and the angle information of the camera to obtain the temperature stress data of the measured curtain wall includes:

[0039] Based on the plane warping data, select the maximum value of the warping data and determine the curtain wall stress monitoring points;

[0040] Based on the curtain wall stress monitoring points, record the temperatures of the adjacent curtain wall detection points to obtain the temperature difference on the curtain wall surface;

[0041] Based on the temperature difference on the curtain wall surface, combined with the structural characteristics of the curtain wall surface, obtain the temperature stress data of the measured curtain wall;

[0042] Among them, the temperature stress data is calculated through the following formula:

[0043]

[0044] In the formula, Temperature stress data, is the linear thermal expansion coefficient of the material, is the current temperature, is the reference temperature, is the Kronecker parameter.

[0045] As an alternative implementation, the strain calculation based on the temperature stress data to obtain the 3D warping data includes:

[0046] Based on the temperature stress data, perform data fitting to obtain the strain values of each part of the curtain wall;

[0047] Based on the strain values, combined with the central curtain wall information and the adjacent curtain wall angle, perform image drawing to obtain a comparison curve;

[0048] Based on the comparison curve, perform data comparison to obtain the 3D warping data.

[0049] As an alternative implementation, the judgment based on the 3D warping data, combined with the standard information value of the data center, to obtain the warning information includes:

[0050] According to the 3D warping data, compare it with a preset threshold to obtain comparison information; wherein, if the 3D warping data is greater than or equal to the preset threshold, mark the comparison information as 1; if the 3D warping data is less than the preset threshold, mark the comparison information as 0;

[0051] When it is determined that the comparison information is 1, generate a warning message.

[0052] In a second aspect, the present invention also provides a monitoring system for a building curtain wall, including:

[0053] An information acquisition module, configured to acquire the image information of the measured curtain wall collected by a camera and the angle information of the camera;

[0054] An image preprocessing module, configured to perform image preprocessing operations according to the image information of the measured curtain wall to obtain a standard image of the measured curtain wall;

[0055] A model comparison module, configured to perform a comparison operation with a 3D model according to the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall;

[0056] A displacement monitoring module, configured to perform displacement monitoring operations according to the 3D image of the measured curtain wall to obtain the displacement data of adjacent curtain walls;

[0057] A warping detection module, configured to perform data conversion according to the displacement data of adjacent curtain walls to obtain the planar warping data within the plane of the measured curtain wall;

[0058] A stress calculation module, configured to perform stress calculation according to the planar warping data and the angle information of the camera to obtain the temperature stress data of the measured curtain wall;

[0059] A stress analysis module, configured to perform strain calculation according to the temperature stress data to obtain 3D warping data;

[0060] A warning module, configured to make a judgment according to the 3D warping data in combination with the standard information value in the data center to obtain a warning message.

[0061] In a third aspect, the present invention also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the monitoring method for a building curtain wall described in any one of the above.

[0062] Fourthly, the present invention also provides a computer-readable storage medium, which includes a stored computer program. When the computer program runs, it controls the device where the computer-readable storage medium is located to execute the monitoring method of the building curtain wall described in any one of the above.

[0063] Compared with the prior art, the present invention has the following beneficial effects: The present invention provides a monitoring method and system for a building curtain wall. The method is executed by a controller and includes: acquiring the image information of the measured curtain wall collected by a camera and the angle information of the camera; performing image preprocessing operations on the image information of the measured curtain wall to obtain a standard image of the measured curtain wall; comparing the standard image of the measured curtain wall with a 3D model according to the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall; performing displacement monitoring operations on the 3D image of the measured curtain wall to obtain displacement data of adjacent curtain walls; performing data conversion on the displacement data of the adjacent curtain walls to obtain in-plane warping data of the measured curtain wall; calculating stress according to the in-plane warping data and the angle information of the camera to obtain temperature stress data; calculating strain according to the temperature stress data to obtain 3D warping data; making a judgment according to the 3D warping data in combination with the standard information value of the data center to obtain a warning information.

[0064] In the present invention, the image is first preprocessed to extract curtain wall data, and then these data are used to compare with a 3D model to generate a 3D image of the curtain wall. Then, the displacement data of adjacent curtain walls are analyzed through displacement monitoring operations, and further the warping data in the plane of the curtain wall are inferred. Combining with the camera angle information, the temperature stress data of the curtain wall can be further analyzed to obtain 3D warping data. Finally, these data are compared with the standard information value of the data center to generate a warning information to help monitor and manage the structural health of the building curtain wall. The above method provides a way to comprehensively detect various parameters of the measured curtain wall, while avoiding causing minor changes to the structure of the measured curtain wall and improving the curtain wall detection effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 is a schematic flowchart of a monitoring method for a building curtain wall provided by the first embodiment of the present invention;

[0066] Figure 2 is a schematic structural diagram of a monitoring system for a building curtain wall provided by the second embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0067] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0068] A curtain wall is the external wall enclosure of a building, which does not bear weight and is hung like a curtain, so it is also called a suspended wall. It is a lightweight wall with a decorative effect commonly used in modern large-scale and high-rise buildings. It consists of a structural framework and inlaid plates, and does not bear the load and action of the main structure. It has the dual functions of easy installation and disassembly, protection and decoration, and is generally fixed to the structural wall through connectors. Curtain wall monitoring is a method to ensure the external decoration effect, service function and structural safety of a building. By monitoring and controlling the key parts of the building's external enclosure structure, evaluating and analyzing the key technical parameters, and guiding the construction based on this. At present, curtain wall monitoring mainly detects the force, deformation and displacement data of curtain wall connectors through relevant instruments and equipment.

[0069] In an existing technology, a building curtain wall monitoring system includes a data acquisition end, a data center and a data analysis end. Among them, multiple data acquisition ends are distributed at multiple positions around the building to be tested. Each data acquisition end includes a pressure or tension sensor group. Each pressure or tension sensor group includes at least three pressure or tension sensors, and each pressure or tension sensor is connected to a component in the building to be tested in a one-to-one correspondence; the data acquisition end transmits the collected data to the data analysis end through the data center for analysis. By arranging the sensor groups at different positions, the pressure and tension data of each component are detected respectively. Through the data center, the pressure and / or tension data of the components are collected and transmitted to the data analysis end, and the data analyzer is used to analyze the pressure and / or tension data of the components, so as to determine the deformation data of the curtain wall to be detected, and obtain the deformation law and deformation amount of the curtain wall deformation, as well as the force data of the connectors.

[0070] In the existing technology, only a single part can be monitored, and various parameters of the curtain wall to be tested cannot be comprehensively detected. Moreover, due to the setting of the sensors, a slight change is caused to the structure of the curtain wall to be detected, affecting the overall detection effect.

[0071] To solve the above problems, the following specific embodiments will be used to introduce and illustrate in detail a monitoring method for a building curtain wall provided by the present invention.

[0072] Referring to Figure 1 , the first embodiment of the present invention provides a monitoring method for a building curtain wall, including the following steps:

[0073] S11. Obtain the image information of the curtain wall to be measured collected by the camera and the angle information of the camera;

[0074] S12. Perform image preprocessing operations on the image information of the curtain wall to be measured to obtain a standard image of the curtain wall to be measured;

[0075] S13. Compare the standard image of the curtain wall to be measured with the 3D model according to the angle information of the camera and the standard image of the curtain wall to be measured to obtain a 3D image of the curtain wall to be measured;

[0076] S14. Perform displacement monitoring operations on the 3D image of the curtain wall to be measured to obtain displacement data of adjacent curtain walls;

[0077] S15. Perform data conversion on the displacement data of the adjacent curtain walls to obtain plane warping data within the plane of the curtain wall to be measured;

[0078] S16. Perform stress calculation according to the plane warping data and the angle information of the camera to obtain temperature stress data of the curtain wall to be measured;

[0079] S17. Perform strain calculation according to the temperature stress data to obtain 3D warping data;

[0080] S18. Make a judgment according to the 3D warping data in combination with the standard information value of the data center to obtain a warning message.

[0081] It should be noted that the camera used to obtain the image information of the curtain wall to be measured collected by the camera and the angle information of the camera belongs to the machine vision module. The machine vision module is a key component in modern industrial automation and intelligent manufacturing. It captures and analyzes images through high-precision vision sensors and provides necessary visual information for the automation system. This module usually includes different types of cameras, such as CCD (Charge Coupled Device) cameras, CMOS (Complementary Metal Oxide Semiconductor) cameras, and line array cameras, each of which has its own unique advantages and application scenarios. CCD cameras are famous for their high resolution, high sensitivity, and excellent image quality, and are especially suitable for applications that require high-quality image capture. CMOS cameras are favored for their fast imaging ability, low power consumption, and cost-effectiveness, and are widely used in occasions that require fast response. Line array cameras are specialized in high-speed scanning and precise measurement and are used for continuous object detection and measurement tasks.

[0082] Exemplarily, in this embodiment, the machine vision module uses a CMOS camera. The CMOS camera collects the image information of the curtain wall to be measured, and the generated digital image data contains detailed visual information of the building curtain wall image. This information can be used for further image processing, analysis, and decision-making.

[0083] The present invention provides a monitoring method and system for building curtain walls. The method is executed by a controller and includes: obtaining the image information of the measured curtain wall collected by a camera and the angle information of the camera; obtaining the image information of the measured curtain wall collected by the camera and the angle information of the camera; performing image preprocessing operations on the basis of the image information of the measured curtain wall to obtain a standard image of the measured curtain wall; performing a comparison operation with a 3D model according to the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall; performing displacement monitoring operations according to the 3D image of the measured curtain wall to obtain displacement data of adjacent curtain walls; performing data conversion according to the displacement data of the adjacent curtain walls to obtain in-plane warping data of the measured curtain wall; performing stress calculation according to the in-plane warping data and the angle information of the camera to obtain temperature stress data of the measured curtain wall; performing strain calculation according to the temperature stress data to obtain 3D warping data; and making a judgment according to the 3D warping data in combination with the standard information value in the data center to obtain a warning message.

[0084] First, the image is preprocessed to extract curtain wall data, and then these data are used to compare with a 3D model to generate a 3D image of the curtain wall. Next, the displacement data of adjacent curtain walls are analyzed through displacement monitoring operations, and then the warping data in the plane of the curtain wall are inferred. Combining with the camera angle information, the temperature stress data of the curtain wall can be further analyzed to obtain 3D warping data. Finally, these data are compared with the standard information values in the data center to generate warning messages to assist in monitoring and managing the structural health of building curtain walls. The above method provides a way to comprehensively detect various parameters of the measured curtain wall, while avoiding causing minor changes to the structure of the measured curtain wall and improving the curtain wall detection effect.

[0085] In step S11, the obtaining of the image information of the measured curtain wall collected by the camera and the angle information of the camera includes:

[0086] According to the curtain wall image, the internal resistance value of the camera changes, and internal voltage change data are obtained;

[0087] Performing analog-to-digital conversion according to the internal voltage change data to obtain the image information of the measured curtain wall collected by the camera;

[0088] Obtaining the position information between the camera and the measured curtain wall during the installation process, where the position information includes the horizontal distance and the vertical distance between the camera and the measured curtain wall;

[0089] Performing angle calculation according to the horizontal distance and the vertical distance to obtain the angle information of the camera.

[0090] It should be noted that the angle information of the camera is calculated based on the horizontal distance and the vertical distance, and the angle information of the camera is determined by the following formula:

[0091]

[0092] In the formula, represents the angle information between the camera and the curtain wall, is the horizontal information between the camera and the curtain wall, is the vertical information between the camera and the curtain wall.

[0093] It should be noted that the horizontal distance x and the vertical distance y are based on taking the camera as the origin, with the horizontal direction between the camera and the curtain wall as the x-axis and the vertical direction between the camera and the curtain wall as the y-axis.

[0094] In the specific implementation process, first, the camera needs to be aimed at the measured curtain wall of the building, and the angle of the camera is adjusted to ensure that the image of the curtain wall can be clearly captured. The camera should be equipped with appropriate lenses and sensors to be able to capture the details and features of the curtain wall. Use the camera's driver and related software to control the camera and start collecting images. The image sensor inside the camera (such as a CMOS or CCD sensor) will convert the incident photons into analog electrical signals, and these analog signals are related to the brightness and color of the curtain wall image. At the same time, the change in the internal resistance value of the camera caused by the curtain wall image will affect the intensity of the analog electrical signal. These changes are generated by the pixel array on the image sensor. Each pixel corresponds to a point in the image and will generate a corresponding voltage change according to the received light amount. Then, the analog signal needs to be converted into a digital signal through an analog-to-digital converter (ADC) so that a computer or digital system can process it. The ADC works by comparing the analog signal with a series of known voltage values (reference voltages generated by an internal digital-to-analog converter) to obtain the corresponding digital value. This process involves different types such as successive approximation type, integral type, voltage-frequency conversion type, ∑-Δ type ADC, etc. Among them, SS-ADC (single-slope ADC) is widely used in image sensors because of its simple structure, small occupied area, and low power consumption. The converted digital signal will be transmitted to a digital signal processor (DSP) or a microcontroller (MCU) for further processing, such as denoising, enhancement, compression, etc., to improve the image quality and reduce the data volume for easy storage and transmission.

[0095] In step S12, the image preprocessing operation is performed according to the measured curtain wall image information to obtain the standard image of the measured curtain wall, including:

[0096] According to the measured curtain wall image information, image conversion is performed to obtain the information of the three color channels RGB;

[0097] Calculate the grayscale value based on the RGB three - color channel information to obtain the grayscale information of the product image;

[0098] Perform two - dimensional Gaussian filtering based on the grayscale information of the product image to obtain the curtain wall data information;

[0099] Among them, the process of the two - dimensional Gaussian filtering includes calculating the Gaussian filtering function corresponding to the pixels on the image information:

[0100]

[0101] In the formula, represents the abscissa value of the pixel in the two - dimensional coordinate system, represents the ordinate value of the pixel coordinate in the two - dimensional coordinate system, is the Gaussian standard deviation preset by the system, represents the Gaussian filtering function value at the coordinate point;

[0102] Among them, according to the Gaussian filtering function value, perform a convolution operation with the image to obtain the image filtering information; the convolution operation process is as follows:

[0103]

[0104] In the formula, is the image filtering information at the coordinate, is the Gaussian filtering function value at the coordinate, is

[0105] It should be noted that the obtaining of the RGB three - color channel information by performing image conversion on the measured curtain wall image information includes:

[0106] Monitor the amplitude of the analog signal for the measured curtain wall image information at a specific time interval, quantize the sampled information, map the sampled values to a finite number of discrete values, and convert them to binary values according to the encoding accuracy used, thereby obtaining the RGB three - color channel information.

[0107] It should be further noted that the calculation of the grayscale value based on the RGB three - color channel information to obtain the grayscale information of the product image is calculated by the following formula:

[0108]

[0109] In the formula, represents the intensity of the red channel, respectively represent the intensity of the green channel, represents the intensity of the blue channel, represents the grayscale information of the product.

[0110] In step S13, the operation of comparing with the 3D model according to the angle information of the camera and the standard image of the measured curtain wall to obtain the 3D image of the measured curtain wall includes:

[0111] Calculate the distance information of the measured curtain wall according to the angle information of the camera and the standard image of the measured curtain wall;

[0112] Extract feature points according to the distance information of the measured curtain wall to obtain the three-dimensional coordinate position of the measured curtain wall;

[0113] According to the three-dimensional coordinate position of the measured curtain wall, compare with the standard 3D model to obtain the 3D image of the measured curtain wall.

[0114] Among them, according to the angle information of the camera and the standard image of the measured curtain wall, three-dimensional modeling measurement technology (such as three-dimensional point cloud model) can be used to calculate the distance information of the measured curtain wall. Based on the obtained distance information, feature points of the measured curtain wall are extracted. Exemplarily, these feature points can be obvious marks, edges or corner points on the curtain wall, etc. Three-dimensional laser scanning technology can be used to quickly obtain the three-dimensional coordinates of these feature points.

[0115] Furthermore, through the extracted feature points, combined with the angle information and distance information of the camera, reverse modeling technology is used to calculate the three-dimensional coordinate position of the measured curtain wall. This process can be carried out through BIM software. By comparing the point cloud data with the design model, the deviation value of the curtain wall component entity is obtained, and the information is adjusted until it meets the specification requirements.

[0116] It should be noted that according to the three-dimensional coordinate position of the measured curtain wall, comparing with the standard 3D model to obtain the 3D image of the measured curtain wall includes:

[0117] Obtain the contour information of the curtain wall according to the three-dimensional coordinate position of the curtain wall. According to the standard 3D model, contour supplementation is carried out, and fitting is carried out to obtain the 3D image of the measured curtain wall. Specifically, according to the contour information of the curtain wall, combined with the standard 3D model, the missing parts of the contour are fitted and completed to obtain the 3D image of the measured curtain wall. The standard 3D model is pre-input by the user.

[0118] In step S14, the operation of displacement monitoring is carried out according to the 3D image of the measured curtain wall to obtain the displacement data of the adjacent curtain wall, including:

[0119] Based on the 3D image of the curtain wall to be measured, calculate the distances between the image feature points to obtain the displacement data of adjacent curtain walls.

[0120] Exemplarily, by measuring the distances between the feature points on the 3D image, obtain the distance values of the feature points on the 3D image; according to the distance values of the feature points on the 3D image, perform proportional conversion to obtain the displacement data of adjacent curtain walls. Among them, to perform proportional conversion according to the distance values of the feature points to obtain the displacement data of adjacent curtain walls: according to the actual distance between the camera and the curtain wall, as well as information such as the resolution and field of view angle of the camera, the distance on the image can be converted into the actual physical distance.

[0121] In step S15, the data conversion according to the displacement data of the adjacent curtain walls to obtain the warping data within the plane of the curtain wall to be measured includes:

[0122] Calculate according to the displacement data of the adjacent curtain walls and the angle information of the camera to obtain the horizontal distance value between the curtain wall to be measured and its adjacent curtain wall;

[0123] Calculate according to the horizontal distance value and the vertical distance value obtained during the installation process to obtain the angle value between the curtain wall to be measured and the adjacent curtain wall;

[0124] According to the angle value, combine with the size of the curtain wall to calculate the corner data to obtain the warping data within the plane of the curtain wall to be measured.

[0125] It should be noted that calculating according to the displacement data of the adjacent curtain walls and the angle information of the camera to obtain the horizontal distance value between the curtain wall to be measured and its adjacent curtain wall is calculated using the following formula:

[0126]

[0127] In the formula, is the horizontal distance value between the curtain wall to be measured and the adjacent curtain wall, is the displacement data of the adjacent curtain wall, is the angle information between the camera and the curtain wall;

[0128] According to the horizontal distance value between the curtain wall to be measured and its adjacent curtain wall and the vertical distance

[0129]

[0130] In the formula, represents the vertical distance between the curtain wall to be measured and the horizontal curtain wall, which is determined during the installation process. Represents the horizontal distance value between the measured curtain wall and the adjacent curtain wall, Represents the angular value between the measured curtain wall and the adjacent curtain wall.

[0131] It should be noted that according to the angular value and the size of the curtain wall, the actually calculated angular value is compared with the designed value to obtain the plane warping data within the plane of the measured curtain wall, thereby determining the warping condition of the curtain wall. For example, if the designed angle of the curtain wall is 90 degrees and the actually measured angle is 89 degrees, this indicates that the curtain wall has a warping of 1 degree.

[0132] In step S16, performing stress calculation based on the plane warping data and the angular information of the camera to obtain the temperature stress data of the measured curtain wall includes:

[0133] Selecting the maximum value of the warping data according to the plane warping data to determine the curtain wall stress monitoring points;

[0134] Recording the temperatures of the adjacent curtain wall detection points according to the curtain wall stress monitoring points to obtain the temperature difference on the surface of the curtain wall;

[0135] Obtaining the temperature stress data of the measured curtain wall by combining the temperature difference on the surface of the curtain wall with the structural characteristics of the surface of the curtain wall;

[0136] Among them, the temperature stress data is calculated through the following formula:

[0137]

[0138] In the formula, is the temperature stress data, is the linear thermal expansion coefficient of the material, which is determined by the structural characteristics of the surface of the curtain wall, is the current temperature, is the reference temperature, is the Kronecker parameter.

[0139] It should be noted that recording the temperatures of the adjacent curtain wall detection points according to the curtain wall stress monitoring points to obtain the temperature difference on the surface of the curtain wall includes: forming a temperature library by recording the temperature values of the adjacent curtain wall detection points, and calculating the adjacent data according to the temperature library to obtain the surface temperature difference value between the curtain walls.

[0140] In step S17, performing strain calculation based on the temperature stress data to obtain 3D warping data includes:

[0141] Performing data fitting according to the temperature stress data to obtain the strain values of each part of the curtain wall;

[0142] Based on the strain, combined with the central curtain wall information and the adjacent curtain wall angles, an image is drawn to obtain a comparison curve;

[0143] Based on the comparison curve, data comparison is performed to obtain 3D warping data.

[0144] It should be noted that the strain of each part of the curtain wall is obtained based on the temperature stress data and is determined by the following formula:

[0145]

[0146] In the formula, represents the temperature stress data, represents the Young's modulus, which is determined by the selected material, represents the strain of each part of the curtain wall.

[0147] It should be noted that the data fitting includes: based on the existing stress data of the measured curtain wall, with the distance as the abscissa and the stress data as the ordinate, a stress two-dimensional image is obtained, and according to the style of the two-dimensional image, the dimension of the fitting function is determined, and then the relevant data is fitted.

[0148] In step S18, obtaining the warning information based on the 3D warping data and combining the data center standard information value includes:

[0149] Based on the 3D warping data, comparing with a preset threshold to obtain comparison information; among them, if the 3D warping data is greater than or equal to the preset threshold, the comparison information is marked as 1; if the 3D warping data is less than the preset threshold, the comparison information is marked as 0;

[0150] When it is determined that the comparison information is 1, a warning information is generated.

[0151] Specifically, based on the comparison information, signal judgment is performed. If the comparison information is 1, that is, the 3D warping data exceeds the preset threshold, the system will generate a warning information to prompt quality risks or production problems. Exemplarily, the warning information is output in an appropriate manner, which can be a warning on the graphical interface, email notification, SMS reminder, etc., so that relevant personnel can take measures in time.

[0152] It should be noted that the preset threshold is set by the user in advance, and the preset threshold of warping can be set according to the engineering technical specifications and design requirements of the building curtain wall. For example, the warping value of the curtain wall should not be greater than 1 / 60,

[0153] That is, the warping value of the curtain wall exceeding 1 / 60 of the curtain wall size can be set as the warning threshold, and no specific limitation is made here.

[0154] For the convenience of understanding the present invention, some preferred embodiments of the present invention will be further described below.

[0155] In this embodiment, a monitoring device for a building curtain wall is proposed. The device consists of the following key parts: an image acquisition and angle measurement device, an image preprocessing device, a 3D modeling and comparison device, a displacement and warping monitoring device, and a stress analysis and warning device. Among them, the image acquisition and angle measurement device is responsible for acquiring the image information of the building curtain wall and the angle information of the camera. After preprocessing the acquired building curtain wall image, a standard image of the measured curtain wall, the angle information of the camera, and the distance information of the measured curtain wall are obtained, the three-dimensional coordinate position of the measured curtain wall is calculated, and a 3D image of the measured curtain wall is generated by comparing with the standard 3D model. The displacement and warping monitoring device monitors the displacement data of adjacent curtain walls, and calculates the angle value between the measured curtain wall and the adjacent curtain wall according to the displacement data and the angle information, so as to obtain the warping data within the plane of the measured curtain wall. Finally, according to the temperature stress data of the measured curtain wall, the strain of each part of the curtain wall is calculated, and combined with the information of the central curtain wall and the angles of adjacent curtain walls, a comparison curve is obtained, and the monitoring data is converted into actual maintenance and warning measures according to the comparison curve.

[0156] Step 1: Use a camera to obtain the image information of the building curtain wall and determine the angle of the camera relative to the curtain wall. The change in resistance inside the camera causes a change in voltage, thereby obtaining the image information.

[0157] Step 2: Preprocess the acquired image, including analog-to-digital conversion to obtain RGB color channel information, calculating the grayscale value, and performing two-dimensional Gaussian filtering to extract the standard image of the measured curtain wall.

[0158] Step 3: Calculate the three-dimensional coordinate position of the curtain wall according to the angle information of the camera and the distance information of the curtain wall, and compare it with the standard 3D model to generate a 3D image of the measured curtain wall.

[0159] Step 4: Monitor the displacement data of adjacent curtain walls, and combine the displacement data and the angle information to calculate the angle value between the measured curtain wall and the adjacent curtain wall, so as to obtain the warping data within the plane of the measured curtain wall.

[0160] Step 5: According to the warping data of the measured curtain wall, determine the stress monitoring points of the curtain wall, record the temperatures of the detection points of adjacent curtain walls, obtain the temperature difference on the surface of the curtain wall, and combine the structural characteristics of the surface of the curtain wall to calculate the stress information of the detection points of the curtain wall, so as to obtain the temperature stress data of the measured curtain wall.

[0161] Step 6: According to the temperature stress data of the measured curtain wall, calculate the strain of each part of the curtain wall, and combine the central curtain wall information and the adjacent curtain wall angles to obtain a comparison curve. Through data comparison, 3D warping data is obtained and compared with the standard information value in the data center, and finally a warning message is generated.

[0162] Exemplarily, assume that the size of a building curtain wall is 4100mm×1500mm. According to the "Technical Code for Glass Curtain Wall Engineering" (JGJ 102 - 2003), the maximum allowable warping value is 4100mm / 60 ≈ 68.33mm. Therefore, 68.33mm can be set as the warning threshold. If the 3D warping value of a certain area measured is 70mm, exceeding the threshold of 68.33mm, then the comparison information is marked as 1, and the system will generate a warning message, such as: "The warping of the first area exceeds the warning threshold, the current warping value is 70mm, please check the curtain wall structure"; if the warping value of a certain area measured is 60mm, lower than the threshold of 68.33mm, then the comparison information is marked as 0, and the system will not generate a warning message.

[0163] For the convenience of understanding the present invention, some preferred embodiments of the present invention will be further described below.

[0164] Refer to Figure 2 , the present invention provides a monitoring system for a building curtain wall, including:

[0165] An information acquisition module, configured to acquire the image information of the measured curtain wall collected by the camera and the angle information of the camera;

[0166] An image preprocessing module, configured to perform image preprocessing operations according to the image information of the measured curtain wall to obtain a standard image of the measured curtain wall;

[0167] A model comparison module, configured to perform a comparison operation with a 3D model according to the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall;

[0168] A displacement monitoring module, configured to perform displacement monitoring operations according to the 3D image of the measured curtain wall to obtain the displacement data of the adjacent curtain wall;

[0169] A warping detection module, configured to perform data conversion according to the displacement data of the adjacent curtain wall to obtain the in-plane warping data of the measured curtain wall;

[0170] A stress calculation module, configured to perform stress calculation according to the in-plane warping data and the angle information of the camera to obtain the temperature stress data of the measured curtain wall;

[0171] A stress analysis module, configured to perform strain calculation based on the temperature stress data to obtain 3D warping data;

[0172] An early warning module, configured to make a judgment based on the 3D warping data in combination with the standard information value in the data center to obtain an early warning message.

[0173] The present invention provides a monitoring system for a building curtain wall. First, the image is preprocessed to extract the curtain wall data, and then these data are compared with the 3D model to generate a 3D image of the curtain wall. Then, the displacement data of adjacent curtain walls are analyzed through displacement monitoring operations, and further the warping data within the plane of the curtain wall are inferred. Combining the camera angle information, the temperature stress data of the curtain wall can be further analyzed to obtain the 3D warping data. Finally, these data are compared with the standard information value in the data center to generate an early warning message to help monitor and manage the structural health of the building curtain wall. The above method provides a way to comprehensively detect various parameters of the measured curtain wall, while avoiding causing slight changes to the structure of the detected curtain wall and improving the detection effect of the curtain wall.

[0174] It should be noted that the monitoring device for a building curtain wall provided in the embodiment of the present invention is used to execute all the process steps of the monitoring method for a building curtain wall in the above embodiment. The working principles and beneficial effects of the two correspond one by one, so they will not be elaborated here.

[0175] The embodiment of the present invention also provides an electronic device. The electronic device includes: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as an image processing program. When the processor executes the computer program, the steps in the above embodiments of the monitoring method for a building curtain wall are implemented, such as Figure 1 the step S11 shown. Alternatively, when the processor executes the computer program, the functions of each module / unit in the above device embodiments are implemented, such as the information acquisition module.

[0176] Exemplarily, the computer program can be divided into one or more modules / units. The one or more modules / units are stored in the memory and executed by the processor to complete the present invention. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, and these instruction segments are used to describe the execution process of the computer program in the electronic device.

[0177] The electronic device may be a computing device such as a desktop computer, a notebook, a palm computer, and a smart tablet. The electronic device may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that the above components are only examples of the electronic device and do not constitute a limitation on the electronic device. It may include more or fewer components than the above, or combine some components, or different components. For example, the electronic device may further include input / output devices, network access devices, a bus, etc.

[0178] The so-called processor may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The processor is the control center of the electronic device and connects various parts of the entire electronic device through various interfaces and lines.

[0179] The memory may be used to store the computer program and / or module. The processor realizes various functions of the electronic device by running or executing the computer program and / or module stored in the memory, and by calling the data stored in the memory. The memory may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the mobile phone (such as audio data, a phone book, etc.). In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0180] Among them, if the modules / units integrated in the electronic device are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the above-described embodiment methods of the present invention, it can also be completed by a computer program instructing relevant hardware. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above-described various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disc, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0181] It should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the attached drawings of the device embodiments provided by the present invention, the connection relationship between the modules indicates that they have a communication connection, which can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art can understand and implement it without creative labor.

[0182] The specific embodiments described above have further elaborated on the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only the specific embodiments of the present invention and is not used to limit the protection scope of the present invention. It is particularly pointed out that for those skilled in the art, any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A monitoring method for a building curtain wall, characterized in that, Including: Obtaining the image information of the curtain wall under test collected by the camera and the angle information of the camera; Performing image preprocessing operations on the image information of the curtain wall under test to obtain a standard image of the curtain wall under test; Performing a comparison operation with a 3D model based on the angle information of the camera and the standard image of the curtain wall under test to obtain a 3D image of the curtain wall under test; Performing displacement monitoring operations based on the 3D image of the curtain wall under test to obtain displacement data of adjacent curtain walls; Performing data conversion based on the displacement data of the adjacent curtain walls to obtain planar warping data within the plane of the curtain wall under test; Performing stress calculation based on the planar warping data and the angle information of the camera to obtain temperature stress data of the curtain wall under test; Performing strain calculation based on the temperature stress data to obtain 3D warping data; Making a judgment based on the 3D warping data in combination with the standard information value of the data center to obtain a warning message.

2. The monitoring method of the building curtain wall according to claim 1, wherein The obtaining the image information of the curtain wall under test collected by the camera and the angle information of the camera includes: According to the curtain wall image, causing a change in the internal resistance value of the camera to obtain internal voltage change data; Performing analog-to-digital conversion based on the internal voltage change data to obtain the image information of the curtain wall under test collected by the camera; Obtaining the position information between the camera and the curtain wall under test during the installation process, where the position information includes the horizontal distance and the vertical distance between the camera and the curtain wall under test; Performing angle calculation based on the horizontal distance and the vertical distance to obtain the angle information of the camera.

3. The monitoring method of the building curtain wall according to claim 2, characterized in that, The performing image preprocessing operations on the image information of the curtain wall under test to obtain a standard image of the curtain wall under test includes: Performing image conversion based on the image information of the curtain wall under test to obtain RGB three-color channel information; Calculating the gray value based on the RGB three-color channel information to obtain the gray information of the product image; Performing two-dimensional Gaussian filtering based on the gray information of the product image to obtain curtain wall data information; Among them, the process of the two-dimensional Gaussian filtering includes calculating the Gaussian filtering function corresponding to the pixels on the image information: In the formula, represents the abscissa value of the pixel in the two-dimensional coordinate system, represents the ordinate value of the pixel coordinate in the two-dimensional coordinate system, is the preset Gaussian standard deviation, represents the Gaussian filtering function value at the coordinate point; Among them, according to the Gaussian filtering function value, performing a convolution operation with the image to obtain image filtering information; the convolution operation process is as follows: In the formula, is the image filtering information under the coordinates, is the value of the Gaussian filtering function under the coordinates, is the gray level information at the coordinates, and is half of the difference between the maximum and minimum values of the abscissa of the established coordinate system.

4. The monitoring method of the building curtain wall according to claim 1, characterized in that, The performing a comparison operation with a 3D model based on the angle information of the camera and the standard image of the curtain wall under test to obtain a 3D image of the curtain wall under test includes: Calculating the distance information of the curtain wall under test based on the angle information of the camera and the standard image of the curtain wall under test; Extracting feature points based on the distance information of the curtain wall under test to obtain the three-dimensional coordinate position of the curtain wall under test; Obtaining the 3D image of the curtain wall under test by comparing with the standard 3D model according to the three-dimensional coordinate position of the curtain wall under test.

5. The monitoring method of the building curtain wall according to claim 1, characterized in that, The performing data conversion based on the displacement data of the adjacent curtain walls to obtain planar warping data within the plane of the curtain wall under test includes: Calculating based on the displacement data of the adjacent curtain walls and the angle information of the camera to obtain the horizontal distance value between the curtain wall under test and its adjacent curtain wall; Calculating based on the horizontal distance value and the vertical distance value obtained during the installation process to obtain the angle value between the curtain wall under test and the adjacent curtain wall; Based on the said angle value, combined with the size of the curtain wall, calculate the corner data to obtain the plane warping data within the plane of the measured curtain wall.

6. The monitoring method of the building curtain wall according to claim 1, characterized in that, Based on the said plane warping data and the angle information of the camera, perform stress calculation to obtain the temperature stress data of the measured curtain wall, including: Based on the said plane warping data, select the maximum value of the warping data and determine the stress monitoring points of the curtain wall; Based on the stress monitoring points of the curtain wall, record the temperatures of adjacent curtain wall detection points to obtain the temperature difference on the surface of the curtain wall; Based on the temperature difference on the surface of the curtain wall, combined with the structural characteristics of the surface of the curtain wall, obtain the temperature stress data of the measured curtain wall; Among them, the temperature stress data is calculated through the following formula: In the formula, is the temperature stress data, is the linear thermal expansion coefficient of the material, is the current temperature, is the reference temperature, is the Kronecker parameter.

7. The monitoring method of the building curtain wall according to claim 1, characterized in that Based on the said temperature stress data, perform strain calculation to obtain 3D warping data, including: Based on the said temperature stress data, perform data fitting to obtain the strain values of each part of the curtain wall; Based on the said strain values, combined with the information of the central curtain wall and the angles of adjacent curtain walls, perform image drawing to obtain a comparison curve; Based on the said comparison curve, perform data comparison to obtain 3D warping data.

8. The monitoring method of the building curtain wall according to claim 1, characterized in that, Based on the said 3D warping data, combined with the standard information value of the data center, perform judgment to obtain a warning message, including: Based on the said 3D warping data, compare it with a preset threshold to obtain comparison information; among them, if the 3D warping data is greater than or equal to the preset threshold, mark the comparison information as 1; if the 3D warping data is less than the preset threshold, mark the comparison information as 0; When it is determined that the comparison information is 1, generate a warning message.

9. A monitoring system for a building curtain wall, characterized in that, Including: An information acquisition module, used to acquire the image information of the measured curtain wall collected by the camera and the angle information of the camera; An image preprocessing module, used to perform image preprocessing operations based on the said image information of the measured curtain wall to obtain a standard image of the measured curtain wall; A model comparison module, used to perform a comparison operation with a 3D model based on the angle information of the camera and the standard image of the measured curtain wall to obtain a 3D image of the measured curtain wall; A displacement monitoring module, used to perform displacement monitoring operations based on the said 3D image of the measured curtain wall to obtain the displacement data of adjacent curtain walls; A warping detection module, used to perform data conversion based on the displacement data of adjacent curtain walls to obtain the plane warping data within the plane of the measured curtain wall; A stress calculation module, used to perform stress calculation based on the said plane warping data and the angle information of the camera to obtain the temperature stress data of the measured curtain wall; A stress analysis module, used to perform strain calculation based on the said temperature stress data to obtain 3D warping data; A warning module, used to perform judgment based on the said 3D warping data, combined with the standard information value of the data center, to obtain a warning message.

10. A computer-readable storage medium, characterized in that, The said computer-readable storage medium includes a stored computer program, wherein, when the computer program runs, it controls the device where the computer-readable storage medium is located to execute a monitoring method for a building curtain wall as described in any one of claims 1 to 8.

Images