Building monitoring system and monitoring method based on intelligent identification and laser ranging

Through intelligent identification and laser ranging technology, combined with binocular photography and laser ranging, real-time monitoring and data analysis of buildings is achieved, which solves the problems of complex installation, high cost and unstable data transmission in the existing technology, and improves the problem of Monitoring accuracy and safety assurance.

CN118962703APending Publication Date: 2024-11-15CHINA INST OF BUILDING STANDARD DESIGN & RES
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411014964.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The existing building monitoring technology has problems such as complex installation, high cost, unstable data transmission and a great impact on the appearance of the building, resulting in low monitoring rate and insufficient security guarantees.

Method used

Adopt a building monitoring system based on intelligent recognition and laser ranging, including binocular photography device, laser ranging device, sound acquisition device and remote data processing device, and realizes the use of artificial intelligence image recognition, coordinate calculation, voice recognition and early warning modules. Real-time monitoring and data analysis of buildings simplifies installation processes and improves data accuracy and transmission stability.

Benefits of technology

It simplifies the layout and cost of the monitoring system, improves data accuracy and work efficiency, enhances the interactive performance and building safety guarantee of the monitoring system, and can promptly identify defects and potential risks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118962703A_ABST
    Figure CN118962703A_ABST
Patent Text Reader

Abstract

The invention relates to a building monitoring system and method based on intelligent identification and laser ranging. The system comprises a binocular photographing device, a laser ranging device, a sound acquisition device, a remote data processing device and a communication device. The binocular photographing device is used for carrying out image acquisition on a monitoring area of the building and transmitting the acquired image data to the remote data processing device through the communication device; the laser ranging device measures the distance to a monitoring point in a monitoring area and pose change information, and transmits the change information to the remote data processing device through the communication device; the sound collection device collects voices in a monitoring area, transmits the voices to the remote data processing device through the communication device, and plays voice information returned by the remote data processing device. According to the invention, a plurality of measuring points and a plurality of defect items can be monitored at the same time, the arrangement work and the monitoring cost of the monitoring system are greatly simplified, and the influence of installation of sensors, cables and acquisition instruments on the appearance of a building is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of building monitoring, and in particular relates to a building monitoring system and a monitoring method based on intelligent recognition and laser ranging. Background Art

[0002] Due to the emphasis on building safety, more and more buildings, especially important buildings, historical and cultural relics buildings, super-high buildings, and large-span structures, choose to use monitoring systems during the construction and operation periods to monitor building safety, including building settlement, tilt, component deformation, and appearance defects. Real-time monitoring can timely discover building problems and changing trends, and predict problems early, so as to avoid risks and protect life and property safety as much as possible. At present, for building settlement, commonly used sensors include static levels. Different measuring points and reference points need to be connected by liquid pipes, which are complicated to install, and collisions and liquid evaporation at any point on the line will affect the monitoring results; for tilt monitoring, inclinometers need to be installed at the measuring points; for component deformation, strain gauges need to be installed at the measuring points; for appearance defects, the current common practice is visual inspection. Due to the need for data collection and transmission, all sensors usually need to be connected by cables. Although data transmission and power supply problems can be solved by wireless transmission and built-in batteries, the wireless signal is not stable, the battery needs to be replaced frequently, and the sensor volume will be greatly increased, affecting the installation appearance.

[0003] To sum up, the existing monitoring technology has certain limitations in practicality. The monitoring system has complex installation procedures, high requirements for the installation environment, high monitoring costs, unstable data transmission, and serious impact on the appearance of the building, resulting in a low building monitoring rate and a lack of effective means to ensure building safety. Summary of the invention

[0004] In order to overcome the above problems existing in the prior art, the present invention provides a building monitoring system and a monitoring method based on intelligent recognition and laser ranging, which are used to solve the above problems existing in the prior art.

[0005] A building monitoring system based on intelligent recognition and laser ranging, the system comprising a binocular photography device, a laser ranging device, a sound collection device, a remote data processing device and a communication device;

[0006] The binocular photography device collects images of the monitoring area of ​​the building, and transmits the collected image data to the remote data processing device through the communication device;

[0007] The laser distance measuring device measures the distance to the monitoring point in the monitoring area and the position change information, and transmits the change information to the remote data processing device through the communication device;

[0008] The sound collection device collects the voice in the monitoring area, transmits it to the remote data processing device through the communication device, and plays the voice information returned by the remote data processing device.

[0009] According to the above aspects and any possible implementation manner, there is further provided an implementation manner, wherein the system further includes a module to be identified which is arranged at the monitoring point.

[0010] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the module to be identified is a target paper.

[0011] According to the above aspects and any possible implementation, a further implementation is provided, wherein the binocular photography device comprises two cameras.

[0012] According to the aspects described above and any possible implementation method, an implementation method is further provided, wherein the laser ranging device is a solid-state laser radar with certain horizontal and vertical viewing angles.

[0013] According to the aspects described above and any possible implementation, an implementation is further provided, which also includes a power supply device, and the power supply device uses a battery or a solar charging panel.

[0014] As described above and any possible implementation method, an implementation method is further provided, wherein the remote data processing device includes an artificial intelligence image recognition module, a coordinate calculation module, a face recognition module, a voice recognition module, an intelligent question and answer module and an early warning module.

[0015] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the warning module sends the warning information to a handheld terminal of an associated person via a wireless method.

[0016] The present invention also provides a monitoring method of a building monitoring system based on intelligent identification and laser ranging, which is implemented by the system, and comprises: S1. Assembling and fixing a binocular photography device and a laser ranging device, so that the monitoring area and the monitoring points therein are placed within the shooting range of the binocular photography device;

[0017] S2. Paste target paper at the monitoring point and identify and locate the image therein;

[0018] S3. Use a binocular camera to photograph the monitoring area, extract corner features of the area around the monitoring point, and match similar features in the binocular image; calculate the depth value of the feature pixel, calculate the three-dimensional coordinates of the feature point and the initial appearance state of the monitoring area; repeatedly measure the distance and angle between the laser distance measuring device and the monitoring point through a laser distance measuring device; integrate the binocular camera depth of field measurement with the laser distance measurement;

[0019] S4. Keep the binocular camera device posture angle unchanged, and the binocular camera device and the laser ranging device continue to measure the target area. Through the multi-sensor data and the feature point tracking module of the remote data processing device, continuously estimate the coordinate change and displacement of the feature points of the monitoring point and the nearby area in three-dimensional space compared to the initial time, and analyze the settlement, tilt and / or deformation in the monitoring area.

[0020] According to the aspects described above and any possible implementation method, an implementation method is further provided, which analyzes the appearance defects existing in the monitoring area through the artificial intelligence image recognition module of the remote data processing device based on the image of the monitoring area taken by the binocular photography device at a certain moment; analyzes the related personnel information through the face recognition module of the remote data processing device based on the image of the monitoring area taken by the binocular photography device at a certain moment; at the same time, the sound collection device uses the voice recognition module and the intelligent question and answer module to perform data voice query and function setting on the data situation analyzed at a certain moment and the system setting function according to the received voice instructions.

[0021] Beneficial effects of the present invention

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] 1. In the present invention, an artificial image intelligent recognition method is used to monitor the monitoring points, and multiple measuring points and multiple defect items can be monitored at the same time, which greatly simplifies the layout of the monitoring system and the monitoring cost, and reduces the impact on the appearance of the building caused by the installation of sensors, cables, and collectors.

[0024] 2. In the present invention, a method combining artificial image intelligent recognition and laser ranging is adopted to obtain the spatial coordinates of the monitoring points, which simplifies the monitoring system and ensures data accuracy.

[0025] 3. In the present invention, a remote data processing device is used to perform intelligent analysis on images and analyze and process coordinate data, thereby avoiding manual data processing and improving work efficiency.

[0026] 4. In the present invention, an artificial image intelligent recognition module is used to recognize human faces, which can identify related persons while discovering defects and lock in the responsible person in time.

[0027] 5. In the present invention, a voice recognition module and an intelligent question-and-answer module are used to communicate with relevant personnel on site. Compared with the traditional monitoring method, the interactive performance of the monitoring system is improved, the operation is simplified, and the timely query and use of monitoring data are facilitated.

[0028] 6. In the present invention, an early warning module is used to intelligently identify abnormal data status and issue early warnings to related personnel, so as to timely discover potential risks and ensure building safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a schematic diagram of the system structure of the present invention;

[0030] Figure 2 It is a schematic diagram of the system layout of the present invention;

[0031] Figure 3 It is a schematic diagram of the method flow of the present invention;

[0032] Figure 4 It is a measurement schematic diagram of the binocular photography device of the present invention;

[0033] Figure 5 It is a schematic diagram of the arrangement of the binocular photography device of the present invention;

[0034] Figure 6 It is a schematic diagram of the arrangement of the binocular photography device and the target paper of the present invention. DETAILED DESCRIPTION

[0035] In order to better understand the technical solution of the present invention, the content of the present invention includes but is not limited to the specific implementation methods described below, and similar technologies and methods should be considered to be within the scope of protection of the present invention. In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will be described in detail with reference to the accompanying drawings and specific embodiments.

[0036] It should be clear that the embodiments described in the present invention are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0038] The present invention provides a building monitoring system based on intelligent recognition and laser ranging, the system comprising a binocular photography device, a laser ranging device, a sound collection device, a remote data processing device and a communication device; the binocular photography device collects images of a monitoring area of ​​a building, and transmits the collected image data to the remote data processing device through a communication device; the laser ranging device measures the distance to a monitoring point in the monitoring area and position change information, and transmits the change information to the remote data processing device through a communication device; the sound collection device collects voices in the monitoring area, transmits them to the remote data processing device through a communication device, and plays the voice information returned by the remote data processing device.

[0039] Preferably, the system further comprises a module to be identified which is arranged at the monitoring point, and the module to be identified is a two-dimensional code target paper.

[0040] Specifically, Figure 1 and Figure 2 As shown, the system of the present invention includes a data acquisition device 1, a remote data processing device 2, a communication device 3, a power supply device 4, and a target paper 5. Among them, the data acquisition device 1 includes a binocular photography device 11, a laser ranging device 12, and a sound collection device 13; the remote data processing device 2 includes a feedback control algorithm module 201, a feature extraction module 202, a feature matching module 203, a feature point tracking module 204, a binocular image parallax calculation module 205, a binocular vision laser fusion module 206, an artificial intelligence image recognition module 207, a face recognition module 208, a voice recognition module 209, an intelligent question and answer module 210, and an early warning module 211. The remote data processing device 2 controls the data acquisition device 1 through the communication device 3 to collect the image data of the monitoring area 6 and the coordinate data of the target paper 5 installed at the internal monitoring point, and the voice data near the data acquisition device, and the power supply device 4 supplies power to the binocular photography device 11, the laser ranging device 12, and the sound collection device 13.

[0041] The remote data processing device 2 uses the artificial intelligence image intelligent recognition module 207 to identify the pixel coordinates and appearance defects of the monitoring point in the monitoring image; uses the feature extraction module 202 to extract the corner point features of the area around the monitoring point, and uses the feature matching module 203 to analyze the initial pixel coordinates of the monitoring point; uses the binocular image parallax calculation module 205 to infer the depth value di of the feature pixel; uses the feedback control algorithm module 201 to guide the laser ranging device 12 to rotate to the appropriate position for laser ranging, and uses the laser ray measurement results and the binocular vision laser fusion module 206 to calculate the initial spatial coordinates of the monitoring point. The above-mentioned method for obtaining the initial spatial coordinates of the monitoring points is combined with the feature point tracking module 204 to continuously monitor the monitoring points in the monitoring area, and the displacement of the monitoring points is obtained by calculating the difference between the spatial coordinates of the monitoring points and the initial spatial coordinates at a certain moment; the face recognition module 208 is used to identify the related persons appearing in the monitoring image; the voice information collected by the sound collection device 13 is recognized by the voice recognition module 209, and the recognized voice information is transmitted to the intelligent question and answer module 210 in the form of characters; the voice information collected by the sound collection device 13 is analyzed by the intelligent question and answer module 210, and data voice query and function voice setting are performed; when the data information obtained by the analysis meets the warning conditions, the abnormal state is intelligently identified through the warning module 211, and a warning is issued to the related persons.

[0042] Preferably, the binocular photography device is two cameras with a resolution of 1920×1080.

[0043] Preferably, the laser ranging device is a solid-state laser radar with certain horizontal and vertical viewing angles, and both the horizontal and vertical viewing angles are not less than 30°.

[0044] Preferably, the remote data processing device is deployed in a control room far away from the building, and performs long-distance data transmission with the binocular photography device 11, the laser ranging device 12 and the sound collection device 13 through a communication device.

[0045] Preferably, the binocular vision laser fusion module 206 uses manually corrected monitoring point coordinate data and records a data correction log.

[0046] Preferably, the feature extraction module 202 and the feature matching module 203 are SIFT operators; the binocular vision laser fusion module 206 is a Kalman filter (KF) algorithm; and the feature point tracking module is an LK optical flow algorithm.

[0047] Preferably, the feedback control is implemented using a PID controller.

[0048] Preferably, the speech recognition module 209 adopts the DeepSpeech model to collect specific speech through voiceprint recognition or password recognition; the intelligent question-answering module 210 adopts a generative large language model, such as Baichuan, GLM, etc.

[0049] Preferably, the artificial intelligence image recognition module 207 adopts the YOLO model;

[0050] Preferably, the communication device is a wireless device.

[0051] Preferably, the power supply device can adopt wired or wireless power supply. When it is inconvenient to use wired power supply, the power supply device adopts a battery or a solar charging panel to charge the monitoring device.

[0052] Preferably, the warning module 211 sends the warning information to a handheld terminal of an associated person by wireless means, and the handheld terminal is a mobile phone or an IPAD.

[0053] The working principle of the present invention includes:

[0054] Binocular Vision

[0055] Depth of field distance measurement in binocular vision of binocular photography device can be realized by triangulation. The feature points in the imaging plane of the left and right binocular cameras and the position of the measured feature in the three-dimensional world form a triangle. When the baseline distance (i.e. the positional relationship between the two cameras), the focal length of the camera and the pixel coordinates of the feature points are known, the three-dimensional coordinates of the measured object can be derived, such as Figure 4As shown, it is known that the matching feature points i in the left and right image planes are x i ,x i ', where u i ,v i ,u i ',v i ' is the pixel coordinates of the feature points in the left and right images, the projection matrices P and P' of the left and right cameras (both 4×3), where f x ,f y ,c x ,c y is the camera projection parameter, t x ,t y ,t z is the offset between the right lens and the left lens; all parameters can be obtained by camera calibration, solving the feature point coordinates X in three-dimensional space i , x i (3) ,y i (3) ,z i (3) is the three-dimensional coordinate of the feature point in the world coordinate system.

[0056]

[0057]

[0058]

[0059] Through the pinhole camera projection model, the relationship between the pixel coordinates in the left eye image and the real world coordinates can be obtained (p 1 T 、p 2 T 、p 3 T are the 1st, 2nd, and 3rd rows of the camera projection matrix P, respectively):

[0060]

[0061] By cross-multiplying the two vectors at both ends of the equation, we can obtain formula (1):

[0062]

[0063] Similarly, according to the right eye image, formula (2) can be obtained:

[0064]

[0065] Combining the first two rows of the matrix, we can construct AX i (4) = 0 form, and use singular value decomposition to obtain the vector Xi (4) Optimal solution.

[0066]

[0067] 2. Kalman filter

[0068] The Kalman filter algorithm is a data processing algorithm based on Bayesian probability theory and linear theory. It can improve data quality by filtering the data and fusing data from multiple sources. The core idea of ​​the Kalman filter is to continuously predict and observe the state of the system, and adjust the state estimate value according to the error between the predicted value and the observed value to obtain a more accurate state estimation result. In the application scenario of this invention, the monitored system state is the spatial position of the key feature points of the building. Since the settlement, tilt, deformation, etc. of the building are all small-range displacements, it can be assumed that the system state changes are linear and the data noise conforms to the Gaussian distribution.

[0069] The Kalman filter iterates continuously with the input of data, and each iteration is mainly divided into two steps: prediction and update.

[0070] In the prediction step, the result of the previous iteration (for the first iteration, the initial state) is used as the known prior information. Assume that the system state of the monitoring area at the tth iteration is x t Among them, μ t is the mean of the feature point vector, ∑ t is the covariance matrix of the feature point vector. The covariance matrix at the initial moment can be initialized according to the sensor parameters.

[0071] p(x t )~N(μ t ,∑ t )

[0072] The prediction model is derived from the binocular camera image data and the results of the previous iteration. t is the displacement data derived from binocular vision, n t is the noise of the binocular camera sensor (with a mean of 0 and a variance of Q t Gaussian distribution, Q t Can be initialized by sensor parameters); A t , B t is the state transfer matrix, which can be derived from the projection model of the binocular lens.

[0073] The prediction model is as follows: t =A t x t-1 +B t u t +n t

[0074] n t ~N(0,Q t )

[0075] The update model is derived from the laser ranging data and the results of the prediction model. t is the displacement data measured by laser, v t is the noise of the laser sensor (with a mean of 0 and a variance of R t Gaussian distribution, R t Can be initialized by sensor parameters); C t is the state observation matrix, which can be derived from the model of the laser transmitter.

[0076] Update the model as follows: t =C t x t +v t

[0077] v t ~N(0,R t )

[0078] Through the above prediction model and update model, the prediction equation and update equation of each iteration can be derived. In each prediction process of binocular vision data, the mean and variance of the state vector undergo the following transformations:

[0079]

[0080]

[0081] In each update process of laser ranging data, the mean and variance of the state vector undergo the following transformations. t is the Kalman gain, which represents the confidence weight of the two source data calculated based on the covariance.

[0082]

[0083]

[0084]

[0085] With the binocular image and laser data at each monitoring moment, the prediction and update steps are iteratively calculated alternately until the required estimation accuracy is achieved or other stopping conditions are met.

[0086] As an embodiment disclosed by the present invention, the present invention also provides a monitoring method of a building monitoring system based on intelligent identification and laser ranging, the method is implemented by the system, and the method comprises: S1. Assembling and fixing a binocular photography device and a laser ranging device so that the monitoring area and the monitoring points therein are placed within the shooting range of the binocular photography device;

[0087] S2. Paste the QR code target paper at the monitoring point and identify and locate the image therein;

[0088] S3. Use a binocular camera to photograph the monitoring area, extract corner features of the area around the monitoring point, and match similar features in the binocular image; calculate the depth value of the feature pixel, calculate the three-dimensional coordinates of the feature point and the initial appearance state of the monitoring area; repeatedly measure the distance and angle between the laser distance measuring device and the monitoring point through a laser distance measuring device; integrate the binocular camera depth of field measurement with the laser distance measurement;

[0089] S4. Keep the binocular photography device at a fixed angle, and the binocular photography device and the laser ranging device continuously measure the target area. Through the data of multiple sensors (i.e., the sensors in the binocular photography device and the laser ranging device) and the feature point tracking module of the remote data processing device, continuously estimate the coordinate changes and displacements of the feature points of the monitoring point and the nearby area in three-dimensional space compared with the initial time, and analyze the settlement, tilt and / or deformation in the monitoring area; according to the monitoring area image taken by the binocular photography device at a certain moment, analyze the appearance defects in the monitoring area through the artificial intelligence image recognition module 207 of the remote data processing device; according to the monitoring area image taken by the photography device at a certain moment, analyze the related personnel information through the face recognition module of the remote data processing device; at the same time, the sound collection device uses the voice recognition module and the intelligent question and answer module to perform data voice query and function setting on the data situation analyzed at a certain moment and the system setting function according to the received voice command.

[0090] Specifically, Figure 3 As shown, the specific process of the system implementation of the present invention is as follows:

[0091] Step 1: Assemble and fix the binocular photography device and the laser ranging device, and calibrate the sensor parameters through the calibration board, including the projection matrix of the binocular lens, the relative posture matrix between the lenses, the relative posture matrix between the lens and the laser ranging device, etc. Placing the monitoring data acquisition device in an appropriate position can place the monitoring area and the monitoring points inside it within the shooting range of the binocular photography device;

[0092] Step 2: Paste target paper 5 at the monitoring point. Multiple target papers can be pasted in the monitoring area, so that the feature extraction module of the remote data processing device can extract feature points and locate them. The binocular photography device is guided to rotate until the center of the left eye image is aligned with the origin of the target paper through the PID control algorithm, and the right eye and the center of the laser viewing angle will be synchronously aligned with the target area;

[0093] The third step: photograph the monitoring area through a binocular camera; estimate the depth of field through binocular vision, analyze the initial three-dimensional coordinates of the monitoring point and the initial appearance state of the monitoring area; automatically measure the distance and angle between the laser ranging device and the monitoring point through a laser ranging device; and optimize the initial spatial coordinates of the monitoring point by fusing multi-sensor data through a Kalman filter algorithm;

[0094] The fourth step: keep the binocular photography device unchanged, continue to measure the area near the monitoring point, and continuously track the spatial coordinates of the monitoring point at a certain moment, as well as the coordinate changes and displacements compared to the initial time, through the LK optical flow algorithm; analyze the appearance defects in the monitoring area through the artificial intelligence image recognition module 207 according to the monitoring area image taken by the binocular photography device at a certain moment; analyze the related personnel information through the face recognition module 208 according to the monitoring area image taken by the binocular photography device at a certain moment; according to the voice command received by the sound collection device 13, the data situation analyzed at a certain moment and the system setting function are subjected to data voice query and function setting through the voice recognition module 209 and the intelligent question and answer module 210; according to the data situation analyzed at a certain moment, when the data exceeds the warning value, the warning module will sound an alarm.

[0095] Specifically, in the first step, when the binocular photography device is deployed, it is preferred that no interfering objects often appear in the selected shooting range. The sensor calibration in the binocular photography device and the laser ranging device is completed in advance in the laboratory, such as Figure 5 shown.

[0096] In the second step, when the monitoring points are arranged, it is preferred to use a two-dimensional code target paper with distinct graphics and color features and a certain difference from the building exterior decoration to paste it at the monitoring point, and lock the target paper image through the corner point extraction algorithm, and rotate the binocular photography device through the feedback control algorithm so that the center of the left camera is facing the origin of the target paper, and the right camera and the center of the laser field of view are synchronously aimed at the area where the target paper is located, such as Figure 6 shown.

[0097] In the third step, when obtaining the initial coordinates of the monitoring point, after the binocular photography device collects the monitoring image, the feature extraction module is used to extract the initial pixel coordinates (u i ,v i ), and automatically number the monitoring points in a certain order; at the same time, extract the features (u i ′,vi ′), the description operator is matched with the left eye image features, and the feature depth of field is calculated through the successfully matched feature pairs, so as to calculate the three-dimensional coordinates (x i,v ,y i,v ,z i,v ); Use the laser ranging device to measure the monitoring area and obtain the initial measurement data (α j ,ω j ,l j )(i.e. the rotation angle, vertical angle and distance value of the jth beam of light), the repeated observation of the three-dimensional coordinates of the feature points is obtained through coordinate transformation and interpolation (x i,l ,y i,l ,z i,l ). The Kalman filter algorithm is used to combine binocular vision measurement and laser measurement to obtain more accurate initial spatial coordinates of the monitoring point. (Time 0, coordinates of the ith feature point) Preferably, when obtaining the initial spatial coordinates of the monitoring points, equipment such as a level and a total station can be used to assist in measuring data and correct the calculated data to improve data accuracy.

[0098] In the fourth step, after obtaining the monitoring data at a certain moment, the coordinates of the current monitoring point are obtained using the method for obtaining the initial spatial coordinates of the monitoring point in the third step. (At time t, coordinates of the i-th feature point), the actual spatial displacement of the monitoring point is calculated as Preferably, when obtaining the spatial coordinates of the monitoring point at a certain moment, a level, a total station or other equipment may be used to measure the data and correct the calculated data to improve the accuracy of the data.

[0099] The above description shows and describes several preferred embodiments of the present invention, but as mentioned above, it should be understood that the present invention is not limited to the form disclosed herein, and should not be regarded as excluding other embodiments, but can be used in various other combinations, modifications and environments, and can be modified within the scope of the application concept described herein through the above teachings or the technology or knowledge of the relevant field. The changes and modifications made by those skilled in the art shall not depart from the spirit and scope of the present invention, and shall be within the scope of protection of the claims attached to the present invention.

Claims

1. A building monitoring system based on intelligent recognition and laser ranging, characterized in that: The system includes a binocular photography device, a laser distance measuring device, a sound collection device, a remote data processing device and a communication device; The binocular photography device collects images of the monitoring area of ​​the building, and transmits the collected image data to the remote data processing device through the communication device; The laser distance measuring device measures the distance to the monitoring point in the monitoring area and the position change information, and transmits the change information to the remote data processing device through the communication device; The sound collection device collects the voice in the monitoring area, transmits it to the remote data processing device through the communication device, and plays the voice information returned by the remote data processing device.

2. The building monitoring system based on intelligent identification and laser ranging according to claim 1 is characterized in that: The system also includes a module to be identified which is arranged at the monitoring point.

3. The building monitoring system based on intelligent identification and laser ranging according to claim 2 is characterized in that: The module to be identified is a target paper.

4. The building monitoring system based on intelligent identification and laser ranging according to claim 1 is characterized in that: The binocular photography device is two cameras.

5. The building monitoring system based on intelligent identification and laser ranging according to claim 1 is characterized in that: The laser distance measuring device is a solid-state laser radar with certain horizontal and vertical viewing angles.

6. The building monitoring system based on intelligent identification and laser ranging according to claim 1 is characterized in that: It also includes a power supply device, which uses a battery or a solar charging panel.

7. The building monitoring system based on intelligent identification and laser ranging according to claim 6 is characterized in that: The remote data processing device includes an artificial intelligence image recognition module, a coordinate calculation module, a face recognition module, a voice recognition module, an intelligent question and answer module and an early warning module.

8. The building monitoring system based on intelligent identification and laser ranging according to claim 7 is characterized in that: The warning module sends the warning information to the handheld terminal of the associated personnel by wireless means.

9. A monitoring method for a building monitoring system based on intelligent identification and laser ranging, characterized in that: The method is implemented by the system according to any one of claims 1 to 8, and the method comprises: S1. Assembling and fixing a binocular photography device and a laser ranging device so that the monitoring area and the monitoring points therein are placed within the shooting range of the binocular photography device; S2. Paste target paper at the monitoring point and identify and locate the image therein; S3. Use a binocular camera to photograph the monitoring area, extract corner features of the area around the monitoring point, and match similar features in the binocular image; calculate the depth value of the feature pixel, calculate the three-dimensional coordinates of the feature point and the initial appearance state of the monitoring area; repeatedly measure the laser distance and angle between the laser distance measuring device and the monitoring point through a laser distance measuring device; integrate the depth measurement of the binocular camera with the laser distance measurement; S4. Keep the binocular camera device posture angle unchanged, and the binocular camera device and the laser ranging device continue to measure the target area. Through the multi-sensor data and the feature point tracking module of the remote data processing device, continuously estimate the coordinate change and displacement of the feature points of the monitoring point and the nearby area in three-dimensional space compared to the initial time, and analyze the settlement, tilt and / or deformation in the monitoring area.

10. The monitoring method according to claim 9, characterized in that: Based on the image of the monitoring area taken by the binocular photography device at a certain moment, the appearance defects existing in the monitoring area are analyzed through the artificial intelligence image recognition module of the remote data processing device; based on the image of the monitoring area taken by the binocular photography device at a certain moment, the face recognition module of the remote data processing device is used to analyze the information of related personnel; at the same time, the sound collection device uses the voice recognition module and the intelligent question and answer module to perform data voice query and function setting on the data situation analyzed at a certain moment and the system setting function according to the received voice instructions.

Citation Information

Cited By

  • Safety evaluation method based on laser ranging and laser measuring instrument used by same

    CN121522651A