Building safety assessment and management system based on multi-modal data

Abstract

The application discloses a building safety evaluation and management system based on multi-modal data, relates to the technical field of building safety evaluation, and comprises an environment similarity analysis module, a hidden danger evaluation module, a building safety evaluation module and a building safety management module.The environment similarity analysis module is used for analyzing the similarity of hidden danger occurrence environments between different historical building safety detection records.The hidden danger evaluation module is used for evaluating the hidden danger risks of characteristic buildings in different numerical ranges of different associated detection parameters.The building safety evaluation module is used for evaluating the hidden danger risks of buildings in a current period to obtain hidden danger data.The building safety management module is used for managing the building safety of buildings in the current period according to the hidden danger data, and fundamentally solves the problem that different modal data joint conditions are difficult to capture, and greatly reduces the probability of hidden danger omission in the building safety evaluation process.

Description

Technical Field

[0001] This invention relates to the field of building safety assessment technology, specifically to a building safety assessment and management system based on multimodal data. Background Technology

[0002] As my country's infrastructure construction continues to expand, the traditional construction quality and safety model that relies on manual visual inspection is increasingly revealing prominent problems such as low efficiency, strong subjectivity, and many blind spots in inspection. At the same time, emerging technologies such as the Internet of Things and sensor technology are being used more and more widely in the field of construction quality and safety. Currently, it is possible to acquire data in different modalities, including images, vibration acceleration signals, and ambient temperature, in the field of construction quality and safety. Multimodal data fusion technology can effectively solve the shortcomings of traditional manual visual inspection, such as poor subjectivity and low efficiency.

[0003] Although multimodal data fusion technology has solved most of the shortcomings of traditional safety and quality inspection methods, in actual safety assessments, building safety hazards are not revealed by a single modal signal. Instead, multiple signals from multiple modal data need to form a joint judgment under specific conditions. This means that a single modal data may appear to be within the normal range, but because multiple signals from multiple modal data are interconnected under specific conditions, they can affect building safety. However, existing technologies cannot accurately capture such interconnected effects under specific conditions. This not only makes it impossible to discover building safety hazards, but may also cause a vicious chain reaction and lead to more serious safety accidents. Summary of the Invention

[0004] The purpose of this invention is to provide a building safety assessment and management system based on multimodal data to solve the problems raised in the prior art.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a building safety assessment and management system based on multimodal data, the system including an environmental similarity analysis module, a hazard assessment module, a building safety assessment module, and a building safety management module; The environmental similarity analysis module is used to acquire safety inspection records and preset inspection data of historical buildings, analyze the degree of similarity of the environmental occurrence of safety hazards among different safety inspection records of historical buildings, and obtain a set of similar historical buildings; The hazard assessment module is used to determine similar historical concentrated changes in environmental parameters, identify associated detection parameters, assess the safety hazard risks of characteristic buildings under different numerical ranges of different associated detection parameters, and obtain target hazard data. The building safety assessment module is used to acquire multimodal data of a building in the current period and, in combination with target hazard data, assess the safety hazard risk of the building in the current period to obtain safety hazard data. The building safety management module is used to manage the building safety within the current period based on safety hazard data.

[0006] Furthermore, the hazard assessment module includes an association determination unit and an association hazard assessment unit; The correlation determination unit is used to analyze the degree of abrupt change of environmental parameters in the safety inspection records of historical buildings in similar historical sets, determine the changed environmental parameters in similar historical sets, analyze the correlation strength between different detection parameters under different data ranges of different changed environmental parameters, and determine the associated detection parameters. The associated hazard assessment unit is used to acquire associated detection parameters, assess the safety hazard risk of characteristic buildings under different numerical ranges of different associated detection parameters at different time scales, and obtain target hazard data; Through the steps described above, the shortcomings of traditional methods in identifying hidden safety hazards at the level of multimodal data are addressed. The specific conditions under which hidden safety hazards exist are clarified, and not only are the characteristic conditions accurately acquired, but the correlation and influence between different detection parameters under specific conditions are also accurately captured. This fundamentally solves the core pain point that traditional single-modal or simple splicing fusion methods cannot identify joint triggering conditions, turning hidden safety hazards that are not easy to detect into visible features that can be accurately captured. This greatly improves the accuracy of building safety assessment and effectively ensures building safety.

[0007] Furthermore, by associating and determining the units, the environmental parameters of similar historical clusters are determined, and the range of mutation parameters of similar historical clusters is obtained; Calculate the duration percentage F of a certain mutation parameter range group, set the duration percentage threshold F´. When F>F´, the numerical range of each changed environmental parameter in a certain mutation parameter range group is recorded as the target range of a certain building safety hazard type. When F≤F´, no processing is performed on a certain mutation parameter range group. When the duration percentage of each mutation parameter range group in a similar historical set is less than F´, the mutation parameter range corresponding to the maximum duration percentage is obtained and recorded as the target range of a certain building safety hazard type. Obtain the historical periods within the target range for various changing environmental parameters in the safety inspection records of historical buildings, and record them as marked historical periods; Obtain the difference between the maximum and minimum values ​​of the inspection parameters in the historical building safety inspection record, obtain the change value L of a certain inspection parameter in the historical building safety inspection record, obtain the change value L´ of a certain inspection parameter in the historical safety inspection record within the marked historical period, and calculate the change amplitude value G=L´ / L of a certain inspection parameter in the historical safety inspection record within the marked historical period; Set a threshold g for the magnitude of change. When G>g, it is determined that a certain detection parameter has a data turning point in the marked historical period. Otherwise, no processing is performed on the certain detection parameter. When another detection parameter detects a data inflection point within the marked historical period of the historical building safety inspection record, it is determined that there is a data correlation between the two detection parameters; obtain the total number f of historical building safety inspection records, and obtain the total number f times that there is a data correlation between the two detection parameters. sum Calculate the parametric correlation strength value H = f / f between one detection parameter and another. sum Set a correlation strength threshold H'. When H>H', it is determined that there is a data correlation between one detection parameter and another detection parameter, and the one detection parameter and the other detection parameter are recorded as the correlated detection parameters. When H≤H', it is determined that there is no data correlation between one detection parameter and another parameter.

[0008] Furthermore, by associating the hazard assessment unit, the minimum and minimum values ​​of the associated detection parameters after the data turning point in the historical period are obtained in the safety inspection records of each historical building, and the characteristic value range of the associated detection parameters is constructed. Obtain the duration of the distance between the data turning point marked in the historical period and the historical time point when the characteristic building was found to have safety hazards in the historical building safety inspection record, and record it as the characteristic duration of the associated detection parameter in the historical building safety inspection record; Obtain the minimum value T of the mean characteristic duration of each associated detection parameter in the safety inspection records of each historical building. min The target time scale is defined as follows: when all environmental parameters change within the target range, and the duration of the associated detection parameters within the characteristic value range exceeds the target time scale, the building is considered to have a safety hazard risk. The target range of each changing environmental parameter, the characteristic value range of each associated detection parameter, and the target time scale of a certain type of building safety hazard are obtained and aggregated to obtain the target hazard data of a certain type of building safety hazard in various characteristic buildings within a similar historical set.

[0009] Furthermore, the environmental similarity analysis module includes a building similarity analysis unit and an environmental similarity analysis unit; The building similarity analysis unit is used to obtain buildings from the platform that have undergone building safety inspections and have been found to have safety hazards within a historical period, and record them as characteristic buildings, and analyze the degree of similarity in architectural design between different characteristic buildings. The environmental similarity analysis unit acquires historical building safety inspection records and preset inspection data of characteristic buildings with similar architectural designs, and acquires individual historical building safety inspection records of characteristic buildings with similar architectural designs. It analyzes the degree of similarity in the environmental occurrence of safety hazards among the various historical building safety inspection records to obtain a similar historical set.

[0010] Furthermore, through the building similarity analysis unit, design data of characteristic buildings are obtained from the platform, data of various design parameters of characteristic buildings are obtained from the design data, design feature vectors of characteristic buildings are constructed, and the architectural design similarity between various characteristic buildings is calculated. Set a similarity threshold for architectural design. When the similarity between the architectural design of one feature building and another feature building is greater than the similarity threshold, it is determined that the architectural design of one feature building and another feature building is similar, and the other feature building is recorded as a similar building to the first feature building. Obtain several similar buildings of a certain characteristic building, and obtain the historical building safety inspection records of the certain characteristic building and several similar buildings to obtain a similar building record set A.

[0011] Furthermore, through the environmental similarity analysis unit, the unit time is set to obtain the values ​​of various detection parameters of the historical building safety inspection records in the similar building record set A, obtain the detection preset data, obtain the preset range of various detection parameters from the detection preset data, obtain the historical time point t where the building safety hazard was detected in a certain historical building safety inspection record in the similar building record set A, obtain the record start time point t´ in a certain historical building safety inspection record, obtain the historical time period between time point t´ and the time point where the unit time before the historical time point t is located, and record it as the characteristic historical time period of a certain historical building safety inspection record; When all the detection parameters of a certain historical building safety inspection record are within the preset range during a characteristic historical period, the historical building safety inspection record is marked, the data of various environmental parameters in the historical building safety inspection record are obtained, and the environmental feature vector of the historical building safety inspection record is constructed. The environmental feature vector of another marked historical building safety inspection record is obtained from the set of similar building records A. Among them, the types of building safety hazards detected in the historical building safety inspection record and the other historical building safety inspection record are the same. Calculate the environmental similarity value S between a safety inspection record of a certain historical building and another safety inspection record of a certain historical building, set an environmental similarity threshold S', and when S>S', it is determined that the safety hazards in a certain historical building safety inspection record and another historical building safety inspection record are similar in environment. Obtain from the similar building record set A the safety inspection records of various marked historical buildings whose safety hazards are similar to those of a certain historical building. Combine the marked historical building safety inspection records with the safety inspection record of a certain historical building to obtain the similar historical set B. The types of building safety hazards in the safety inspection records of various historical buildings in the similar historical set B are the same.

[0012] Furthermore, the building safety assessment module includes a building safety assessment unit; The building safety assessment unit is used to monitor a building during the current period, obtain multimodal data of the building during the current period, acquire target hazard data, assess the safety hazard risk of the building during the current period, and obtain safety hazard data.

[0013] Furthermore, through the building safety assessment unit, target hazard data and preset detection data for various building safety hazard types of buildings with similar architectural design characteristics are obtained; Data on various environmental parameters and detection parameters of the building in the current period are obtained from multimodal data. Preset ranges of various detection parameters are obtained from the preset detection data. When the maximum and minimum values ​​of the γth detection parameter are not within the preset range, the building is determined to have safety hazards in the current period. The building safety hazard type corresponding to the γth detection parameter is obtained from the platform and recorded as the target building safety hazard type in the current period. If the maximum and minimum values ​​of all detection parameters of the building are within the preset range in the detection preset data during the current period, then the target hazard data of the p-th building safety hazard type is obtained, and the target range of each changing environmental parameter, the characteristic value range of each associated detection parameter and the target time scale of each building safety hazard type in the p-th building safety hazard type are obtained from the target hazard data. Obtain the target hazard data for the p-th type of building safety hazard, and obtain several changing environmental parameters for the p-th type of building safety hazard. If the values ​​of several changing environmental parameters are within the target range in the target hazard data and the duration is greater than the target time scale, then obtain the data of several associated detection parameters for the p-th type of building safety hazard. Otherwise, it is determined that the building does not have the risk of the p-th type of building safety hazard occurring in the current period. If the values ​​of several associated detection parameters are within the range of characteristic values ​​and the duration is longer than the target time scale, then it is determined that the building has the risk of the p-th type of building safety hazard in the current period, and the p-th type of building safety hazard is recorded as the target type of building safety hazard in the current period. Otherwise, it is determined that the building does not have the risk of the p-th type of building safety hazard in the current period. The target building safety hazard types within the current period are obtained and aggregated to obtain the building safety hazard data within the current period.

[0014] Furthermore, the building safety management module includes a building safety management unit; The building safety management unit is used to manage the building safety within the current period. The specific management process is as follows: when the building has a target building safety hazard type that is at risk within the current period in the safety hazard data, a building safety risk alarm is sent through the platform. The target building safety hazard type is also sent to the building's safety management personnel through the platform, notifying the safety management personnel to dispatch personnel to carry out safety maintenance on the building.

[0015] Compared with existing technologies, the beneficial effects of this invention are as follows: By analyzing the similarity of different building environments when safety hazards occur, a similar historical set of safety hazards of the same type and similar building environments is gathered. Through the analysis of similar historical sets, it is found that under what data ranges and for which environmental parameters, characteristic buildings will have safety hazard risks that cannot be detected by preset thresholds. Furthermore, the correlation strength between different detection parameters under this environmental condition is analyzed to determine the associated detection parameters, and the safety hazard risk of characteristic buildings under different numerical ranges of different associated detection parameters at different time scales is evaluated. Thus, the judgment conditions for hidden safety hazards are clarified, and the judgment conditions are used to accurately capture hidden safety hazards of buildings in the current period. This fundamentally solves the problem that it is difficult to capture hidden safety hazards under the joint conditions of different modal data, greatly reduces the probability of missing hidden safety hazards in the building safety assessment process, and realizes true building safety management. Attached Figure Description

[0016] Figure 1 This is a flowchart of the modules of the building safety assessment and management system based on multimodal data of the present invention; Figure 2 This is a flowchart of parameter correlation determination for the building safety assessment and management system based on multimodal data according to the present invention. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Example: Figures 1-2As shown, the present invention provides a technical solution, a building safety assessment and management system based on multimodal data, the system including an environmental similarity analysis module, a hazard assessment module, a building safety assessment module and a building safety management module; The environmental similarity analysis module is used to acquire safety inspection records and preset inspection data of historical buildings, analyze the degree of similarity of the environmental occurrence of safety hazards among different safety inspection records of historical buildings, and obtain a set of similar historical buildings; The environmental similarity analysis module includes a building similarity analysis unit and an environmental similarity analysis unit. The building similarity analysis unit is used to obtain buildings from the platform that have undergone building safety inspections and have been found to have safety hazards within a historical period, and record them as characteristic buildings, and analyze the degree of similarity in architectural design between different characteristic buildings. For example, the design parameters of a distinctive building include the building frame and the fortification intensity. For example, when the design parameters of a feature building are ordered features, each ordered category of the design parameters is assigned an equally spaced integer, and then mapped to the interval [0, 1] through Min-Max normalization; When the design parameters are categorical features, they are processed using one-hot encoding. For example, the specific construction process for constructing the design feature vector of a characteristic building is as follows: The design parameters of the feature building after one-hot encoding and Min-Max normalization are collected in a preset order to obtain the design feature vector of the feature building. The architectural design similarity between various characteristic buildings is calculated as follows: Calculate the cosine similarity of the design feature vectors between each feature building to obtain the architectural design similarity between each feature building; The environmental similarity analysis unit acquires historical building safety inspection records and preset inspection data of characteristic buildings with similar architectural designs, and acquires individual historical building safety inspection records of characteristic buildings with similar architectural designs. It analyzes the degree of similarity in the environmental occurrence of safety hazards among the various historical building safety inspection records to obtain a similar historical set. Specifically, through the building similarity analysis unit, design data of characteristic buildings are obtained from the platform, data of various design parameters of characteristic buildings are obtained from the design data, design feature vectors of characteristic buildings are constructed, and the architectural design similarity between various characteristic buildings is calculated. Set a similarity threshold for architectural design. When the similarity between the architectural design of one feature building and another feature building is greater than the similarity threshold, it is determined that the architectural design of one feature building and another feature building is similar, and the other feature building is recorded as a similar building to the first feature building. Obtain several similar buildings of a certain characteristic building, and obtain the historical building safety inspection records of the certain characteristic building and several similar buildings to obtain a similar building record set A; Specifically, through the environmental similarity analysis unit, the unit time is set to obtain the values ​​of various detection parameters in the safety inspection records of historical buildings in the similar building record set A, obtain the detection preset data, obtain the preset range of various detection parameters from the detection preset data, obtain the historical time point t where the building safety hazard was detected in a certain historical building safety inspection record in the similar building record set A, obtain the record start time point t´ in a certain historical building safety inspection record, obtain the historical time period between time point t´ and the time point where the unit time before the historical time point t is located, and record it as the characteristic historical time period of a certain historical building safety inspection record; When all the detection parameters of a certain historical building safety inspection record are within the preset range during a characteristic historical period, the historical building safety inspection record is marked, the data of various environmental parameters in the historical building safety inspection record are obtained, and the environmental feature vector of the historical building safety inspection record is constructed. The environmental feature vector of another marked historical building safety inspection record is obtained from the set of similar building records A. Among them, the types of building safety hazards detected in the historical building safety inspection record and the other historical building safety inspection record are the same. For example, the various test parameters recorded in the safety inspection records of historical buildings include the width of building cracks, the building's natural frequency, environmental wind pressure, and environmental humidity. For example, various types of building safety hazards include foundation slippage, steel reinforcement corrosion, and component decay; Calculate the environmental similarity value S between a safety inspection record of a certain historical building and another safety inspection record of a certain historical building, set an environmental similarity threshold S', and when S>S', it is determined that the safety hazards in a certain historical building safety inspection record and another historical building safety inspection record are similar in environment. For example, environmental parameters in the safety inspection record of a certain historical building include ambient temperature, ambient relative humidity, etc. For example, the specific process for constructing the environmental feature vector of a safety inspection record for a historical building is as follows: The mean values ​​of various environmental parameters in the safety inspection record of a certain historical building are obtained, normalized, and aggregated in a preset order to obtain the environmental feature vector of the safety inspection record of a certain historical building. For example, the specific calculation process for the environmental similarity value S is as follows: Calculate the cosine similarity of the environmental feature vectors between the safety inspection records of one historical building and another historical building, and denot it as the environmental similarity value S; Obtain from the similar building record set A the safety inspection records of various marked historical buildings whose safety hazards are similar to those of a certain historical building. Combine the marked historical building safety inspection records with the safety inspection record of a certain historical building to obtain the similar historical set B. The types of building safety hazards in the safety inspection records of various historical buildings in the similar historical set B are the same.

[0019] The hazard assessment module is used to determine similar historical concentrated changes in environmental parameters, identify associated detection parameters, assess the safety hazard risks of characteristic buildings under different numerical ranges of different associated detection parameters, and obtain target hazard data. The hazard assessment module includes an association determination unit and an association hazard assessment unit. The correlation determination unit is used to analyze the degree of abrupt change of environmental parameters in the safety inspection records of historical buildings in similar historical sets, determine the changed environmental parameters in similar historical sets, analyze the correlation strength between different detection parameters under different data ranges of different changed environmental parameters, and determine the associated detection parameters. The associated hazard assessment unit is used to acquire associated detection parameters, assess the safety hazard risk of characteristic buildings under different numerical ranges of different associated detection parameters at different time scales, and obtain target hazard data; Among them, by determining the associated units, the environmental parameters of similar historical sets are determined, and the range of mutation parameters of similar historical sets is obtained; For example, to determine the environmental parameters of similar historical sets and obtain the range of mutation parameters for similar historical sets, the specific process is as follows: Obtain the relevant historical data set corresponding to a specific type of building safety hazard. Then, obtain the maximum and minimum values ​​of various environmental parameters from the historical building safety inspection records within the characteristic historical period. Finally, calculate the data mutation value R of the c-th environmental parameter in the historical building safety inspection records. c ; For example, the data mutation value R c The specific formula is: , Where T´ represents the duration corresponding to the characteristic historical period in the safety inspection record of the historical building; D (c,max) For the safety inspection record of historical buildings, the maximum value of the c-th environmental parameter is recorded within the characteristic historical period; D (c,min) The minimum value of the c-th environmental parameter recorded during the characteristic historical period for safety inspection of historical buildings; T is the unit of time. Obtain the mean value of the data mutation of the c-th environmental parameter in the safety inspection records of various historical buildings in similar historical sets, and record it as the overall mutation value β of the c-th environmental parameter in similar historical sets. cSet the overall mutation threshold β. When β c When β > β, the c-th environmental parameter in the similar historical set is determined to be unstable, and the c-th environmental parameter is recorded as the changing environmental parameter in the similar historical set. c When ≤β, the c-th environmental parameter in the similar historical set is determined to be stable, and no processing is performed on the c-th environmental parameter; Set a feature value k to obtain the maximum value D of the changing environmental parameters of each historical building safety inspection record within a characteristic historical period in a similar historical set. max and minimum value D min Construct the range of changing environmental parameters α=[D min D max Divide the range α into k uniformly sized numerical ranges to obtain k numerical ranges of the changing environmental parameters. Obtain k numerical ranges of each changing environmental parameter in the similar historical set. Then, randomly select a numerical range from each changing environmental parameter and combine them to obtain the mutation parameter range group of the similar historical set. Calculate the duration percentage F of a certain mutation parameter range group, set the duration percentage threshold F´. When F>F´, the numerical range of each changed environmental parameter in a certain mutation parameter range group is recorded as the target range of a certain building safety hazard type. When F≤F´, no processing is performed on a certain mutation parameter range group. When the duration percentage of each mutation parameter range group in a similar historical set is less than F´, the mutation parameter range corresponding to the maximum duration percentage is obtained and recorded as the target range of a certain building safety hazard type. For example, the specific calculation process for calculating the duration percentage F of a certain mutation parameter range group is as follows: Obtain the total duration t of the values ​​of various environmental parameters changing within a certain range of abrupt change parameters in the safety inspection records of each historical building during a specific historical period. sum Obtain the total duration T of characteristic historical periods from the safety inspection records of each historical building. sum Calculate the duration percentage F=t for a certain mutation parameter range group. sum / T sum ; Obtain the historical periods within the target range for various changing environmental parameters in the safety inspection records of historical buildings, and record them as marked historical periods; Obtain the difference between the maximum and minimum values ​​of the inspection parameters in the historical building safety inspection record, obtain the change value L of a certain inspection parameter in the historical building safety inspection record, obtain the change value L´ of a certain inspection parameter in the historical safety inspection record within the marked historical period, and calculate the change amplitude value G=L´ / L of a certain inspection parameter in the historical safety inspection record within the marked historical period; Set a threshold g for the magnitude of change. When G>g, it is determined that a certain detection parameter has a data turning point in the marked historical period. Otherwise, no processing is performed on the certain detection parameter. When another detection parameter detects a data inflection point within the marked historical period of the historical building safety inspection record, it is determined that there is a data correlation between the two detection parameters; obtain the total number f of historical building safety inspection records, and obtain the total number f times that there is a data correlation between the two detection parameters. sum Calculate the parametric correlation strength value H = f / f between one detection parameter and another. sum Set a correlation strength threshold H´. When H>H´, it is determined that there is a data correlation between one detection parameter and another detection parameter, and the one detection parameter and the other detection parameter are recorded as the correlation detection parameter. When H≤H´, it is determined that there is no data correlation between one detection parameter and another parameter. Among them, by associating the hazard assessment unit, the minimum and minimum values ​​of the associated detection parameters after the data turning point in the historical period are obtained in the safety inspection records of each historical building, and the characteristic value range of the associated detection parameters is constructed. Obtain the duration of the distance between the data turning point marked in the historical period and the historical time point when the characteristic building was found to have safety hazards in the historical building safety inspection record, and record it as the characteristic duration of the associated detection parameter in the historical building safety inspection record; Obtain the minimum value T of the mean characteristic duration of each associated detection parameter in the safety inspection records of each historical building. min The target time scale is defined as follows: when all environmental parameters change within the target range, and the duration of the associated detection parameters within the characteristic value range exceeds the target time scale, the building is considered to have a safety hazard risk. The target range of each changing environmental parameter, the characteristic value range of each associated detection parameter, and the target time scale of a certain type of building safety hazard are obtained and aggregated to obtain the target hazard data of a certain type of building safety hazard in various characteristic buildings within a similar historical set.

[0020] The building safety assessment module is used to acquire multimodal data of a building in the current period and, in combination with target hazard data, assess the safety hazard risk of the building in the current period to obtain safety hazard data. The building safety assessment module includes a building safety assessment unit. The building safety assessment unit is used to monitor a building during the current period, obtain multimodal data of the building during the current period, acquire target hazard data, assess the safety hazard risk of the building during the current period, and obtain safety hazard data.

[0021] Among them, through the building safety assessment unit, target hazard data and detection preset data of various building safety hazard types of characteristic buildings with similar architectural designs to the building are obtained; Data on various environmental parameters and detection parameters of the building in the current period are obtained from multimodal data. Preset ranges of various detection parameters are obtained from the preset detection data. When the maximum and minimum values ​​of the γth detection parameter are not within the preset range, the building is determined to have safety hazards in the current period. The building safety hazard type corresponding to the γth detection parameter is obtained from the platform and recorded as the target building safety hazard type in the current period. If the maximum and minimum values ​​of all detection parameters of the building are within the preset range in the detection preset data during the current period, then the target hazard data of the p-th building safety hazard type is obtained, and the target range of each changing environmental parameter, the characteristic value range of each associated detection parameter and the target time scale of each building safety hazard type in the p-th building safety hazard type are obtained from the target hazard data. For example, the building's multimodal data during the current cycle includes ambient temperature, ambient relative humidity, building crack width, building natural frequency, ambient wind pressure, etc. Obtain the target hazard data for the p-th type of building safety hazard, and obtain several changing environmental parameters for the p-th type of building safety hazard. If the values ​​of several changing environmental parameters are within the target range in the target hazard data and the duration is greater than the target time scale, then obtain the data of several associated detection parameters for the p-th type of building safety hazard. Otherwise, it is determined that the building does not have the risk of the p-th type of building safety hazard occurring in the current period. If the values ​​of several associated detection parameters are within the range of characteristic values ​​and the duration is longer than the target time scale, then it is determined that the building has the risk of the p-th type of building safety hazard in the current period, and the p-th type of building safety hazard is recorded as the target type of building safety hazard in the current period. Otherwise, it is determined that the building does not have the risk of the p-th type of building safety hazard in the current period. The target building safety hazard types within the current period are obtained and aggregated to obtain the building safety hazard data within the current period.

[0022] The building safety management module is used to manage the building safety within the current period based on safety hazard data; The building safety management module includes a building safety management unit; The building safety management unit is used to manage the building safety within the current period. The specific management process is as follows: when the building has a target building safety hazard type that is at risk within the current period in the safety hazard data, a building safety risk alarm is sent through the platform. The target building safety hazard type is also sent to the building's safety management personnel through the platform, notifying the safety management personnel to dispatch personnel to carry out safety maintenance on the building.

[0023] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the present invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

Claims

1. A building safety assessment and management system based on multimodal data, characterized in that, The system includes an environmental similarity analysis module, a hazard assessment module, a building safety assessment module, and a building safety management module; The environmental similarity analysis module is used to acquire historical building safety inspection records and preset inspection data, analyze the degree of similarity of the environmental occurrence of safety hazards among different historical building safety inspection records, and obtain a similar historical set; The hazard assessment module is used to determine similar historical concentrated changes in environmental parameters, determine associated detection parameters, assess the safety hazard risk of characteristic buildings under different numerical ranges of different associated detection parameters, and obtain target hazard data. The building safety assessment module is used to acquire multimodal data of the building in the current period, and combine it with target hazard data to assess the safety hazard risk of the building in the current period, thereby obtaining safety hazard data. The building safety management module is used to manage the building safety within the current period based on safety hazard data.

2. The building safety assessment and management system based on multimodal data according to claim 1, characterized in that, The hazard assessment module includes an association determination unit and an association hazard assessment unit; The association determination unit is used to analyze the degree of abrupt change of environmental parameters in the safety inspection records of historical buildings in similar historical sets, determine the changed environmental parameters in similar historical sets, analyze the correlation strength between different detection parameters under different data ranges of different changed environmental parameters, and determine the associated detection parameters. The associated hazard assessment unit is used to acquire associated detection parameters, assess the safety hazard risk of characteristic buildings under different numerical ranges of different associated detection parameters at different time scales, and obtain target hazard data.

3. The building safety assessment and management system based on multimodal data according to claim 2, characterized in that: The correlation determination unit determines the environmental parameters of similar historical sets and obtains the range of mutation parameters for similar historical sets. Calculate the duration percentage F of a certain mutation parameter range group, set the duration percentage threshold F´. When F>F´, the numerical range of each changed environmental parameter in a certain mutation parameter range group is recorded as the target range of a certain building safety hazard type. When F≤F´, no processing is performed on a certain mutation parameter range group. When the duration percentage of each mutation parameter range group in a similar historical set is less than F´, the mutation parameter range corresponding to the maximum duration percentage is obtained and recorded as the target range of a certain building safety hazard type. Obtain the historical periods within the target range for various changing environmental parameters in the safety inspection records of historical buildings, and record them as marked historical periods; Obtain the difference between the maximum and minimum values ​​of the inspection parameters in the historical building safety inspection record, obtain the change value L of a certain inspection parameter in the historical building safety inspection record, obtain the change value L´ of a certain inspection parameter in the historical safety inspection record within the marked historical period, and calculate the change amplitude value G=L´ / L of a certain inspection parameter in the historical safety inspection record within the marked historical period; Set a threshold g for the magnitude of change. When G>g, it is determined that a certain detection parameter has a data turning point in the marked historical period. Otherwise, no processing is performed on the certain detection parameter. When another detection parameter detects a data inflection point within the marked historical period of the historical building safety inspection record, it is determined that there is a data correlation between one detection parameter and the other detection parameter. Get the total number f of safety inspection records for historical buildings, and get the total number f of data correlations between one inspection parameter and another. sum Calculate the parametric correlation strength value H = f / f between one detection parameter and another. sum Set a correlation strength threshold H'. When H>H', it is determined that there is a data correlation between one detection parameter and another detection parameter, and the one detection parameter and the other detection parameter are recorded as the correlated detection parameters. When H≤H', it is determined that there is no data correlation between one detection parameter and another parameter.

4. The building safety assessment and management system based on multimodal data according to claim 3, characterized in that: The associated hazard assessment unit obtains the minimum and minimum values ​​of the associated detection parameters after the data turning point in the historical period marked in the safety inspection records of each historical building, and constructs the characteristic value range of the associated detection parameters. Obtain the duration of the distance between the data turning point marked in the historical period and the historical time point when the characteristic building was found to have safety hazards in the historical building safety inspection record, and record it as the characteristic duration of the associated detection parameter in the historical building safety inspection record; Obtain the minimum value T of the mean characteristic duration of each associated detection parameter in the safety inspection records of each historical building. min The target time scale is defined as follows: when all environmental parameters change within the target range and the duration of the associated detection parameters within the characteristic value range exceeds the target time scale, the building is considered to have a safety hazard risk. The target range of each changing environmental parameter, the characteristic value range of each associated detection parameter, and the target time scale of a certain type of building safety hazard are obtained and aggregated to obtain the target hazard data of a certain type of building safety hazard in various characteristic buildings within a similar historical set.

5. The building safety assessment and management system based on multimodal data according to claim 1, characterized in that, The environmental similarity analysis module includes a building similarity analysis unit and an environmental similarity analysis unit; The building similarity analysis unit is used to obtain buildings that have undergone building safety inspections and have been found to have safety hazards within a historical period from the platform, and record them as characteristic buildings, and analyze the degree of similarity in architectural design between different characteristic buildings. The environmental similarity analysis unit acquires historical building safety inspection records and preset inspection data of characteristic buildings with similar architectural designs, and acquires the safety inspection records of each historical building of characteristic buildings with similar architectural designs. It analyzes the degree of similarity in the environmental occurrence of safety hazards among the safety inspection records of each historical building to obtain a similar historical set.

6. The building safety assessment and management system based on multimodal data according to claim 5, characterized in that: The building similarity analysis unit obtains the design data of the characteristic buildings from the platform, extracts the design parameters of the characteristic buildings from the design data, constructs the design feature vector of the characteristic buildings, and calculates the building design similarity between the various characteristic buildings. Set a similarity threshold for architectural design. When the similarity between the architectural design of one feature building and another feature building is greater than the similarity threshold, it is determined that the architectural design of one feature building and another feature building is similar, and the other feature building is recorded as a similar building to the first feature building. Obtain several similar buildings of a certain characteristic building, and obtain the historical building safety inspection records of the certain characteristic building and several similar buildings to obtain a similar building record set A.

7. The building safety assessment and management system based on multimodal data according to claim 6, characterized in that: Through the environmental similarity analysis unit, the unit time is set to obtain the values ​​of various detection parameters of the historical building safety inspection records in the similar building record set A, obtain the detection preset data, obtain the preset range of various detection parameters from the detection preset data, obtain the historical time point t where the building safety hazard was detected in a certain historical building safety inspection record in the similar building record set A, obtain the record start time point t´ in a certain historical building safety inspection record, obtain the historical time period between time point t´ and the time point where the unit time before the historical time point t is located, and record it as the characteristic historical time period of a certain historical building safety inspection record; When all the detection parameters of a certain historical building safety inspection record are within the preset range during a characteristic historical period, the historical building safety inspection record is marked, the data of various environmental parameters in the historical building safety inspection record are obtained, and the environmental feature vector of the historical building safety inspection record is constructed. The environmental feature vector of another marked historical building safety inspection record is obtained from the set of similar building records A. Among them, the types of building safety hazards detected in the historical building safety inspection record and the other historical building safety inspection record are the same. Calculate the environmental similarity value S between a safety inspection record of a certain historical building and another safety inspection record of a certain historical building, set an environmental similarity threshold S', and when S>S', it is determined that the safety hazards in a certain historical building safety inspection record and another historical building safety inspection record are similar in environment. Obtain from the similar building record set A the safety inspection records of various marked historical buildings whose safety hazards are similar to those of a certain historical building. Combine the marked historical building safety inspection records with the safety inspection record of a certain historical building to obtain the similar historical set B. The types of building safety hazards in the safety inspection records of various historical buildings in the similar historical set B are the same.

8. The building safety assessment and management system based on multimodal data according to claim 1, characterized in that, The building safety assessment module includes a building safety assessment unit; The building safety assessment unit is used to monitor the building during the current period, obtain multimodal data of the building during the current period, acquire target hazard data, assess the safety hazard risk of the building during the current period, and obtain safety hazard data.

9. The building safety assessment and management system based on multimodal data according to claim 8, characterized in that: Through the building safety assessment unit, target hazard data and preset detection data of various building safety hazard types of characteristic buildings with similar architectural designs to the building are obtained; Data on various environmental parameters and detection parameters of the building in the current period are obtained from multimodal data. Preset ranges of various detection parameters are obtained from the preset detection data. When the maximum and minimum values ​​of the γth detection parameter are not within the preset range, the building is determined to have safety hazards in the current period. The building safety hazard type corresponding to the γth detection parameter is obtained from the platform and recorded as the target building safety hazard type in the current period. If the maximum and minimum values ​​of all detection parameters of the building are within the preset range in the detection preset data during the current period, then the target hazard data of the p-th building safety hazard type is obtained, and the target range of each changing environmental parameter, the characteristic value range of each associated detection parameter and the target time scale of each building safety hazard type in the p-th building safety hazard type are obtained from the target hazard data. Obtain the target hazard data for the p-th type of building safety hazard, and obtain several changing environmental parameters for the p-th type of building safety hazard. If the values ​​of several changing environmental parameters are within the target range in the target hazard data and the duration is greater than the target time scale, then obtain the data of several associated detection parameters for the p-th type of building safety hazard. Otherwise, it is determined that the building does not have the risk of the p-th type of building safety hazard occurring in the current period. If the values ​​of the aforementioned associated detection parameters are within the characteristic value range and the duration is greater than the target time scale, then it is determined that the building has the risk of exhibiting the p-th type of building safety hazard in the current period, and the p-th type of building safety hazard is recorded as the target type of building safety hazard in the current period; otherwise, it is determined that the building does not have the risk of exhibiting the p-th type of building safety hazard in the current period. The target building safety hazard types within the current period are obtained and aggregated to obtain the building safety hazard data within the current period.

10. The building safety assessment and management system based on multimodal data according to claim 1, characterized in that, The building safety management module includes a building safety management unit; The building safety management unit is used to manage the building safety within the current period. The specific management process is as follows: when the building has a target building safety hazard type that is at risk within the current period in the safety hazard data, a building safety risk alarm is sent through the platform, and the target building safety hazard type is sent to the building's safety management personnel through the platform, notifying the safety management personnel to dispatch personnel to carry out safety maintenance on the building.

Images