A three-dimensional fusion visualization method, system, device and medium for historical buildings
Through the three-dimensional fusion visualization method, combined with GIS, BIM and Webgl technology, historical building models are generated and real-time monitoring videos are added, which solves the problems of historical building protection and management, realizes digital processing and real-time monitoring of historical buildings, and improves protection and management. efficiency.
Patent Information
- Application Number
- CN202111440679.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-30
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-11-30
AI Technical Summary
The existing technology is difficult to effectively protect and manage historical buildings, especially in the face of natural disasters and man-made destruction, and lacks digital processing and real-time monitoring methods.
Using three-dimensional fusion visualization method, a historical building model is generated by obtaining architectural data, combined with GIS, BIM and Webgl technologies, the model is visualized and displayed, and real-time monitoring video images are added to create body heat maps and scene simulations, supporting interactive experience and monitoring functions .
It realizes digital processing and real-time monitoring of historical buildings, meets the interactive needs of visitors, improves the protection and management efficiency of historical buildings, and provides better protection and monitoring methods.
Smart Images

Figure CN114491727B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of three-dimensional model data processing, and in particular to a three-dimensional fusion visualization method, system, equipment and storage medium for historical buildings. Background Art
[0002] Historical buildings are precious cultural treasures left to us by our ancestors. They have historical, cultural, scientific, artistic and other values. The protection of historical buildings is to protect the carrier of historical culture, is a physical example of historical research, is an important material basis for the development of tourism, and is an important reference for new architectural design and new artistic creation. As ancient cultural relics, historical buildings are subjected to the ruthless attacks of natural disasters such as wind, frost, rain, dew, water, fire, thunder and lightning day after day and year after year, which inevitably cause damage, destruction and collapse to historical buildings. In addition, the situation of human destruction is becoming more and more serious. The protection of historical buildings is imperative, and the digital processing of historical buildings has also become one of the important means of protecting historical buildings. Summary of the invention
[0003] In order to overcome the deficiencies of the prior art, one of the purposes of the present invention is to provide a three-dimensional fusion visualization method for historical buildings, which performs three-dimensional processing on historical buildings to achieve digital interaction purposes.
[0004] A second object of the present invention is to provide a three-dimensional fusion visualization system for historical buildings.
[0005] A third object of the present invention is to provide an electronic device.
[0006] A fourth object of the present invention is to provide a storage medium.
[0007] One of the purposes of the present invention is achieved by the following technical solution:
[0008] A three-dimensional fusion visualization method for historical buildings, comprising:
[0009] Step S1: Acquire building data, generate a historical building model according to the building data and create vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server;
[0010] Step S2: obtaining a monitoring video stream uploaded by a camera device used to photograph historical buildings and storing it in the data server;
[0011] Step S3: Loading the historical building model data, vector data and video stream data stored in the data server for visual display.
[0012] Furthermore, the method for generating the historical building model is:
[0013] Obtain the building data of the historical building area, construct the oblique camera model of the historical building and its corresponding BIM model; the building data includes aerial photo data, control point information and the data of the accessories corresponding to the historical building;
[0014] Create a boundary vector file of the historical building, flatten the oblique camera model using the boundary vector file of the historical building, and superimpose the BIM model corresponding to the historical building onto the flattened oblique camera model. Adjust the superimposed position between the BIM model and the oblique camera model so that the BIM model and the oblique photography model are integrated to obtain a complete historical building model.
[0015] Furthermore, when storing the vector data in the data server, it also includes:
[0016] Each vector data is matched with its corresponding attribute information, and the vector data and its attribute information are converted into data formats and stored in the data server together for visualization processing.
[0017] Furthermore, it also includes:
[0018] The number of visitors connected to each wireless access point in the historical building area is obtained, and a three-dimensional heat map of the distribution of people in the historical building is formed according to the number of visitors and the location information corresponding to the wireless access points, in which different colors are used to represent different ranges of the number of people; and the three-dimensional heat map of the distribution of people is superimposed on the oblique camera model for visual display.
[0019] Furthermore, it also includes:
[0020] Real-time weather information is obtained, and scene simulation is performed on the visualized historical building model according to the real-time weather information; the real-time weather information includes real-time solar activity data, real-time rainfall data, real-time wind speed data, and current environmental season data.
[0021] Furthermore, the scenario simulation includes:
[0022] Control the historical building model to adjust lighting and shadows according to real-time solar activity data;
[0023] Control the historical building model to adjust the rainfall effect according to real-time rainfall data;
[0024] Control some of the appendages of the historical building model to adjust the swing effect according to the real-time wind speed data;
[0025] Control the historical building model to switch to the corresponding season effect according to the current environmental season data.
[0026] Furthermore, it also includes:
[0027] According to the interactive experience requirements, video data shot by an external camera device with a portrait image is obtained, and background removal processing is performed on the video data to extract a pure portrait image;
[0028] Draw a mesh object, and adjust the position of the mesh object in the historical building model and the size of the mesh object according to the interactive experience requirements, and use the extracted pure portrait image as the texture map of the mesh object to integrate the portrait in the video data into the historical building model;
[0029] A screenshot instruction is received to take a screenshot of the characters integrated into the historical building model to output a group photo.
[0030] The second object of the present invention is achieved by adopting the following technical solution:
[0031] A three-dimensional fusion visualization system for historical buildings, which executes the three-dimensional fusion visualization method for historical buildings as described above, comprises:
[0032] A model display module is used to obtain building data, generate a historical building model according to the building data and produce vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server;
[0033] A video stream acquisition module, used to acquire the surveillance video stream uploaded by the camera device and store it in the data server;
[0034] The visualization display module is used to load the historical building model data, vector data and video stream data stored in the data server for visualization display.
[0035] The third object of the present invention is achieved by adopting the following technical solution:
[0036] An electronic device comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned three-dimensional fusion visualization method of historical buildings when executing the computer program.
[0037] The fourth object of the present invention is achieved by adopting the following technical solution:
[0038] A computer-readable storage medium stores a computer program, which, when executed, implements the above-mentioned three-dimensional fusion visualization method of historical buildings.
[0039] Compared with the prior art, the present invention has the following beneficial effects:
[0040] The present invention integrates GIS, BIM, and Webgl technologies to form a three-dimensional fusion visualization engine. The historical building model generated by the engine can meet the various interactive needs of visitors and further understand the internal and external structures of the historical building model. At the same time, real-time monitoring video images are added to the historical building model, and the managers of the historical buildings can also monitor the status of the historical buildings through the visualization engine, so as to better protect the historical buildings. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 It is a schematic diagram of the process of the three-dimensional fusion visualization method of historical buildings of the present invention;
[0042] Figure 2 It is a flow chart of fire monitoring using a visualization engine according to the present invention;
[0043] Figure 3 It is a schematic diagram of the process of using a visualization engine to perform transformation detection in the present invention;
[0044] Figure 4 It is a module schematic diagram of the visualization engine of the present invention;
[0045] Figure 5 This is a system architecture diagram of the visualization engine of the present invention. DETAILED DESCRIPTION
[0046] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.
[0047] Embodiment 1
[0048] This embodiment provides a three-dimensional fusion visualization method for historical buildings. Through this method, historical buildings can be digitized to form a three-dimensional fusion visualization engine, thereby revitalizing historical buildings. At the same time, through visualization, managers can perform daily management of historical buildings more conveniently and intuitively. At the same time, for the public, they can also experience the style of visiting historical buildings online without leaving home, thereby protecting the historical buildings themselves to the greatest extent.
[0049] like Figure 1 As shown, the three-dimensional fusion visualization method of this embodiment specifically includes the following steps:
[0050] Step S1: Acquire building data, generate a historical building model according to the building data and create vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server;
[0051] Step S2: obtaining a monitoring video stream uploaded by a camera device used to photograph historical buildings and storing it in the data server;
[0052] Step S3: Loading the historical building model data, vector data and video stream data stored in the data server for visual display.
[0053] The production of system model data mainly includes oblique photography model production, BIM model production, vector data production, video data, etc. In this embodiment, the building data of the historical building area obtained includes aerial photograph data, control point information, aerial photograph image puncture points, etc., wherein the aerial photograph data refers to the aerial photograph of the historical building area obtained by drone aerial photography; and the control points are points obtained by surveying and mapping, which are used to provide control points when constructing the oblique model to improve the modeling accuracy.
[0054] This embodiment obtains aerial photograph data, control point information and other data of the historical building area for making an oblique photography model, imports the aerial photograph data, control point information and architectural data such as aerial photograph image puncture points into Smart3D modeling software to construct an oblique photography model of the historical building, and converts it into 3dtiles data format, and stores the converted data in the data server for easy visualization of the model. The oblique photography model of the historical building is mainly used to represent the overall situation of the historical building and its surroundings within a certain range, but it is not conducive to operations such as attribute query and material replacement. Therefore, after creating the oblique photography model, it is also necessary to create a building information model of the historical building (hereinafter referred to as BIM model). The BIM model is a structured model. Manual fine modeling is performed for the historical building and its accessories, which can facilitate operations such as attribute query and texture replacement. Therefore, when acquiring architectural data, this embodiment also needs to acquire architectural data related to historical buildings and their accessories, and produce BIM models of historical buildings through modeling software such as 3Dmax, SketchUp, Maya, etc. At the same time, the accessories in the historical buildings, such as lamp poles, trash cans, cameras, etc., are modeled separately, and all BIM models are converted into OBJ, FBX, or other general formats, and finally all are compressed into GLTF, GLB and other formats and stored in the data server.
[0055] After creating the oblique photography model and BIM model, this embodiment uses ArcGIS technology to produce vector data of natural resources, POIs, buildings, roads, etc. near the historical buildings, and enters the corresponding attribute information. At the same time, it is converted into Geojson data format and stored in the data server for visualization on the web page.
[0056] At the same time, in order to achieve the purpose of monitoring historical buildings, this embodiment also stores the monitoring video stream data shot by the camera equipment used to shoot the interior or exterior of the historical building in the data server to facilitate the visual display of the monitoring video.
[0057] After obtaining relevant data of the two models from the data server, this embodiment visualizes the models. The specific method is as follows:
[0058] Based on Webgl technology, the capabilities provided by the three-dimensional fusion visualization engine are utilized. For example, the oblique photography model of the historical building is loaded through the Cesium.Cesium3DTileset interface provided by Cesium.js, and the BIM model of the historical building is loaded through the Three.GLTFLoader interface provided by Three.js. At the same time, in the process of model data visualization, a boundary vector file of the historical building is produced, and the oblique photography model is pre-loaded and then flattened through the boundary vector file of the historical building. At the same time, the BIM model of the historical building and its accessories is superimposed on the flattened oblique photography model, and the superimposed position between the BIM model and the oblique photography model is adjusted so that the BIM model and the oblique photography model are integrated to present a complete historical building model.
[0059] While visualizing the complete historical building model, it is also necessary to obtain vector data from the data server and visualize the vector data. Specifically, based on Webgl technology, the capabilities provided by the 3D fusion visualization engine are utilized, such as loading vector data for visualization through the Cesium.GeoJsonDataSource.load interface provided by Cesium.js, so that managers or visitors can obtain various vector data related to historical buildings from the historical building model, and gain a further understanding of the internal and external structures of the historical buildings.
[0060] In addition, the monitoring video stream data of historical buildings is obtained from the data server, and the video stream is accessed on the web page for visual display based on Webgl technology, so as to achieve the purpose of real-time monitoring of historical buildings.
[0061] This embodiment integrates the existing GIS, BIM, and Webgl technologies to form a 3D fusion visualization engine (Cesium.js+Three.js). Figure 4 As shown, historical buildings can be protected and monitored based on this engine.
[0062] The visualization engine of this embodiment integrates basic measurement tools such as spatial distance, ground distance, horizontal area, ground area, triangulation, and azimuth, so that managers can perform the required measurement functions on the historical building model. At the same time, the visualization engine of historical buildings can also realize various spatial analysis functions, including personnel distribution analysis, fire simulation, and roaming analysis.
[0063] The specific method of personnel distribution analysis in this embodiment is:
[0064] Obtaining the number of visitors connected to each wireless access point in the historical building area is equivalent to using the WIFI probes in the historical building to search for the number of visitors near each probe to learn about the distribution of people in the historical building area. This embodiment forms a three-dimensional heat map of the distribution of people in the historical building based on the number of visitors and the location information corresponding to their wireless access points. Different colors are used in the three-dimensional heat map to represent different ranges of the number of people; at the same time, the three-dimensional heat map of the distribution of people is superimposed on the oblique camera model, so that the results can be more intuitively and three-dimensionally displayed in front of the manager, which is convenient for assisting decision-making. For example, when monitoring a fire in a historical building, the three-dimensional heat map of the distribution of people can be used to assist in rescue and evacuation.
[0065] The visualization engine of this embodiment can also connect to the Internet to obtain real-time weather information of the area where the historical building is located, and the real-time weather information includes real-time solar activity data, real-time rainfall data, real-time wind speed data, current environmental season data, etc.; the visualization engine can perform scene simulation on the visualized historical building model according to the real-time weather information. For example, the real-time solar activity data of the geographical location of the historical building is obtained, including the sun position and solar light intensity at different time periods of the day, etc., and the corresponding lighting and shadow effects are added to the historical building model according to the sun position at different time periods and the solar light intensity at different time periods of the day, so that the lighting and shadow effects presented by the historical building model can be adjusted with the real-time sun position and solar light intensity, so that the management personnel can understand the lighting conditions corresponding to the historical building area from the visualized historical building model, which is convenient for the management personnel to control the lights of the historical building for remote control.
[0066] The real-time rainfall data of the geographical location of the historical building is obtained to simulate the rain effect of the historical building model, and the rainfall effect of the historical building model can be adjusted according to the real-time rainfall data. In addition, the rainfall can be monitored. If the duration of the rainfall effect displayed by the historical building exceeds the preset time, an alarm can be generated; or if it is known from the real-time rainfall data that the rainfall exceeds the preset range, an alarm can also be generated. At the same time, the historical building model area can be divided into several grid units in advance, and the degree of depression of each grid unit is determined according to the geographical elements of each grid unit (such as land type, elevation), and each grid unit is adjusted according to the degree of depression of each grid unit. The low-lying risk factor coefficient of each grid cell is calibrated. The low-lying risk factor coefficient of the grid cell corresponding to a relatively flat area is 0, and the low-lying risk factor coefficient of the grid cell corresponding to the area with a greater degree of depression is higher. When simulating the rainfall effect of the historical building model, the current rainfall is determined, and the threshold value is determined according to the current rainfall. The low-lying risk factor value of each grid cell is calculated and a judgment is made as to whether it exceeds the threshold value. If it exceeds, the corresponding water accumulation effect is added to the grid cell in the historical building model that exceeds the threshold value, so that the management personnel can timely understand the water accumulation inside and outside the historical building, so as to facilitate the timely arrangement of cleaning personnel to clean up the accumulated water to prevent flooding.
[0067] Similarly, real-time wind speed data is obtained to simulate the swing effect of some of the appendages in the historical building model. Some of the appendages can be objects such as trees, flowers and plants, and their swing amplitude can change with the wind speed. The current environmental season data of the geographical location of the historical building is obtained, and the seasonal effect of the historical building model is adjusted according to the current environmental season data; for example, if the current season of the historical building is winter, and the weather condition of the historical building on that day is snowing, the snowing effect can be simulated in the historical building model, and even the corresponding snow can be added to each grid unit of the historical building model according to the amount of snow, so that the historical building model can present an effect consistent with the actual situation, and provide intuitive feedback to managers to facilitate decision-making.
[0068] The visualization engine of this embodiment can also realize interactive experience, such as providing customized roaming paths and perspectives (first-person perspective, God's perspective, follow-up perspective, etc.), so that visitors can visit historical buildings online independently; in addition, video data shot by external camera equipment with portraits can be obtained, and the background of the video can be removed through AI algorithm to extract pure portrait images. Based on Webgl technology, a mesh object (hereinafter referred to as mesh object) is drawn using Three.js, and the position and size of the mesh object in the historical building model are adjusted. The processed video frame is used as the texture map of the mesh to realize the integration of the characters in the video into the historical building BIM scene; in addition, the lighting of the Three.js scene can be adjusted to make the character effect in the video more consistent with the model display effect and better integrated into the BIM model. At the same time, after receiving the screenshot command, the characters integrated into the historical building model are screenshoted to output group photos, and the function of screenshot saving scene is provided to realize the function of taking photos with historical buildings of interest.
[0069] After the visualization engine is made in this embodiment, the fire simulation and detection of historical buildings can be carried out through the visualization engine. Specifically, a fire point location is added to the historical building model, flame particles are used to simulate the flames in the fire based on Webgl technology, and the simulated flames are added to the fire point location; the query and analysis function of the visualization engine is used to query the distribution of resources within a certain range of the fire point, such as firefighting facilities, medical facilities, transportation facilities, building information, etc., and the weather conditions (wind direction, wind speed, temperature), surrounding terrain features and other factors are combined to simulate the spread of the fire and form an impact analysis report.
[0070] At the same time, the firefighting and rescue process is simulated in the system, that is, the best route for fire trucks is planned in the historical building model area, and the on-site fire extinguishing process of firefighters after the fire truck arrives at the fire scene is simulated. Water droplets are used to simulate water to extinguish the burning flames, and the flame extinguishing is controlled by a timer. For example, when a fire occurs, firefighters arrive at the fire scene and begin to extinguish the flames. If it takes 60 seconds to extinguish the flames, then during these 60 seconds, the size of the flame simulated in the historical building model gradually decreases within 60 seconds. When the flame is extinguished, that is, after 60 seconds, the water column gradually becomes smaller and disappears, achieving the dynamic process of simulating the extinguishing of the flame and the disappearance of the water column. Several rescue resettlement points can also be pre-set in the historical building area, and the rescue resettlement point closest to the fire point can be determined according to the location of the fire point, and the best evacuation path for personnel from the fire point to the rescue resettlement point can be simulated, thereby simulating the complete fire rescue process.
[0071] In addition to manual or system determination, the selection of the fire point can also be carried out through automatic detection of the actual fire point location in the actual scene, and impact analysis and fire rescue planning can be carried out on the actual fire point to facilitate the rapid development of fire rescue work and reduce the losses caused by the fire.
[0072] like Figure 2 As shown, the method for using the visualization engine to detect fire in historical buildings in this embodiment is:
[0073] Step S4: Create a historical building model and visualize the historical building model; this step is the same as the aforementioned historical building model creation and display method and will not be described in detail here.
[0074] Step S5: receiving real-time video data obtained by monitoring the historical building to perform fire identification on the real-time video data, and visualizing the fire point information obtained by the fire identification and then displaying it in the historical building model through simulation.
[0075] Surveillance cameras can be installed both inside and outside the historical building. The surveillance cameras can be the same as the aforementioned camera equipment, or cameras with infrared detection can be used to monitor fire conditions inside and outside the historical building.
[0076] After acquiring real-time video data captured by surveillance cameras, AI technology is used to identify real-time video data, and the images obtained by comparing and analyzing the previous frame of the real-time video data with the images obtained by identifying the next frame are used to extract suspicious areas that have changed in the video. The extracted suspicious areas that have changed are compared and analyzed with a pre-established fire sample set. When the comparison result is greater than a preset recognition threshold, it is marked as a suspected fire area. The fire sample set contains smoke video data and flame video data when a fire occurs, which are used for video fire recognition.
[0077] In order to avoid the smoke in the video being identified as coming from other places, which would affect the accurate judgment of the fire point, the present embodiment, in addition to performing video recognition, also receives smoke data collected by various smoke sensors installed in the historical building, determines whether there is a set of smoke data that reaches the preset alarm range, obtains the sensor position corresponding to the smoke data that reaches the alarm range, and compares its sensor position with the position of the area marked as suspected fire. If the two are the same, the suspicious area is determined as the fire area. If the two are different, the fire area is determined based on the data detected by the sensor.
[0078] After the fire area is determined, the fire area is visualized as the fire point and displayed in the historical building model. The visualization method is as follows:
[0079] Determine the geographical location of the fire in the historic building;
[0080] Calling flame particles in the model database, and mapping the flame particles according to the location of the ignition point to display them in the historical building model;
[0081] Collect thermal imaging data, use the acquired thermal imaging data as texture maps, superimpose them on the corresponding positions of the historical building model, and update them in real time, so that decision makers can intuitively understand the latest fire situation through the three-dimensional model. Among them, thermal imaging data can be obtained through infrared thermal imager detection, or through camera with infrared detection; analyze the latest fire situation of the ignition point based on thermal imaging data, and dynamically demonstrate and adjust the flame particles displayed in the historical building model based on the latest fire situation.
[0082] Step S6: Perform an impact analysis on the fire situation simulated in the historical building model to obtain the fire impact range, determine the best firefighting route according to the fire impact range, and push the fire message to the corresponding rescue resettlement point.
[0083] In this embodiment, the preset area containing historical buildings can be divided into a number of grid units in advance by the aforementioned method, and the weight coefficients of the fire factors of all grid units can be assigned according to the geographical elements (land type, elevation) of each grid unit. For example, if there is easily ignited dry grass on the surface corresponding to a certain grid unit, then the weight coefficient of the fire factor of the grid unit is relatively high, which also means that the area corresponding to the grid unit is easily ignited.
[0084] Since different weather conditions also have a certain degree of impact on the spread speed of the fire, this embodiment obtains the real-time wind speed, real-time wind direction and real-time temperature information of the current fire point through the Internet or local sensors, and then determines the current fire factor of each grid unit in combination with the weight coefficient; and the fire factor of each grid unit will be adjusted at any time according to the real-time weather information to improve the calculation accuracy of the fire spread range.
[0085] After determining the fire factor of each grid unit, the location of the ignition point is determined in real time according to the thermal imaging data, and the fire factor of the grid unit corresponding to the ignition point is assigned a value of 1. A fire factor of 1 represents that the location is in a fire state, and the fire factors of the 8 grid units around the ignition point are traversed outward, and it is determined whether the fire factors of the 8 grid units around the ignition point are greater than the preset threshold. The fire factors of the grid units greater than the preset threshold are also assigned a value of 1; at every preset time interval, the grid unit with a fire factor value of 1 is taken as the center, and the fire factors of the 8 grid units around it are traversed to see whether they are greater than the preset threshold. The fire factors of the grid units greater than the preset threshold are assigned a value of 1. The above operation is repeated within the simulation time period. All grid units with a fire factor of 1 are traversed and selected within the simulation time period, and fire spread simulation can be performed. The area surrounded by the geographical locations corresponding to all grid units with a fire factor of 1 is the fire impact range.
[0086] After determining the fire impact range, this embodiment extends a preset distance outward from the fire impact range to determine a buffer zone that includes the fire impact range; obtains the corresponding POI information in the buffer zone, and generates a corresponding fire impact analysis report based on the POI information in the buffer zone, so that decision makers can understand what material damage will be caused by the fire in order to perform post-disaster loss accounting.
[0087] After determining the fire impact range, the fire impact range will be visualized in the historical building model. When the fire impact range increases, the simulated flame displayed in the historical building model will become larger and more fierce. If the fire impact range decreases, the simulated flame displayed in the historical building model will become smaller. The flame simulation will not be extinguished until the fire impact range disappears.
[0088] In this embodiment, several rescue and resettlement points are pre-marked in the historical building model, and the rescue and resettlement points can be equipped with certain rescue materials and firefighters; after determining the fire impact range, the distance between the fire impact range and each pre-marked rescue and resettlement point is calculated, and the nearest rescue and resettlement point is marked as the target rescue point. The best route for the fire truck is planned according to the distance between the target rescue point and the fire impact range, and the time for the firefighters to arrive at the fire scene is calculated; the escape route for visitors is planned according to the fire impact range, and the time required for fire extinguishing and the amount of fire-fighting materials required for fire extinguishing are calculated, and the calculated results together with various fire information such as the fire location and fire impact range are pushed to different terminals for display, so as to prompt relevant personnel to arrive at the scene as soon as possible to deal with it.
[0089] like Figure 3 As shown, this embodiment can also detect the appearance changes of historical buildings through a visualization engine, and the specific method includes the following steps:
[0090] Step S7: receiving building data to create a historical building model, and visually displaying the historical building model; this step is the same as the aforementioned historical building model creation and display method, and will not be described in detail here.
[0091] Step S8: Acquire the surveillance video stream of the historical building, perform change detection on the surveillance video stream data, and use the target area that has changed during the change detection as a texture object and perform texture mapping on the corresponding position of the historical building model to visualize the target area in the historical building model.
[0092] The camera used to photograph the surface of the historical building may be the same as the aforementioned camera device, or a camera with better photographing clarity may be used to detect minor changes in the appearance of the historical building.
[0093] The method for detecting changes in surveillance video stream data in this embodiment includes:
[0094] Determine the local area of the building corresponding to the captured image according to the captured image of the monitoring video stream data;
[0095] The local area of the building is compared with the same area in the historical building model. If the comparison finds that the two have changed, the changed area will be marked as the target area.
[0096] In order to further determine the location of the local area of the building, the camera position and shooting angle corresponding to the camera reporting the surveillance video stream can also be obtained. The local area of the building can be verified according to the camera position and shooting angle to re-determine the local area of the building corresponding to the captured image, so as to ensure the recognition accuracy of the local area of the building.
[0097] In this embodiment, the method for comparing a local area of a building with the same area in a historical building model may be to perform feature recognition on the captured image of the surveillance video stream data, and compare the feature information obtained by the recognition with the feature information corresponding to the local area of the building in the historical building model. If the similarity between the two exceeds a first threshold, it can be considered that the two have not changed in appearance; if the similarity between the two is lower than the first threshold, it can be considered that the two have changed in appearance.
[0098] Step S9: Compare and analyze the target area with the preset change detection sample, generate a corresponding repair plan according to the comparison and analysis result, and send a repair message to the designated terminal.
[0099] The change detection samples are pre-stored in a sample library, and the change detection samples include but are not limited to crack samples, collapse samples and attachment samples of different degrees. At the same time, the sample library also stores the repair solutions corresponding to the crack samples, collapse samples and attachment samples of different degrees. The sample library refers to a defined change type library (image library) and a corresponding repair solution library. For example, "cracks" defines samples according to different crack width, length and other judgment criteria, and formulates corresponding repair solutions for different samples, thereby forming a sample library.
[0100] After determining the target area that has changed, this embodiment performs designated feature recognition on the target area to determine whether there are cracks, collapses and / or attachments on the building surface corresponding to the target area, and the attachments may be vegetation, algae, fungi, bird droppings, etc.; the cracks, collapses and / or attachments on the building surface corresponding to the target area are compared with each change detection sample in the sample library. If the cracks, collapses and / or attachments in the target area match any change detection sample, the crack degree, collapse and attachment area of the target area are determined according to the matching change detection sample. This embodiment highlights the changed part and uses the change analysis result as a texture object to perform texture mapping with the corresponding part of the historical building BIM model, so that the changed part of the historical building model can be more intuitively displayed in three dimensions.
[0101] At the same time, the repair plan corresponding to the sample library is retrieved according to the degree of cracks, collapse and attachment area of the target area, and the repair plan together with the degree of cracks, collapse and attachment area corresponding to the target area is pushed to the designated terminal for display, so as to notify relevant personnel to deal with it in time and discover the phenomenon that may cause damage to the historical building in time.
[0102] In this embodiment, the timing of change detection can be to perform change detection once at a preset time interval, that is, automatically obtain the surveillance video stream of the historical building for change detection at the preset time interval; or actively obtain the current surveillance video stream for change detection after triggering a specified event. For example, after a fire event occurs, change detection can be used to determine the post-fire situation, understand the changes in the surface of the historical building after the fire, and actively generate a corresponding repair plan.
[0103] Embodiment 2
[0104] This embodiment provides a three-dimensional fusion visualization system for historical buildings. Figure 5 As shown, the method for three-dimensional fusion visualization of historical buildings as described in the first embodiment includes:
[0105] A model display module is used to obtain building data, generate a historical building model according to the building data and produce vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server;
[0106] A video stream acquisition module, used to acquire the surveillance video stream uploaded by the camera device and store it in the data server;
[0107] The visualization display module is used to load the historical building model data, vector data and video stream data stored in the data server for visualization display.
[0108] In addition, the three-dimensional fusion visualization system may also include a fire identification module and a fire impact analysis module for detecting fire conditions, and a change detection module and a repair analysis module for detecting building changes.
[0109] Among them, the fire identification module is used to receive real-time video data obtained by monitoring the historical building to identify the fire in the real-time video data, and visualize the fire point information obtained by the fire identification and simulate it in the historical building model; the fire impact analysis module is used to perform impact analysis on the fire situation simulated in the historical building model to obtain the fire impact range, determine the best fire-fighting route according to the fire impact range, and push fire messages to the corresponding rescue resettlement points.
[0110] The change detection module is used to obtain the monitoring video stream of the historical building, perform change detection on the monitoring video stream data, and use the target area that has changed in the change detection as a texture object and perform texture mapping on the corresponding position of the historical building model to visualize the target area in the historical building model; the repair analysis module compares and analyzes the target area with the preset change detection sample, generates a corresponding repair plan based on the comparison and analysis results, and sends a repair message to the designated terminal.
[0111] This embodiment integrates and forms a three-dimensional fusion visualization engine. The historical building model generated by the engine can meet the various interactive needs of visitors and further understand the internal and external structures of the historical building model. At the same time, real-time monitoring video images are added to the historical building model, and the managers of the historical buildings can also monitor the status of the historical buildings through the visualization engine, so as to better protect the historical buildings.
[0112] Embodiment 3
[0113] This embodiment provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the three-dimensional fusion visualization method of the historical building in the first embodiment when executing the computer program; in addition, this embodiment also provides a storage medium on which the computer program is stored, wherein the computer program implements the above-mentioned three-dimensional fusion visualization method of the historical building when executed.
[0114] The device and storage medium in this embodiment and the method in the aforementioned embodiment are two aspects based on the same inventive concept. The method implementation process has been described in detail above, so those skilled in the art can clearly understand the structure and implementation process of the device and storage medium in this embodiment based on the aforementioned description. For the sake of brevity of the specification, they will not be repeated here.
[0115] The above-mentioned embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and substitutions made by technicians in this field on the basis of the present invention shall fall within the scope of protection required by the present invention.
Claims
1. A three-dimensional fusion visualization method for historical buildings, characterized in that: include: Acquire building data, generate a historical building model according to the building data and create vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server; Acquire the surveillance video stream uploaded by the camera equipment used to shoot the historical building and store it in the data server; Loading the historical building model data, vector data and video stream data stored in the data server for visual display; Acquire real-time weather information, and perform scene simulation on the visually displayed historical building model according to the real-time weather information; the real-time weather information includes real-time solar activity data, real-time rainfall data, real-time wind speed data, and current environmental season data; According to the interactive experience requirements, video data shot by an external camera with a portrait image is obtained, and the background of the video frames in the video data is removed through an AI algorithm to extract a pure portrait image; Draw a mesh object according to the interactive experience requirements, and adjust the position of the mesh object in the historical building model and the size of the mesh object according to the interactive experience requirements, and use the pure portrait image extracted from the video frame as the texture map of the mesh object to integrate the portrait in the video data into the historical building model; Adjust the scene lighting so that the characters in the video match the display effects of the historical building models; A screenshot instruction is received to take a screenshot of the characters integrated into the historical building model to output a group photo.
2. The three-dimensional fusion visualization method of historical buildings according to claim 1 is characterized in that: The method for generating the historical building model is: Obtain the building data of the historical building area, construct the oblique camera model of the historical building and its corresponding BIM model; the building data includes aerial photo data, control point information and the data of the accessories corresponding to the historical building; Create a boundary vector file of the historical building, flatten the oblique camera model using the boundary vector file of the historical building, and superimpose the BIM model corresponding to the historical building onto the flattened oblique camera model. Adjust the superimposed position between the BIM model and the oblique camera model so that the BIM model and the oblique photography model are integrated to obtain a complete historical building model.
3. The three-dimensional fusion visualization method of historical buildings according to claim 1 is characterized in that: When storing the vector data in the data server, the method further includes: Each vector data is matched with its corresponding attribute information, and the vector data and its attribute information are converted into data formats and stored in the data server together for visualization processing.
4. The three-dimensional fusion visualization method of historical buildings according to claim 2 is characterized in that: Also includes: The number of visitors connected to each wireless access point in the historical building area is obtained, and a three-dimensional heat map of the distribution of people in the historical building is formed according to the number of visitors and the location information corresponding to the wireless access points, in which different colors are used to represent different ranges of the number of people; and the three-dimensional heat map of the distribution of people is superimposed on the oblique camera model for visual display.
5. The three-dimensional fusion visualization method of historical buildings according to any one of claims 1 to 4, characterized in that: The scenario simulation includes: Control the historical building model to adjust lighting and shadows according to real-time solar activity data; Control the historical building model to adjust the rainfall effect according to real-time rainfall data; Control some of the appendages of the historical building model to adjust the swing effect according to the real-time wind speed data; Control the historical building model to switch to the corresponding season effect according to the current environmental season data.
6. A three-dimensional fusion visualization system of historical buildings, characterized in that: The method for three-dimensional fusion visualization of a historical building as claimed in any one of claims 1 to 5 comprises: A model display module is used to obtain building data, generate a historical building model according to the building data and produce vector data corresponding to the historical building model, and store the historical building model and its vector data in a data server; A video stream acquisition module, used to acquire the surveillance video stream uploaded by the camera device and store it in the data server; The visualization display module is used to load the historical building model data, vector data and video stream data stored in the data server for visualization display.
7. An electronic device, characterized in that: It includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the three-dimensional fusion visualization method of the historical building described in any one of claims 1 to 5 is implemented.
8. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed, the three-dimensional fusion visualization method of the historical building described in any one of claims 1 to 5 is implemented.
