Geographic area visualization method and device, electronic equipment and storage medium

Abstract

The invention provides a geographic area visualization method and device, electronic equipment and a storage medium, and the method comprises the steps: constructing a three-dimensional space model of a geographic area based on GIS data and BIM data of the geographic area, and three-dimensional scanning data of all objects in the geographic area, and carrying out the visual display; determining a fault state of the infrastructure based on the operation data of the infrastructure in the geographic area; and adding the fault state of the infrastructure in the three-dimensional space model. A three-dimensional space model is constructed based on GIS data and BIM data of a geographic area, the geographic topographic features and the surrounding environment of the geographic area are displayed in the macroscopic level, the three-dimensional layout of a building structure and the operation state of basic equipment are reproduced in the microscopic level, and accurate and visual expression of the geographic features and the building features of the geographic area is achieved. And a three-dimensional space model is constructed in combination with the three-dimensional scanning data of each object, so that the digital simulation degree and accuracy of geographic region visualization are improved.

Description

Technical Field

[0001] The present application relates to the field of visualization and digital twin technology, and in particular to a method, device, electronic device and storage medium for visualizing a geographic area. Background Art

[0002] The digital twin corresponds to the physical world. It builds a model consistent with the physical world in a digital form in the virtual space. Through information interaction with the physical world, it can monitor changes in the physical world and reflect the operating status of the physical world.

[0003] In order to adjust the economic and industrial structure and gather industrial advantages, my country has vigorously developed the park economy, forming a growth pole for my country's regional economy. The digital twin model has the advantage of intuitively and clearly displaying the internal equipment and data of the park, and therefore has become one of the important development directions of park visualization.

[0004] Due to the complex environment of the park, it is difficult to accurately and comprehensively collect data on the park, resulting in a low degree of simulation of the park's digital twin model.

[0005] Therefore, there is an urgent need for a visualization method of geographical areas with high simulation and accuracy. Summary of the invention

[0006] The present application aims to solve one of the technical problems in the related art at least to some extent.

[0007] To this end, the first purpose of the present application is to propose a visualization method for a geographical area to improve the digital simulation degree of the visualization of the geographical area.

[0008] A second objective of the present application is to provide a device for visualizing a geographical area.

[0009] The third objective of the present application is to provide an electronic device.

[0010] A fourth objective of the present application is to provide a computer-readable storage medium.

[0011] A fifth object of the present application is to provide a computer program product.

[0012] To achieve the above-mentioned purpose, the first embodiment of the present application proposes a method for visualizing a geographical area, including:

[0013] Based on the GIS data, BIM data and 3D scanning data of objects in the geographical area, a 3D spatial model of the geographical area is constructed and visualized;

[0014] Determining a fault status of the infrastructure equipment based on operating data of the infrastructure equipment in the geographic area;

[0015] Add fault status of basic equipment in the 3D space model.

[0016] To achieve the above-mentioned purpose, the second aspect of the present application provides a device for visualizing a geographical area, including:

[0017] A construction module is used to construct a three-dimensional spatial model of a geographic area and perform visual display based on GIS data, BIM data, and three-dimensional scanning data of objects in the geographic area;

[0018] A determination module for determining a fault status of a basic device based on operation data of the basic device in a geographical area;

[0019] Update module to add fault status of basic equipment in 3D space model.

[0020] To achieve the above-mentioned purpose, the third aspect of the present application provides an electronic device, including:

[0021] at least one processor; and

[0022] a memory communicatively connected to at least one processor; wherein,

[0023] The memory stores instructions that can be executed by at least one processor. The instructions are executed by the at least one processor so that the at least one processor can execute the method of the above embodiment.

[0024] To achieve the above objectives, the fourth aspect of the present application proposes a computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the method according to the above embodiment.

[0025] To achieve the above objectives, the fifth aspect of the present application proposes a computer program product, including a computer program, which implements the method of the above embodiment when executed by a processor.

[0026] The visualization method, device, electronic device and storage medium of the geographical area provided by the present application, in the present application, based on the GIS data, BIM data and three-dimensional scanning data of each object in the geographical area, a three-dimensional space model of the geographical area is constructed and visualized, and then, based on the operation data of the basic equipment in the geographical area, the fault state of the basic equipment is determined, and then the fault state of the basic equipment is added to the three-dimensional space model. Thus, the three-dimensional space model constructed based on the GIS data and BIM data of the geographical area not only shows the geographical terrain characteristics and its surrounding environment of the geographical area at the macro level, but also reproduces the three-dimensional layout of the building structure and the operation status of the basic equipment at the micro level, realizing the accurate and intuitive expression of the geographical characteristics and architectural characteristics of the geographical area. In addition, the three-dimensional scanning data of each object is combined to construct a three-dimensional space model, thereby improving the digital simulation and accuracy of the visualization of the geographical area.

[0027] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0029] Figure 1 A schematic diagram of a flow chart of a method for visualizing a geographical area provided in an embodiment of the present application;

[0030] Figure 2 A schematic diagram of a flow chart of another method for visualizing a geographical area provided in an embodiment of the present application;

[0031] Figure 3 A schematic diagram of a flow chart of another method for visualizing a geographical area provided in an embodiment of the present application;

[0032] Figure 4 A schematic diagram of a flow chart of another method for visualizing a geographical area provided in an embodiment of the present application;

[0033] Figure 5 A schematic diagram of the structure of a device for visualizing a geographical area provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0035] The following describes the method and device for visualizing a geographic area according to an embodiment of the present application with reference to the accompanying drawings.

[0036] The method for visualizing a geographic area in an embodiment of the present application is executed by a device for visualizing a geographic area (hereinafter referred to as a visualization device) provided in an embodiment of the present application. The device can be configured in a computer device or a terminal device to improve the digital simulation degree of the visualization of the geographic area.

[0037] Figure 1 A flowchart of a method for visualizing a geographic area provided in an embodiment of the present application.

[0038] like Figure 1 As shown, the visualization method of the geographic area includes the following steps:

[0039] Step 101, based on the GIS data of the geographical area, the BIM data, and the three-dimensional scanning data of each object in the geographical area, a three-dimensional spatial model of the geographical area is constructed and visualized.

[0040] The geographical area may be a park, a designated area, etc., and this application does not impose any restrictions on this.

[0041] In this application, GIS data, BIM data of a geographic area, and three-dimensional scanning data of each object in the geographic area can be stored in the system in advance. Among them, each object in the geographic area can be a building, basic equipment, etc., and the basic equipment can be a generator, ventilation equipment, etc. The basic equipment can be inside or outside the building, and this application does not limit this.

[0042] In this application, a reference 3D space model can be generated based on GIS data and BIM data, and the 3D scan data can be spliced ​​to generate a scanned 3D space model. After that, multiple pairs of feature points in the reference 3D space model and the scanned 3D space model are determined to determine the transformation matrix of the reference 3D space model based on the feature points, and then, based on the transformation matrix, the reference 3D space model is aligned in perspective to obtain the 3D space model.

[0043] For example, GIS data can be converted to obtain the corresponding geographic 3D model (such as digital elevation model), and the geographic 3D model can be imported into 3D modeling software (such as AutoCAD Civil 3D, SketchUp, 3ds Max, etc.) as the terrain basis, and the BIM model can be imported and placed to its corresponding geographic location to obtain a reference 3D space model. In addition, the 3D scan data can be spliced ​​to generate a scanned 3D space model.

[0044] After that, multiple feature points are extracted from the scanned 3D space model and the reference 3D space model respectively, and feature matching algorithms such as SIFT, SURF or ORB are used to match the multiple feature points in the scanned 3D space model and the reference 3D space model, and the correspondence between the feature points in the reference 3D space model and the scanned 3D space model is determined to obtain multiple pairs of feature points. Based on multiple pairs of feature points (i.e., the correspondence between the feature points in the reference 3D space model and the scanned 3D space model), a method that minimizes the reprojection error (such as the iterative closest point (ICP) algorithm or similarity transformation) is used to obtain the transformation matrix between the reference 3D space model and the scanned 3D space model. Among them, the transformation matrix contains rotation and translation parameters, which can transform the reference 3D space model to the correct position and orientation.

[0045] Then, the reference three-dimensional space model is transformed according to the transformation matrix to achieve perspective alignment of the reference three-dimensional space model, thereby obtaining a three-dimensional space model.

[0046] Finally, we can use 3D GIS platforms (such as CityEngine, Unreal Engine combined with GIS plug-ins) or WebGL technology (such as CesiumJS, Three.js) to create an interactive 3D scene corresponding to the 3D space model, thereby realizing the visualization of the geographic area.

[0047] Step 102 : determining a fault status of the infrastructure equipment based on the operating data of the infrastructure equipment in the geographical area.

[0048] In the present application, each basic device can be monitored, and the operation data of each basic device can be obtained and saved. Afterwards, any fault diagnosis model can be used to process the operation data of each basic device to determine the fault status of each basic device.

[0049] For example, using the BP-CA-Attention-Elman algorithm, a device fault diagnosis model is constructed to determine the fault state of the basic device based on the fault diagnosis model, including the following steps:

[0050] 1. Obtain the data stream of the basic equipment running data in multiple consecutive data collection cycles, and use the BP network to extract the feature vector G of the data stream corresponding to each data collection cycle i .

[0051] 2. Use the CA clustering algorithm to cluster each feature vector G i The process of performing clustering to obtain multiple feature vector groups and determining the feature vector weight matrix of the basic device data flow based on the multiple feature vector groups is as follows:

[0052]

[0053] Among them, W is the feature vector weight matrix; G i is the i-th data stream; w n For G i The set of n data streams that belong to the same feature vector group.

[0054] 3. According to the feature vector weight matrix, set the attention weight of the Multi-Head Attention module, and use the Multi-Head Attention module to i Perform a linear transformation to obtain the eigenvector G after linear transformation i ', the formula is:

[0055] G i '=MultiHeads(Q,K,V)G i =Concat(head i )W i G i

[0056] head i =Attention(W i Q Q,W i K K,W i V V)

[0057] Among them, G i ' is the feature vector after linear transformation; MultiHeads(Q,K,V) is the linear transformation function of the Multi-Head Attention module on the three vectors Q, K, and V; Q is the Query vector; K is the Key vector; V is the Value vector; Concat() is the concatenation function; W i is the feature vector weight matrix of the i-th data stream; head i is the i-th attention channel; Attention() is the attention function; W i Q , W i K , W i V To W i The feature vector weight matrix is ​​split according to the three vectors Q, K, and V.

[0058] 4. Use the pre-trained Elman network to classify the linearly transformed feature vector Gi' to obtain the fault status of the basic equipment, thereby achieving reliable and stable fault diagnosis.

[0059] Optionally, before processing the operating data of each basic device, the operating data of the basic device may be preprocessed, including removal of duplicate data, format conversion, etc., to achieve standardized processing of the operating data.

[0060] Optionally, the operation data can be converted into a data stream according to the timestamp of the operation data of each basic device. After that, the corresponding data stream can be added to the digital twin model corresponding to each basic device in the three-dimensional space model to realize the real-time display of the operation data of the basic device.

[0061] Step 103: Add the fault status of the basic equipment to the three-dimensional space model.

[0062] In the present application, the corresponding fault status of each basic equipment can be added to the digital twin model corresponding to the three-dimensional space model to realize real-time monitoring of the fault status of the basic equipment, thereby improving the degree of intelligence.

[0063] It can be understood that adding the fault status of the basic equipment to the visualized three-dimensional space model realizes the visualization of the fault status of the basic equipment.

[0064] In this application, based on the GIS data, BIM data, and three-dimensional scanning data of each object in the geographical area, a three-dimensional space model of the geographical area is constructed and visualized. After that, based on the operating data of the basic equipment in the geographical area, the fault state of the basic equipment is determined, and then the fault state of the basic equipment is added to the three-dimensional space model. As a result, the three-dimensional space model constructed based on the GIS data and BIM data of the geographical area not only shows the geographical terrain characteristics and its surrounding environment of the geographical area at the macro level, but also reproduces the three-dimensional layout of the building structure and the operating status of the basic equipment at the micro level, realizing the accurate and intuitive expression of the geographical characteristics and architectural characteristics of the geographical area. In addition, the three-dimensional scanning data of each object is combined to construct a three-dimensional space model, thereby improving the digital simulation and accuracy of the visualization of the geographical area.

[0065] Figure 2 A flowchart of a method for visualizing a geographic area provided in an embodiment of the present application.

[0066] like Figure 2 As shown, the visualization method of the geographic area includes the following steps:

[0067] Step 201 , based on the GIS data of the geographical area, the BIM data, and the three-dimensional scanning data of each object in the geographical area, a three-dimensional spatial model of the geographical area is constructed and visualized.

[0068] Step 202: Determine the fault status of the infrastructure equipment based on the operation data of the infrastructure equipment in the geographical area.

[0069] Step 203: Add the fault status of the basic equipment to the three-dimensional space model.

[0070] In the present application, the specific implementation process of steps 201 to 203 can be found in the detailed description of any embodiment of the present application and will not be repeated here.

[0071] Step 204 , based on the pedestrian images collected at each location in the geographic area, determine the pedestrian flow at each location.

[0072] In this application, cameras can be installed at various locations in a geographic area to collect pedestrian images at each location. Afterwards, a preset recognition model (such as the YOLO v5 model) can be used to recognize the continuous frame pedestrian images in the current time period of each location, and the predicted frames of pedestrians in each pedestrian image can be marked. Then, algorithms such as SORT are used to track the same pedestrian in the continuous frame pedestrian images of each location to calculate the pedestrian flow in the current time period of each location.

[0073] Step 205 , gridding the three-dimensional space model to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at the position corresponding to each grid.

[0074] In this application, any grid generation algorithm can be used to process the three-dimensional space model to obtain a three-dimensional grid map corresponding to the three-dimensional space model. And determine the positions in the geographical area contained in each grid, so as to determine the thermal value of the pedestrians in each grid based on the number of pedestrians at each position corresponding to each grid, thereby generating a thermal map of the geographical area at the current moment, so as to intuitively display the distribution of pedestrians at each position in the geographical area in real time.

[0075] The process of determining the thermal value of each grid can be seen in the following formula:

[0076]

[0077] In the formula, q i_new is the thermal value; q i is the sum of the number of pedestrians at each location corresponding to the i-th grid; i is the grid indicator; q max ,q min are the maximum and minimum values ​​of the sum of the number of pedestrians at each location corresponding to each grid.

[0078] The thermal value represents the heat of pedestrians staying at the corresponding position in the geographical area. The closer the thermal value of the grid is to 1, the more pedestrians are distributed at the corresponding position of the grid in the geographical area at the current moment.

[0079] In this application, based on the pedestrian images collected at various locations in the geographic area, the flow of people at each location is determined. The three-dimensional space model is gridded to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at the location corresponding to each grid. This enables an intuitive and real-time display of the distribution of pedestrians at various locations in the geographic area.

[0080] Figure 3 A flowchart of a method for visualizing a geographic area provided in an embodiment of the present application.

[0081] like Figure 3 As shown, the visualization method of the geographic area includes the following steps:

[0082] Step 301 , based on the GIS data of the geographical area, the BIM data, and the three-dimensional scanning data of each object in the geographical area, a three-dimensional spatial model of the geographical area is constructed and visualized.

[0083] Step 302, determining a fault status of the infrastructure equipment based on the operating data of the infrastructure equipment in the geographic area.

[0084] Step 303: Add the fault status of the basic equipment to the three-dimensional space model.

[0085] Step 304 , based on the pedestrian images collected at each location in the geographic area, determine the pedestrian flow at each location.

[0086] Step 305 , gridding the three-dimensional space model to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at the position corresponding to each grid.

[0087] In the present application, the specific implementation process of steps 301 to 305 can be found in the detailed description of any embodiment of the present application and will not be repeated here.

[0088] Step 306 , identifying the walking directions of pedestrians at the entrances and exits of the geographical area, so as to determine the number of people leaving and the number of people entering based on the walking directions.

[0089] The pedestrian direction may include an entry direction and an exit direction. The starting point of the pedestrian walking path corresponding to the entry direction is closer to the entrance of the geographical area, and the end point is farther from the entrance of the geographical area. The end point of the pedestrian walking path corresponding to the exit direction is closer to the entrance of the geographical area, and the starting point is farther from the entrance of the geographical area.

[0090] In this application, any pedestrian tracking algorithm (SORT algorithm) can be used to determine the walking direction of pedestrians at the entrance and exit of a geographical area. Afterwards, when a pedestrian's walking direction is the entry direction and the pedestrian's position is within the geographical area, the number of people entering is added by 1 to determine the number of people entering at the current moment. Similarly, when a pedestrian's walking direction is the departure direction and the pedestrian's position is outside the geographical area, the number of people leaving is added by 1 to determine the number of people leaving at the current moment.

[0091] Step 307: Add a pedestrian mark at a first position corresponding to the entrance and exit in the three-dimensional space model based on the number of people entering.

[0092] In the present application, the first position corresponding to the entrance and exit in the three-dimensional space model is determined, and a pedestrian mark is added at the first position in the three-dimensional space model. The number of pedestrian marks added can be the same as the number of people entering. Alternatively, the number of people entering can be multiplied by a preset ratio to determine the number of pedestrian marks added at the first position in the three-dimensional space model.

[0093] Step 308, determining the second position and the third position based on the thermal value and object distribution at each position in the three-dimensional space model.

[0094] In the present application, the positions corresponding to non-walkable entities such as walls of buildings, obstacles, lakes, etc. in the three-dimensional space model can be eliminated, and among the remaining positions, the position with a thermal value greater than 0 is determined as the second position, and the position with a thermal value of 0 is determined as the third position.

[0095] Step 309 , based on the distribution of thermal values ​​corresponding to the second positions, determine the first target position corresponding to each pedestrian mark from the second positions.

[0096] In the present application, it is assumed that N pedestrian marks are added at the first position, and then the proportion m of the thermal value of each second position to the sum of the thermal values ​​of all second positions can be determined. The proportion m corresponding to each second position is multiplied by N to determine the total number t of first target positions corresponding to each second position. Then, a total number t of first target positions corresponding to each second position are randomly selected in the preset area where each second position is located, and the first target position determined at each second position is respectively assigned to each pedestrian mark. In this way, during the movement of the pedestrian mark, the distribution of the pedestrian mark always conforms to the thermal value distribution of the geographical area in the current time period.

[0097] Step 310 , based on the first position, the first target position, and the third position corresponding to each pedestrian mark, a moving path corresponding to each pedestrian mark is generated, and the pedestrian mark is moved in the three-dimensional space model based on the moving path.

[0098] In this application, any path planning method can be used to generate a moving path corresponding to each pedestrian marker based on the first position, the first target position, and the third position corresponding to each pedestrian marker, and add the moving path in the three-dimensional space model to move the pedestrian marker based on the moving path in the three-dimensional space model. For example, the pedestrian marker moves at a preset speed along the moving path. This enables the visualization of pedestrian movement and the real-time calculation of the moving path of the pedestrian marker, so that the digital twin model has both the ability to respond to the physical world and the dynamic vitality of the digital world. It realizes self-operation and simulation functions and improves the degree of intelligence.

[0099] It can be understood that the first position is the starting point of the pedestrian marking movement path, the first target position is the end point of the movement path, and the third position is a number of points along the movement path.

[0100] Optionally, during the movement of the pedestrian marker, the movement path can be updated based on the current position of the pedestrian marker. For example, the starting position of the movement path is updated using the current position of the pedestrian marker, that is, the portion of the movement path that the pedestrian marker has moved through is deleted, and only the portion of the movement path that has not been moved through is displayed.

[0101] Optionally, the process of generating the moving path corresponding to each pedestrian mark may refer to the following steps:

[0102] 1. Randomly generate an initial moving path based on the first position corresponding to the pedestrian mark.

[0103] 2. The first position, the first target position, the third position and the number of third positions are used as optimization targets, and the optimization target is used as the position of individual whales in the IWOA population.

[0104] 3. Initialize the IWOA optimization algorithm parameters and use the Tent-Logistic-Cosine chaotic mapping sequence to initialize the IWOA population. The formula is:

[0105]

[0106] In the formula, x i+1 is the initial position of the i-th whale individual generated by the Tent-Logistic-Cosine chaotic mapping sequence; x(i) is the initial position of the i-th whale population generated randomly; r is the preset parameter.

[0107] Compared with the randomly distributed population, the initial position distribution of the whale population is more uniform when the Tent-Logistic-Cosine chaotic mapping sequence is used to generate the initial population, which expands the search range of the whale population in space, increases the diversity of the group position, and to a certain extent improves the defect that the algorithm is prone to fall into local extreme values, thereby improving the optimization efficiency of the algorithm.

[0108] 4. Calculate the fitness value of each whale individual in the IWOA population, and retain the best whale individual based on the fitness value of each whale individual. The fitness value formula is:

[0109]

[0110] Where fit is the fitness function; E is the network output error function; y n is the true output value of the nth network node; is the ideal output value of the nth network node; n is the network node indicator; N is the total number of network nodes.

[0111] 5. Randomly generate p. If p<0.5 and |A|<1, execute the prey encirclement behavior improved by the convergence factor and update the IWOA population position. If p<0.5 and |A|≥1, execute the prey search behavior improved by the convergence factor and update the IWOA population position. If p≥0.5, execute the bubble net attack behavior improved by the convergence factor and update the IWOA population position. Among them, p is the update parameter, and A is the step size coefficient introduced for convergence factor optimization.

[0112] The process of executing the convergence factor-improved encirclement behavior and updating the IWOA population position can be seen in the following formula:

[0113] X 1 (t+1)=X * (t)-AD

[0114] Where, X 1 (t+1) is the updated position of the individual whale after surrounding the prey; X * (t) is the optimal whale individual position; D is the distance between the current whale individual and the optimal whale individual; A=2ar-a, a is the convergence factor decreasing from 2 to 0.

[0115] The formula for the convergence factor is:

[0116]

[0117] Where a is the convergence factor; tanh(.) is the hyperbolic tangent function; t, t max are the current number of iterations and the maximum number of iterations respectively; a max 、a minare the maximum and minimum values ​​of the convergence factor respectively; λ is the decreasing rate parameter, k is the decreasing period parameter, λ=-2π, k=π.

[0118] In the early stage of iteration, the value of a is large, the updated A is also large, |A|≥1, which makes the IWOA algorithm search for prey for a long time in the early stage of iteration, enhancing the global search ability of the algorithm. In the early stage of iteration, the value of a is small, the updated A is also small, |A|<1, which makes the IWOA algorithm surround the prey for a long time in the early stage of iteration, enhancing the local surround ability of the algorithm and improving the local hunting ability.

[0119] The process of executing the search prey behavior with improved convergence factor and updating the IWOA population position can be seen in the following formula:

[0120] X 2 (t+1)=X rand (t)-AD

[0121] Where, X 2 (t+1) is the individual position of the whale updated by the prey search behavior; X rand (t) is the position of a random individual whale selected from the IWOA population.

[0122] The process of executing the bubble net attack behavior with improved convergence factor and updating the IWOA population position can be seen in the following formula:

[0123] X 3 (t+1)=D'c bl cos(2πl)+X * (t)

[0124] Where, X 3 (t+1) is the position of the individual whale updated by the attack behavior of the bubble network; D' is the distance between the current individual whale and the prey; b is the constant defining the spiral equation, b=1; l is a random number between [-1,1].

[0125] 6. According to the updated IWOA population, dynamic reverse learning is performed to obtain the reverse IWOA population, the fitness value of each whale individual in the updated IWOA population and the reverse IWOA population is calculated, and the optimal whale individual is updated according to the fitness values ​​of all whale individuals to obtain the updated optimal whale individual.

[0126] The formula of the dynamic reverse learning strategy is:

[0127] X' ij (t) = k(a j (t)+b j (t))-X ij (t)

[0128] Where X' ij (t), X ij (t) are the reverse solution position and forward solution position of the j-th dimension of the i-th individual respectively; a j (t), b j (t) are the upper and lower bounds of the jth dimension of the current IWOA population; k is the decreasing inertia factor, k = 0.9-0.5t / t max ; t, t max are the current number of iterations and the maximum number of iterations respectively; reducing search blind spots and more effectively avoiding premature algorithm maturation and falling into local optimal values.

[0129] 7. Determine whether the number of iterations meets the requirements or whether the optimal fitness value corresponding to the updated optimal whale individual meets the requirements. If so, output the position of the global optimal solution corresponding to the updated optimal whale individual to obtain the optimal optimization target of the optimal pedestrian path. Otherwise, perform the next update of the IWOA population.

[0130] 8. According to the optimal optimization goal, the optimal first position, first target position, third position and the number of third positions are obtained, and according to the optimal first position, first target position, third position and the number of third positions, the optimal moving path of the pedestrian marker is generated.

[0131] It can be understood that the moving path of the pedestrian mark is the walking path that the pedestrian will take in the geographical area.

[0132] Optionally, when the first target position corresponding to the moving path is inside a building, the moving path is corrected based on the entrance and exit positions of the building and the staircase entrance and exit positions of the building to obtain a new moving path. This ensures the accuracy of the moving path marked by the pedestrian and improves the user experience of the model.

[0133] Step 311, taking the first position as the end point, based on the number of people leaving and the thermal values ​​at each position in the three-dimensional space model, re-planning the movement path of the pedestrian marker that has moved to the first target position to obtain a new movement path.

[0134] In this application, it is assumed that the number of people leaving is N, and then the proportion m of the thermal value at each position to the sum of the thermal values ​​of all positions can be determined. Multiply the proportion m corresponding to each position by N to determine the total number t of pedestrian marks corresponding to each position that need to re-plan the movement path. Then, randomly select the total number t of pedestrian marks corresponding to each position in the preset area, and re-plan the path for the t pedestrian marks with the first position as the end point. In this way, during the movement of the pedestrian marks, the distribution of the pedestrian marks always conforms to the thermal value distribution of the geographical area in the current time period.

[0135] In this application, the walking direction of pedestrians at the entrance and exit of a geographic area is identified, so as to determine the number of people leaving and entering based on the walking direction, and based on the number of people entering, a pedestrian mark is added to the first position corresponding to the entrance and exit in the three-dimensional space model. Then, based on the thermal value and object distribution at each position in the three-dimensional space model, the second position and the third position are determined, and based on the distribution of the thermal value corresponding to each second position, the first target position corresponding to each pedestrian mark is determined from each second position, so as to generate a moving path corresponding to each pedestrian mark based on the first position, the first target position, and the third position corresponding to each pedestrian mark, and move the pedestrian mark based on the moving path in the three-dimensional space model, and then, with the first position as the end point, based on the number of people leaving and the thermal value at each position in the three-dimensional space model, the moving path of the pedestrian mark that has moved to the first target position is re-planned to obtain a new moving path. Thus, the moving path of the pedestrian mark is calculated in real time, and the movement of the pedestrian is visualized, so that the digital twin model has both the ability to respond to the physical world and the dynamic vitality of the digital world. Self-operation and simulation functions are realized, and the degree of intelligence is improved.

[0136] Figure 4 A flowchart of a method for visualizing a geographic area provided in an embodiment of the present application.

[0137] like Figure 4 As shown, the visualization method of the geographic area includes the following steps:

[0138] Step 401 , based on the GIS data of the geographical area, the BIM data, and the three-dimensional scanning data of each object in the geographical area, a three-dimensional spatial model of the geographical area is constructed and visualized.

[0139] Step 402, determining a fault status of the infrastructure equipment based on the operating data of the infrastructure equipment in the geographic area.

[0140] Step 403: Add the fault status of the basic equipment to the three-dimensional space model.

[0141] Step 404 , based on the pedestrian images collected at each location in the geographic area, determine the pedestrian flow at each location.

[0142] Step 405 , gridding the three-dimensional space model to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at the position corresponding to each grid.

[0143] Step 406 , identifying the walking directions of pedestrians at the entrances and exits of the geographic area, so as to determine the number of people leaving and the number of people entering based on the walking directions.

[0144] Step 407: Add a pedestrian mark at a first position corresponding to the entrance and exit in the three-dimensional space model based on the number of people entering.

[0145] Step 408, determining the second position and the third position based on the thermal value and object distribution at each position in the three-dimensional space model.

[0146] Step 409 , based on the distribution of thermal values ​​corresponding to the second positions, determine the first target position corresponding to each pedestrian mark from the second positions.

[0147] Step 410 , based on the first position, the first target position, and the third position corresponding to each pedestrian mark, a moving path corresponding to each pedestrian mark is generated, and the pedestrian mark is moved in the three-dimensional space model based on the moving path.

[0148] Step 411, taking the first position as the end point, based on the number of people leaving and the thermal values ​​at each position in the three-dimensional space model, re-planning the movement path of the pedestrian marker that has moved to the first target position to obtain a new movement path.

[0149] In the present application, the specific implementation process of steps 401 to 411 can be found in the detailed description of any embodiment of the present application and will not be repeated here.

[0150] Step 412 , based on the stay time of each pedestrian mark at each reference position in the preset area where the moving path in the three-dimensional space model is located, determine the attraction index of each reference position.

[0151] In this application, the process of determining the attraction index of each position is as follows:

[0152] y=log ax

[0153] Where y is the attraction index; a is a positive number with a preferred value range of 1-50; x is the average of the dwell time of each pedestrian mark at the same location. The dwell time of the pedestrian mark can be determined by tracking the pedestrian.

[0154] Step 413: when the attraction index corresponding to any reference position is greater than a preset threshold, any reference position is determined as a second target position.

[0155] In the present application, the attraction index corresponding to each position may be compared with a preset threshold value. When the attraction index corresponding to a certain position is greater than the preset threshold value, the position is determined as the second target position.

[0156] Step 414: adjust the moving path based on the second target position to generate a new moving path.

[0157] In this application, before the pedestrian mark moves to the first target position according to the moving path, a new moving path can be regenerated with the second target position as the new end point, thereby making the pedestrian mark active to a certain extent and improving the user experience.

[0158] Optionally, the number of pedestrians at each location in the geographic area can be monitored in real time to determine the thermal value of each location in the geographic area. After the pedestrian mark moves to the first target position, when the thermal value of the first target position decreases, a third target position is allocated to some pedestrian marks in the preset area where the first target position is located in the local area where the thermal value increases. Afterwards, with the third target position as the end point, a new moving path corresponding to the part of the pedestrian marks is regenerated, and the part of the pedestrian marks is moved based on the new moving path. The update of the pedestrian marks is made to match the update of the thermal map of the geographic area, which further improves the activity of pedestrians and improves the accuracy of the movement of pedestrian marks and the user experience.

[0159] The process of allocating the third target position to some pedestrian markers in the preset area to which the first target position belongs in the local area where the thermal value increases is as follows:

[0160] 1. Based on the reduction ratio of the thermal value at the first target position, determine the number t of pedestrian marks that need to be re-routed in the preset area where the first target position is located. For example, the thermal value at the first target position at the current moment is N, which is reduced by m compared with the thermal value at the previous moment, and the number of pedestrian marks at the first target position at the previous moment is T, then:

[0161]

[0162] 2. Randomly select t positions in the local area where the thermal value increases and assign them to t pedestrian marks in the preset area where the first target position is located, and determine them as the third target positions corresponding to the t pedestrian marks.

[0163] In this application, based on the dwell time of each pedestrian mark at each reference position in the preset area where the moving path in the three-dimensional space model is located, the attraction index of each reference position is determined, and when the attraction index corresponding to any reference position is greater than the preset threshold, any reference position is determined as the second target position, and the moving path is adjusted based on the second target position to generate a new moving path. This makes the pedestrian mark have a certain activity, and improves the accuracy of pedestrian mark movement and the user experience.

[0164] In order to implement the above embodiment, the present application also proposes a device for visualizing a geographical area.

[0165] Figure 5 A schematic diagram of the structure of a device for visualizing a geographical area provided in an embodiment of the present application.

[0166] like Figure 5 As shown, the visualization device for the geographical area includes a construction module 510 , a determination module 520 , and an update module 530 .

[0167] A construction module 510 is used to construct a three-dimensional spatial model of the geographical area and perform visual display based on GIS data, BIM data, and three-dimensional scanning data of each object in the geographical area;

[0168] An equipment monitoring module 520 for determining a fault status of basic equipment based on operating data of basic equipment in a geographic area;

[0169] The visualization module 530 is used to add the fault status of the basic equipment in the three-dimensional space model.

[0170] Furthermore, in a possible implementation of the embodiment of the present application, the construction module 510 is used to:

[0171] Generate reference 3D spatial models based on GIS data and BIM data;

[0172] The three-dimensional scanning data are spliced ​​to generate a scanned three-dimensional space model;

[0173] Determine a plurality of pairs of feature points in the reference three-dimensional space model and the scanned three-dimensional space model to determine a transformation matrix of the reference three-dimensional space model based on the feature points;

[0174] Based on the transformation matrix, the reference 3D space model is aligned to obtain a 3D space model.

[0175] Furthermore, in a possible implementation of the embodiment of the present application, it also includes:

[0176] A data collection module for determining the flow of pedestrians at each location based on pedestrian images collected at each location in the geographic area;

[0177] The heat map generation module is used to grid the three-dimensional space model to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at the position corresponding to each grid.

[0178] Furthermore, in a possible implementation of the embodiment of the present application, a pedestrian simulation control module is further included, which is used to:

[0179] Identify the walking direction of pedestrians at the entrance and exit of the geographic area to determine the number of people leaving and entering based on the walking direction;

[0180] Based on the number of people entering, a pedestrian marker is added at the first position corresponding to the entrance and exit in the three-dimensional space model.

[0181] Determine the second position and the third position based on the thermal value and the object distribution at each position in the three-dimensional space model;

[0182] Determining a first target position corresponding to each pedestrian mark from each second position based on a distribution of thermal values ​​corresponding to each second position;

[0183] Based on the first position, the first target position, and the third position corresponding to each pedestrian mark, a moving path corresponding to each pedestrian mark is generated, and the pedestrian mark is moved in the three-dimensional space model based on the moving path;

[0184] Taking the first position as the end point, based on the number of people leaving and the thermal value at each position in the three-dimensional space model, the moving path of the pedestrian marker that has moved to the first target position is replanned to obtain a new moving path.

[0185] Furthermore, in a possible implementation manner of the embodiment of the present application, a correction module is also included, which is used to:

[0186] When the first target position corresponding to the moving path is inside a building, the moving path is corrected based on the entrance and exit positions of the building and the entrance and exit positions of the stairs of the building to obtain a new moving path.

[0187] Furthermore, in a possible implementation of the embodiment of the present application, the correction module is used to:

[0188] Determine the attraction index of each reference position based on the stay time of each pedestrian mark at each reference position in the preset area where the moving path is located in the three-dimensional space model;

[0189] When the attraction index corresponding to any reference position is greater than a preset threshold, any reference position is determined as a second target position;

[0190] The moving path is adjusted based on the second target position to generate a new moving path.

[0191] Furthermore, in a possible implementation of the embodiment of the present application, the correction module is used to:

[0192] After the pedestrian mark moves to the first target position, when the thermal value at the first target position decreases, a third target position is allocated to some pedestrian marks in the preset area where the first target position is located in a local area where the thermal value increases;

[0193] Taking the third target position as the end point, some pedestrian marks are regenerated to correspond to the new moving path.

[0194] It should be noted that the above explanations of the embodiment of the method for visualizing a geographic area are also applicable to the device for visualizing a geographic area of ​​this embodiment, and will not be described in detail here.

[0195] In this application, based on the GIS data, BIM data, and three-dimensional scanning data of each object in the geographical area, a three-dimensional space model of the geographical area is constructed and visualized. After that, based on the operating data of the basic equipment in the geographical area, the fault state of the basic equipment is determined, and then the fault state of the basic equipment is added to the three-dimensional space model. As a result, the three-dimensional space model constructed based on the GIS data and BIM data of the geographical area not only shows the geographical terrain characteristics and its surrounding environment of the geographical area at the macro level, but also reproduces the three-dimensional layout of the building structure and the operating status of the basic equipment at the micro level, realizing the accurate and intuitive expression of the geographical characteristics and architectural characteristics of the geographical area. In addition, the three-dimensional scanning data of each object is combined to construct a three-dimensional space model, thereby improving the digital simulation and accuracy of the visualization of the geographical area.

[0196] In order to implement the above embodiments, the present application also proposes an electronic device, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method provided by the above embodiments.

[0197] In order to implement the above embodiments, the present application also proposes a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the methods provided by the above embodiments.

[0198] In order to implement the above embodiments, the present application also proposes a computer program product, including a computer program, which implements the methods provided by the above embodiments when executed by a processor.

[0199] The collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in this application are in compliance with relevant laws and regulations and do not violate public order and good morals.

[0200] It should be noted that personal information from users should be collected for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. In addition, such collection / sharing should be carried out after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign the agreement / authorization including authorization of relevant user information before the user uses the function. In addition, any necessary steps should be taken to protect and safeguard access to such personal information data and ensure that others who have access to personal information data comply with its privacy policy and procedures.

[0201] This application is expected to provide an implementation scheme for users to selectively block the use or access of personal information data. That is, this application is expected to provide hardware and / or software to prevent or block access to such personal information data. Once the personal information data is no longer needed, risks can be minimized by limiting data collection and deleting data. In addition, when applicable, personal identifiers are removed from such personal information to protect the privacy of users.

[0202] In the description of the aforementioned embodiments, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0203] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0204] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0205] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0206] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0207] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0208] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0209] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for visualizing a geographical area, characterized in that: The method comprises: Based on the GIS data, BIM data and 3D scanning data of each object in the geographical area, a 3D spatial model of the geographical area is constructed and visualized; determining a fault status of the infrastructure equipment based on operating data of the infrastructure equipment in the geographic area; The fault status of the basic equipment is added to the three-dimensional space model.

2. The method according to claim 1, characterized in that The method of constructing a three-dimensional spatial model of the geographical area based on the GIS data, BIM data of the geographical area, and three-dimensional scanning data of each object in the geographical area and performing a visual display includes: Generate a reference three-dimensional space model based on the GIS data and the BIM data; splicing the three-dimensional scanning data to generate a scanned three-dimensional space model; Determine a plurality of pairs of feature points in the reference three-dimensional space model and the scanned three-dimensional space model, so as to determine a transformation matrix of the reference three-dimensional space model based on the feature points; Based on the transformation matrix, the reference three-dimensional space model is aligned in perspective to obtain a three-dimensional space model.

3. The method according to claim 1, characterized in that Also includes: Determine the pedestrian flow at each location in the geographic area based on pedestrian images collected at each location; The three-dimensional space model is gridded to generate and add a heat map to the three-dimensional space model based on the number of pedestrians at a position corresponding to each grid.

4. The method according to claim 3, characterized in that Also includes: Identifying the walking directions of pedestrians at the entrance and exit of the geographic area to determine the number of people leaving and the number of people entering based on the walking directions; Based on the number of people entering, a pedestrian mark is added to a first position corresponding to the entrance and exit in the three-dimensional space model. Determining a second position and a third position based on thermal values ​​and object distribution at each position in the three-dimensional space model; Based on the distribution of the thermal values ​​corresponding to the second positions, determining the first target position corresponding to each of the pedestrian marks from the second positions; Based on the first position, the first target position, and the third position corresponding to each of the pedestrian marks, a moving path corresponding to each of the pedestrian marks is generated, and the pedestrian marks are moved in the three-dimensional space model based on the moving path; Taking the first position as the end point, based on the number of people leaving and the thermal value at each position in the three-dimensional space model, the movement path of the pedestrian marker that has moved to the first target position is re-planned to obtain a new movement path.

5. The method according to claim 4, characterized in that Also includes: When the first target position corresponding to the moving path is inside a building, the moving path is corrected based on the entrance and exit positions of the building and the entrance and exit positions of the stairs of the building to obtain a new moving path.

6. The method according to claim 4, characterized in that Also includes: Determining an attraction index of each reference position based on the stay time of each pedestrian mark at each reference position in the preset area where the moving path in the three-dimensional space model is located; When the attraction index corresponding to any reference position is greater than a preset threshold, determining the any reference position as a second target position; The moving path is adjusted based on the second target position to generate a new moving path.

7. The method according to claim 4, characterized in that Also includes: After the pedestrian mark moves to the first target position, when the thermal value of the first target position decreases, a third target position is allocated to some pedestrian marks in the preset area where the first target position is located in the local area where the thermal value increases; Taking the third target position as an end point, a new moving path corresponding to the partial pedestrian mark is regenerated.

8. A device for visualizing a geographical area, characterized in that: The device comprises: A construction module is used to construct a three-dimensional spatial model of the geographical area and perform visual display based on GIS data, BIM data, and three-dimensional scanning data of each object in the geographical area; An equipment monitoring module, configured to determine a fault status of the basic equipment based on operation data of the basic equipment in the geographical area; A visualization module is used to add the fault status of the basic equipment in the three-dimensional space model.

9. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

Images