A data fusion and sharing method, apparatus, electronic device, and storage medium

By establishing a community digital map and business relationship map, the shortcomings of data fusion and sharing in the community big data platform are solved, and the ability to respond quickly and deal with emergencies is achieved.

CN113590568BActive Publication Date: 2025-08-01TSINGHUA UNIVERSITY
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202110755048.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-02
Publication Date
2025-08-01
Estimated Expiration
2041-07-02

AI Technical Summary

Technical Problem

The community big data platform has shortcomings in data fusion and sharing, which leads to the inability to provide comprehensive decision-making support, the data silos are serious and data updates and maintenance are difficult, making it difficult to respond to emergencies quickly.

Method used

Establish a community digital map containing two-dimensional maps, tilt photography models and building information models, and realize data sharing through business relationship maps. Use an open source map engine to fusion and unified spatiotemporal coordinate processing, and establish data exchange channels and protocols.

Benefits of technology

It realizes rapid retrieval and response of community data, supports the rapid location and efficient handling of emergencies, and provides comprehensive decision-making support.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113590568B_ABST
    Figure CN113590568B_ABST
Patent Text Reader

Abstract

This application relates to the technical fields of data science and emergency management, and particularly relates to a data fusion and sharing method, device, electronic device, and storage medium. It includes the following steps: establishing a digital map of a data community that includes data such as GIS maps, oblique photography models, and building BIM models; establishing a community data business relationship graph that includes a data file graph and a data coupling relationship graph, and establishing a data exchange channel to unify the data transmission protocol; locating the spatio-temporal coordinates of a risk event in the digital map of the community, finding the associated institutions of the event according to the business relationship graph, sending a data sharing request to the institutions, and the data owner institutions upload and share the data through the data exchange channel. This method provides an architecture design for a community risk prevention big data platform, which can improve the flexibility and practicality of the community data platform and greatly enhance the response speed and handling efficiency of community risk events.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical fields of data science and emergency management, and particularly relates to a data fusion and sharing method, apparatus, electronic device, and storage medium. Background Art

[0002] Communities are characterized by numerous and complex overlapping risk factors. Monitoring, predicting, and intelligently preventing community risks are extremely challenging topics and important technical supports for community safety assurance. Community risk factors are highly concentrated, complexly coupled with each other, and have the characteristics of high dynamics, high uncertainty, and a mixture of "humans-machines-things". Community risk prevention faces the dilemmas of high uncertainty, difficult risk quantification analysis, and prediction and response. Existing methods and technologies cannot support the active prevention needs of community risks in the big data era.

[0003] Community big data platforms provide a solution for community risk prevention. By integrating and analyzing various types of community data, risk sources can be identified and risk events can be predicted, and community risks can be scientifically controlled to a certain extent. However, the existing various community big data platforms still have the following problems: (1) Data integration only stays at the data access level, there is a lack of interaction between data, and deep fusion cannot be carried out, making it difficult to provide comprehensive decision-making support for community emergency management, and further design of the data fusion scheme is required; (2) Various types of data in the community belong to different organizational structures, and it is difficult to share data between various entities, and the phenomenon of "data islands" is serious. Centralized data storage will also bring problems such as slow data update and difficult maintenance, and an efficient data sharing mechanism needs to be established; (3) When dealing with emergencies, it is difficult to clarify the data required to handle the event in the first place and request data from the data owners. Summary of the Invention

[0004] In view of this, the present disclosure needs to propose a data fusion and sharing method, apparatus, electronic device, and storage medium, and a community data retrieval method that can respond quickly. After technical retrieval and research, no data fusion and sharing method for community governance has been found. It aims to solve at least one of the related technical defects to provide a technical framework and application method for the community risk prevention big data platform and provide decision-making support for community emergency event handling.

[0005] According to a first aspect of the present disclosure, a data fusion and sharing method is proposed, including:

[0006] Establish a community digital map including a two-dimensional map, an oblique photography model, and a building information model;

[0007] Establish a community data subject business relationship graph including a data file graph and a data coupling relationship graph;

[0008] Locate emergencies in the community digital map in terms of time and space, and perform data sharing according to the community main business relationship graph.

[0009] Optionally, the establishment of the community digital map includes:

[0010] Obtain the two-dimensional map data of the community from a commercial map company or an open-source database;

[0011] Collect community ground images from multiple perspectives, use three-dimensional image reconstruction technology to perform three-dimensional reconstruction on the community ground images to obtain a three-dimensional model of the community ground buildings, and use the surface texture mapping method to process the three-dimensional model to obtain an oblique photography model of the community ground buildings;

[0012] Draw a building information model of the community buildings including building structures according to the construction drawings of the community buildings;

[0013] Obtain the community spatio-temporal information from the community property or the street management center, and the spatio-temporal information includes: the water supply and power supply pipeline map, the monitoring camera location map, the building floor plan, the community building attribute information, and the community fire passage information within the community;

[0014] Use an open-source map engine to import the two-dimensional map data, the oblique photography model of the community ground buildings, and the building information model into the map engine to obtain a community digital map with spatio-temporal coordinate information, and establish a coordinate mapping relationship between the data and the model;

[0015] According to the spatio-temporal information, label the spatio-temporal coordinate information in the community digital map, and the labeling content includes: water supply and power supply lines, monitoring camera locations, building floor plans, community building attribute information, and community fire passage information;

[0016] Optionally, the establishment of the community data main business relationship graph includes:

[0017] Record each functional department in the community as a community data main body;

[0018] Establish a business relationship graph between community data main bodies, including a data file graph and a data coupling relationship graph, where the data file graph is used to describe the data information held by community data main bodies, and the data coupling relationship graph is used to describe the association relationship between different data information;

[0019] According to the business relationship graph between the community data main bodies, establish a data exchange channel and a data exchange protocol between the community data main bodies;

[0020] Optionally, the locating of emergencies in the community digital map in terms of time and space and the data sharing according to the community main business relationship graph include:

[0021] Locate the spatio-temporal coordinates of community emergencies in the established community digital map. The location content includes the occurrence time and location of the emergency and the geographical information granularity of the location. The geographical information granularity is divided into city level, community level, building level, and room level. According to the geographical information granularity, relevant data information is retrieved from the corresponding two-dimensional community map, oblique photography model, building information model, and room floor plan respectively;

[0022] Search for the functional departments associated with the emergency according to the community main business relationship graph, and send a data sharing request to the functional departments. The functional departments receive the data sharing request and send the relevant data information to the data sharing requester.

[0023] According to the second aspect of the present disclosure, a data fusion and sharing system is proposed, including:

[0024] A data fusion module, which is used to establish or obtain a GIS map, an oblique photography model, and a building BIM model, unify the spatio-temporal coordinates of the above data, and fuse them into a community digital map. At the same time, it provides functions such as viewing, annotation, location, and data visualization of the community digital map.

[0025] A data graph module, which is used to establish and save a community main business relationship graph including a data file graph and a data coupling relationship graph, and provide functions such as business relationship retrieval, screening, and matching.

[0026] A data sharing module, which is used to establish a data exchange channel between community data entities, and the community data entities share data through a unified data exchange channel and protocol.

[0027] According to the third aspect of the present disclosure, an electronic device for data fusion and sharing is proposed, including:

[0028] An oblique photography unmanned aerial vehicle, which is used to collect community ground images;

[0029] A graphics workstation, which is used to perform three-dimensional reconstruction on the ground images;

[0030] A GPU server, which is used to carry an open-source map engine, import a two-dimensional map, an oblique photography model, and a building information model into the map engine, and perform unified spatio-temporal coordinate processing, so as to provide community digital map services for community data entities;

[0031] A computing server, which is used to establish and store the business relationship graph between community data entities, establish a data exchange channel between community data entities, and process user data sharing requests;

[0032] An electronic computer, which is used to store user data, access the community digital map, send data sharing requests, and receive data shared from other data entities.

[0033] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions for causing the computer to execute:

[0034] Establish a community digital map including a two-dimensional map, an oblique photography model, and a building information model;

[0035] Establish a community data subject business relationship graph including a data archive map and a data coupling relationship map;

[0036] Perform spatio-temporal positioning of emergencies in the community digital map and perform data sharing according to the community subject business relationship graph.

[0037] According to an embodiment of the present disclosure, three different levels of community geographic information data, namely two-dimensional map data, oblique photography model, and building information model, are effectively integrated to form a community digital map with unified spatio-temporal coordinates, and further spatio-temporal information annotation is performed, so as to more efficiently monitor various types of information in the community and quickly locate emergencies. The data sharing channel established based on the community data subject business relationship graph can assist the emergency disposal party and the relevant functional departments of the event to establish data communication, so as to obtain the data related to the event in the first time, support on-site command decision-making, and achieve rapid response and efficient disposal of emergencies.

[0038] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be understood through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The above and / or additional aspects and advantages of the present disclosure will become apparent and be readily understood from the following description of the embodiments in conjunction with the accompanying drawings, wherein

[0040] Figure 1 is a flowchart of a data fusion and sharing method according to an embodiment of the present disclosure.

[0041] Figure 2 is a flowchart of establishing a community digital map according to an embodiment of the present disclosure.

[0042] Figure 3 is a data archive map according to an embodiment of the present disclosure.

[0043] Figure 4 is a data coupling relationship map according to an embodiment of the present disclosure.

[0044] Figure 5 is a schematic diagram of the architecture of a data fusion and sharing device according to an embodiment of the present disclosure.

[0045] Figure 6 This is the hardware structure diagram of an electronic device for data fusion and sharing according to an embodiment of the present disclosure. Specific implementation manners

[0046] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0047] Figure 1 The figure shows a flowchart of an embodiment of the data fusion and sharing method proposed by the present disclosure, which may include the following steps:

[0048] In step 1, a community digital map including a two-dimensional map, an oblique photography model, and a building information model is established;

[0049] In one embodiment, as Figure 2 shown, establishing the community digital map includes the following steps:

[0050] (1) Obtain the two-dimensional map data of the community from a commercial map company or an open-source database; the map data is the basis for the spatial coordinate unification and three-dimensional visualization display of all community data. At present, there are rich data sources for two-dimensional GIS map data. Map interfaces can be applied to commercial companies such as Google Earth, or map data resources can be obtained through open-source databases such as OpenStreetMap.

[0051] (2) Use a drone to collect ground images of the community from multiple angles, use three-dimensional image reconstruction technology to perform three-dimensional reconstruction on the ground images of the community, obtain a three-dimensional model of the ground buildings in the community, and use the surface texture mapping method to process the three-dimensional model to obtain an oblique photography model of the ground buildings in the community;

[0052] (3) Draw a building information model of the community buildings including building structures according to the construction drawings of the community buildings; the building structures include doors, windows, beams, columns, etc. The building information model (BIM) is a more accurate building information model obtained through manual modeling. This model contains rich building structure information and can clearly represent the building, providing more effective and richer information for community risk prevention than the oblique photography model.

[0053] (4) Obtain the community spatio-temporal information from the community property or the street management center. The spatio-temporal information includes: the water supply and power supply pipeline diagram in the community, the location map of surveillance cameras, the building floor plan, the community building attribute information, and the community fire passage information;

[0054] (5) Adopt an open-source map engine (the open-source map engine is abbreviated as Cesium, which is a map engine based on JavaScript using WebGL, supports map displays in 3D, 2D, and 2.5D forms, can draw graphics and highlight areas by itself, and supports the vast majority of browsers and mobile devices.), import the data and models in the above steps (1), (2), and (3) into the map engine to obtain a community digital map with spatio-temporal coordinate information, and establish a coordinate mapping relationship between the data and models in steps (1), (2), and (3):

[0055] mapping f:B(x B ,y B ,z B )→O(x o ,y o ,z o )→G(long, lati, heig)

[0056] where: mapping f is a mapping function, B(x B ,y B ,z B ) is the spatial coordinate system of the building information model in step (3), O(x o ,y o ,z o ) is the spatial coordinate system of the oblique photography model in step (2), and G(long, lati, heig) is the longitude-latitude-elevation coordinate system of the 2D map data in step (1);

[0057] (6) According to the spatio-temporal information in step (4), label the spatio-temporal coordinate information in the community digital map in step (5), and the labeling content includes: water supply and power supply lines, positions of surveillance cameras, building floor plans, community building attribute information, and community fire passage information.

[0058] In step 2, establish a community data main body business relationship graph including a data file graph and a data coupling relationship graph;

[0059] In one embodiment, establishing a community data main body business relationship graph includes the following steps:

[0060] (1) Respectively record each functional department in the community as a community data main body;

[0061] (2) Establish a business relationship graph between community data main bodies, including a data file graph and a data coupling relationship graph, where the data file graph is used to describe the data information held by community data main bodies (the data information includes data sources, parameter attribute descriptions, data interface information, return data format examples, etc.), Figure 3It is an example diagram of a data archive diagram. The data coupling relationship diagram is used to describe the association relationships between different data information; Figure 4 It is an example diagram of a community data coupling relationship diagram.

[0062] (3) According to the business relationship diagram between the community data subjects, establish a data exchange channel and a data exchange protocol between the community data subjects; data sharing is carried out between the community data subjects through a unified data exchange channel and protocol.

[0063] In step 3, locate the emergency events in the community digital map in terms of time and space, and perform data sharing according to the community subject business relationship map.

[0064] In one embodiment, locating the emergency events in the community digital map in terms of time and space, and performing data sharing according to the community subject business relationship map includes the following steps:

[0065] (1) Locate the spatio-temporal coordinates of the community emergency events in the established community digital map. The location content includes the occurrence time and location of the emergency events and the geographical information granularity of the location. The geographical information granularity is divided into city level, community level, building level and room level. According to the geographical information granularity, find the relevant data information from the corresponding two-dimensional community map, oblique photography model, building information model and room floor plan respectively;

[0066] (2) Find the functional departments associated with the emergency events according to the community subject business relationship map, and send a data sharing request to the functional departments. The functional departments receive the data sharing request and send the relevant data information to the data sharing requester.

[0067] One embodiment of the present disclosure proposes a data fusion and sharing device. The logical relationships between the modules in the device are as Figure 5 shown, including:

[0068] (1) A data fusion module, which is used to establish or obtain a GIS map, an oblique photography model, and a building BIM model, unify the spatio-temporal coordinates of the above data, fuse them into a community digital map, and at the same time provide functions such as viewing, marking, positioning and data visualization of the community digital map.

[0069] (2) A data map module, which is used to establish and save a community subject business relationship map including a data archive map and a data coupling relationship map, and provide functions such as business relationship retrieval, screening and matching.

[0070] (3) A data sharing module, which is used to establish a data exchange channel between community data subjects. Data sharing is carried out between the community data subjects through a unified data exchange channel and protocol.

[0071] An embodiment of the present disclosure provides an electronic device for data fusion and sharing. The connection relationships among the electronic devices for data fusion and sharing are as shown in Figure 6 and include:

[0072] An oblique photography UAV for collecting community ground images;

[0073] A graphics workstation for three-dimensional reconstruction of ground images;

[0074] A GPU server for carrying an open-source map engine and importing a two-dimensional map, an oblique photography model, and a building information model into the map engine for unified spatio-temporal coordinate processing, so as to provide community digital map services for community data subjects;

[0075] A computing server for establishing and storing a business relationship graph among community data subjects, establishing a data exchange channel among community data subjects, and processing user data sharing requests

[0076] An electronic computer for storing user data, accessing the community digital map, sending data sharing requests, and receiving data shared by other data subjects.

[0077] An embodiment of the present disclosure provides a computer-readable storage medium storing computer instructions for causing a computer to execute:

[0078] Establishing a community digital map including a two-dimensional map, an oblique photography model, and a building information model;

[0079] Establishing a business relationship graph of community data subjects including a data archive map and a data coupling relationship graph;

[0080] Performing spatio-temporal positioning of emergencies in the community digital map and sharing data according to the business relationship graph of community subjects.

[0081] In summary, the embodiments of the present disclosure provide a data fusion and sharing method, device, electronic device, and storage medium for community risk prevention and emergency management requirements.

[0082] In an embodiment of the present disclosure, a data fusion and sharing method for community governance is used to provide data resources and decision-making support for community fire rescue risk events. Figure 5A data fusion and sharing system developed based on the architecture design proposed in this disclosure. This system integrates data from GIS maps, oblique photography models, and building information models and unifies the spatio-temporal coordinates, annotates building information and the locations of surveillance cameras, and establishes data indexes for housing personnel and CAD drawings. When a fire incident occurs in the community, the fire department first locates the fire position through this data platform to obtain the spatio-temporal information of the incident. Further, through the business relationship diagram of data entities established by the data platform, the fire department retrieves that the required housing structure information and fire passage data are located at the community property entity, sends a data sharing request through the platform, and the community property shares this data with the fire department through the data sharing channel established by the platform. Further, the fire department formulates a rescue plan based on the obtained housing structure information and fire passage data to support on-site command and decision-making, thereby achieving a rapid response and efficient handling of the incident.

Claims

1. A data fusion and sharing method, characterized in that Including: Establishing a community digital map including a two-dimensional map, an oblique photography model, and a building information model includes: collecting community ground images from multiple angles, reconstructing the community ground images in three dimensions using three-dimensional image reconstruction technology, and obtaining three-dimensional models of community ground buildings; drawing a building information model of the community building including the building structure based on the construction drawings of the community building; using an open source map engine to import the two-dimensional map data, the oblique photography model, and the building information model into the map engine to obtain a community digital map with spatiotemporal coordinate information, and establishing a coordinate mapping relationship between the three, wherein the mapping relationship is mapping f:B(x B ,y B ,z B )→O(x o ,y o ,z o )→G(long,lati,heig), where mapping f is the mapping function, B(x B ,y B ,z B ) is the spatial coordinate system of the building information model, O(x o ,y o ,z o ) is the spatial coordinate system of the oblique photography model, and G(long, lati, heig) is the latitude, longitude, and elevation coordinate system of the two-dimensional map data; Establish a community data subject business relationship graph including a data archive graph and a data coupling relationship graph, where the data archive graph is used to describe the data information held by the community data subject, and the data information includes: data source, parameter attribute description, data interface information, and return data format example, and the data coupling relationship graph is used to describe the association relationship between different data information; Perform spatio-temporal positioning on emergencies in the community digital map, and the positioning content includes the occurrence time and location of the emergency and the geographical information granularity of the location. The geographical information granularity is divided into city level, community level, building level, and room level, and relevant data information is obtained by searching from the corresponding two-dimensional community map, oblique photography model, building information model, and room floor plan according to the geographical information granularity; Search for the functional departments associated with the emergency according to the community data subject business relationship graph, send a data sharing request to the functional department, and the functional department receives the data sharing request and performs data sharing according to the community data subject business relationship graph.

2. The data fusion and sharing method according to claim 1, characterized in that Establishing a community digital map includes the following steps: (1) Obtain the two-dimensional map data of the community from a commercial map company or an open-source database; (2) Collect community ground images from multiple angles, use three-dimensional image reconstruction technology to perform three-dimensional reconstruction on the community ground images to obtain a three-dimensional model of the community ground buildings, and use the surface texture mapping method to process the three-dimensional model to obtain an oblique photography model of the community ground buildings; (3) Draw a building information model of the community buildings including the building structure according to the construction drawings of the community buildings; (4) Obtain the spatio-temporal information of the community from the community property or the street management center, and the spatio-temporal information includes: the water supply and power supply pipeline map in the community, the monitoring camera location map, the building floor plan, the community building attribute information, and the community fire passage information; (5) Use an open-source map engine to import the data and models in the above steps (1), (2), and (3) into the map engine to obtain a community digital map with spatio-temporal coordinate information; (6) According to the spatio-temporal information in step (4), annotate the spatio-temporal coordinate information in the community digital map in step (5), and the annotation content includes: water supply and power supply lines, monitoring camera locations, building floor plans, community building attribute information, and community fire passage information.

3. The data fusion and sharing method according to claim 1, wherein Establishing a community data subject business relationship graph includes the following steps: (1) Denote each functional department in the community as a community data subject; (2) Establish a business relationship graph between community data subjects, including a data archive graph and a data coupling relationship graph, where the data archive graph is used to describe the data information held by the community data subject, and the data coupling relationship graph is used to describe the association relationship between different data information; (3) According to the business relationship graph between the community data subjects, establish a data exchange channel and a data exchange protocol between the community data subjects.

4. A data fusion and sharing device for performing the data fusion and sharing method according to any one of claims 1-3, characterized in that Including: (1) Data fusion module, which is used to establish or obtain maps, oblique photography models, and building models, unify the spatio-temporal coordinates of the above data, fuse them into a community digital map, and at the same time provide functions such as viewing, annotation, positioning, and data visualization of the community digital map; (2) Data atlas module, which is used to establish and save a community main business relationship atlas containing a data archive map and a data coupling relationship map, and provide functions such as business relationship retrieval, screening, and matching; (3) Data sharing module, which is used to establish a data exchange channel between community data subjects, and the community data subjects share data through a unified data exchange channel and protocol.

5. An electronic device for data fusion and sharing, which is used to execute the data fusion and sharing method described in any one of claims 1-3, characterized in that Comprising: An oblique photography drone, which is used to collect community ground images; A graphics workstation, which is used to perform three-dimensional reconstruction on the ground images; A GPU server, which is used to carry an open-source map engine, import a two-dimensional map, an oblique photography model, and a building information model into the map engine, and perform unified spatio-temporal coordinate processing, so as to provide community digital map services for community data subjects; A computing server, which is used to establish and store the business relationship atlas between community data subjects, establish a data exchange channel between community data subjects, and process user data sharing requests, An electronic computer, which is used to store user data, access the community digital map, send data sharing requests, and receive data shared from other data subjects.

6. A computer-readable storage medium, characterized in that Comprising: The computer-readable storage medium stores computer instructions, and the computer instructions are used to cause the computer to execute the data fusion and sharing method according to any one of claims 1-3.

Citation Information

Patent Citations

  • Community knowledge graph construction method and system

    CN110727805A

  • Smart city three-dimensional comprehensive command center

    CN110825728A

  • Community real-time twinning system based on combination of community service middle station and data middle station and BIM

    CN112699451A