Multi-source heterogeneous data cross-system collaborative processing method and system

Abstract

The present invention discloses a method and system for cross-system collaborative processing of multi-source heterogeneous data, and relates to the technical field of intelligent perception of public safety events. The method of the present invention includes first dividing the data security level, then identifying the data structure, and then establishing a multi-source heterogeneous data processing system. The data acquisition party sends a digital signature to the calling unit, the calling unit matches the data signature with the data security level, the data processing unit processes and transmits the data, and finally the data display unit displays the data content. The system of the present invention includes a data provider and a data acquisition party, and the communication connection between them is a multi-source heterogeneous data processing system, and the processing system includes a calling unit, a processing unit, and a display unit. The present invention is a method and system for cross-system collaborative processing of multi-source heterogeneous data, which reduces the error rate of data transmission and ensures the safe transmission and collaborative scheduling of data resources.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent perception processing of public safety events, and in particular to a method and system for cross-system collaborative processing of multi-source heterogeneous data. Background Art

[0002] The intelligent perception and processing of public safety events of integrated sky-ground big data aims to make full use of the advantages of massive multi-source heterogeneous big data in the sky-ground in the form of close cooperation among multiple parties, and improve the response and processing capabilities of public safety events. With the rapid development of economy and society and the continuous advancement of network management reform, it is of great significance to realize the cross-temporal, multi-scale and multi-granularity convergence of multi-source heterogeneous data and build a big data system required for multi-type event handling for the intelligent perception and understanding of public safety events of integrated sky-ground big data. In the existing collaborative processing of multi-source heterogeneous data, the matching of call permissions for data from different sources is relatively chaotic, and the data structure is different, which leads to confusion in the representation and display of data, and it is very easy to have data format unsupported. Among them, how to realize cross-system flow and viewing between data with different source systems, different security levels and different data structure types is relatively troublesome. Therefore, it is of great significance to formulate unified standards for representation, management and display. It is necessary to consider the problem of cross-network transmission, ensure the stability, reliability, security and confidentiality of the system, and then solve the management problem of cross-security level network link interaction.

[0003] However, the multi-source heterogeneous data cross-system collaborative processing methods provided in the prior art are all simple operations on one or two types of data and the usage standards are not unified. It is impossible to complete real-time processing and real-time viewing of multiple data through a single system. Permission errors, format errors, and confidential data being illegally downloaded and viewed often occur. It is also difficult to process complex data based on unified standards. Summary of the invention

[0004] The main purpose of the present invention is to provide a method and system for cross-system collaborative processing of multi-source heterogeneous data, which can effectively solve the problems that the existing processing methods in the background technology cannot uniformly process data from various sources with different structures, making data calls difficult, and often causing insufficient permissions and display format errors.

[0005] To achieve the above object, the technical solution adopted by the present invention is: a method for cross-system collaborative processing of multi-source heterogeneous data, comprising the following steps:

[0006] S1: Data security levels are divided according to the data source and in combination with the data source regulations, and the level division identifier is used as the encoding suffix and attached to the data encoding backend. The data level division identifier performs asynchronous encryption processing on the data and generates a set of decryption characters at the same time;

[0007] S2: Identify the data structure of data in different data forms, use the data structure identifier as the encoding prefix, and attach it to the front end of the data encoding;

[0008] S3: Establish a multi-source heterogeneous data processing system, and establish a calling unit, a processing unit, and a display unit in the processing system;

[0009] S4: The data acquirer first sends a digital signature carrying its own identity information to the calling unit. The digital signature simultaneously carries the data content identifier required by the data acquirer. The calling unit compares the digital signature with the data level classification identifier and determines whether they match. If the match is successful, the data calling unit directly calls the data content.

[0010] S5: The data calling unit sends the data to the processing unit. The processing unit adopts different ferrying mechanisms for different data types. The processing process mainly involves data reception, content security processing, data copying, format conversion, data encryption and data transmission. Different data attributes are processed individually and differentiated. The data ferrying function is completed in the information hub of the processing unit, and other processing processes are all performed in the access gateway.

[0011] S6: The data display unit displays the data according to the ferry mechanism and the data structure identifier, and meets the data usage requirements of the data acquirer.

[0012] Preferably, in the process of classifying the data security levels according to the data sources in combination with the data source regulations in step S1, the remote sensing data management system, border surveillance video system, police PGIS system and police information comprehensive application platform transmitted through dedicated lines are classified as three-level security identification, the drone data acquisition and processing system and the prefecture-level integrated video information command and dispatch system are classified as two-level security identification, and the remote sensing data management system and the public network system transmitted through the Internet are classified as one-level security identification.

[0013] Preferably, in step S3, the data calling module first builds a collection unit, an external network proxy service unit, an isolated communication unit and an internal network proxy service unit, and collects the collected military satellite remote sensing image data, civilian satellite remote sensing image data, drone data, border monitoring data, and ground monitoring video data into the corresponding collection unit through the external network collection interface, and then transmits the data through different networks, and sends the data to the corresponding external network proxy service unit in different categories. The external network service unit then feeds back the data type to the isolated communication units of different levels for differentiated isolation processing. After the processing, the isolated communication unit sends the data to the internal network proxy service unit to complete the data crossing from the external network to the internal network. The intranet proxy service unit will send the isolated security data to the intranet collection unit. The processing unit directly calls the data in the intranet collection unit, including the police information comprehensive application platform in the data source system, the police PGIS system and the business information and PGIS traffic information collected from the Internet, and the Internet data. Because the data is inside the public security information network, there is no need to access the gateway. For the remote sensing image data, drone data, border monitoring data, and ground monitoring video data collected by the remote sensing data management system, drone aviation data link, border monitoring video system, and prefecture-level integrated video information command and dispatch system, which are outside the public security information network, access gateways are required to ensure the security of the data during transmission. The data transmitted to the service bus through the access gateway realizes the logical link of physical isolation through data transmission, maps these data source system addresses to the complex networking security system address space, realizes the interconnection between the external network system and the multi-source heterogeneous data management platform, and realizes the intercommunication between the external network data source system data and the multi-source heterogeneous data management platform through the transmission mechanism. At the same time, the data demand instruction information issued by the multi-source heterogeneous data management platform and the information interaction instruction information during the data transmission process also complete the interconnection and interoperability of internal and external network information through the access gateway.

[0014] Preferably, the processing unit uses DOC / Tiff / JPEG data formats in the process of processing file data, and supports protection mechanisms such as breakpoint resumption in the design of transmission and exchange services; for real-time data, a private bit / character coded data format is used, which mainly includes the point tracks, tracks and platform and sensor telemetry data of air and surface targets, and has the outstanding characteristics of small capacity and high frequency. Because the transmission needs to be processed in time, the requirement for reliability is relatively low, so the transmission requires real-time performance and efficiency is prioritized. For near real-time data, a private bit / character coded data format is used, which mainly includes remote control commands, network messages and any For instant short data messages with certain reliability requirements, such as business phrases, the number of retransmissions and intervals need to be automatically set according to business needs to meet the transmission characteristics of various narrowband communication links such as satellites, radio stations and data links; for streaming media data, the data adopts the standard video format of H.264 / H.265, mainly including media data such as video and sound. During the transmission process, key performance such as delay, jitter and bit error rate must be strictly controlled to meet people's audio-visual sensory requirements. However, due to the large capacity of high-definition video streams and the limited bandwidth resources, certain compression must be performed, and the decompressed data needs to be optimized to ensure that the data meets the standards.

[0015] Preferably, if the match is unsuccessful in step S4, an authority error is displayed to the data acquirer, prompting the data acquirer to resend the digital signature, as the digital signature cannot obtain the data authority.

[0016] A multi-source heterogeneous data cross-system collaborative processing system, which also includes data providers and data acquirers. Several of the data providers have different sources. The data providers are mainly used to provide data content with different structures. The data providers and the data acquirers are communicated with each other via a multi-source heterogeneous data processing system, which includes a calling unit, a processing unit and a display unit.

[0017] Preferably, the calling unit generates a set of data codes according to the data structure, and the set of data codes includes a coding suffix of a data security level identifier, multiple decryption characters, and a data coding prefix for identifying the data type, and the coding suffix not only carries the data security level, but also encrypts the data, and the data acquirer obtains the decryption characters corresponding to its own permissions in advance according to its own data viewing permissions, and the decryption characters are integrated with the digital signature of the data acquirer, and the digital signature of the data acquirer includes its own identity information, data content information to be acquired, and the corresponding decryption characters.

[0018] Preferably, the processing unit is mainly used to adopt different ferrying mechanisms for different data forms, and its processing process mainly involves data reception, content security processing, data copying, format conversion, data encryption and data transmission.

[0019] Preferably, the display unit is mainly used to display the data content required by the data acquirer. After the processing unit completes the processing of the data, the display unit directly selects the corresponding expression method according to the data structure coding prefix to display the data.

[0020] Compared with the prior art, the present invention has the following beneficial effects:

[0021] In the present invention, data security levels are divided in each batch of data according to the data source and the relevant security regulations of the data source, and the level division identifier is used as the coding suffix and attached to the data coding back end, and the data level division identifier performs asynchronous encryption processing on the data, and generates a set of decryption characters at the same time; then the data structure of data in different data forms is identified, and the data structure identifier is used as the coding prefix and attached to the data coding front end, so as to complete the unified planning and unified allocation of data. Secondly, in the constructed multi-source heterogeneous data processing system, the calling unit generates a set of data codes according to the data structure, and a set of data codes includes a coding suffix of a data security level identifier and multiple decryption characters. The coding suffix not only carries the data security level, but also The data is encrypted, and the data acquirer obtains the decryption character corresponding to its own authority in advance according to its own data viewing authority. The decryption character is merged with the digital signature of the data acquirer, and the data acquirer sends a request for obtaining data to the calling unit, that is, sends a digital signature, and the data calling unit verifies the authority, and then calls the data by the calling unit. The data after the call passes through the processing unit, which adopts different ferry mechanisms for different data forms. The processing process mainly involves data reception, content security processing, data copying, format conversion, data encryption and data transmission. Finally, the display unit performs corresponding display according to the data structure identifier, which improves the efficiency of data coordinated planning and transmission, ensures that the error rate of data coordinated calling is small, data display is more accurate, and data transmission and display are safer.

[0022] In the present invention, a processing unit is set up. The processing unit uses DOC / Tiff / JPEG data formats for file data, and supports protection mechanisms such as breakpoint resumption in transmission and exchange service design; for real-time data, a private bit / character coded data format is used, which mainly includes the point tracks, tracks and platform and sensor telemetry data of air and surface targets, and has the outstanding characteristics of small capacity and high frequency. Because the transmission needs to be processed in time, the requirement for reliability is relatively low, so the transmission requires real-time performance and efficiency is prioritized; for near real-time data, a private bit / character coded data format is used, which mainly includes remote control commands, network messages and For instant short data messages with certain reliability requirements, such as mission phrases, the number of retransmissions and intervals need to be automatically set according to business needs to meet the transmission characteristics of various narrowband communication links such as satellites, radio stations and data links; for streaming media data, the data adopts the standard video format of H.264 / H.265, mainly including media data such as video and sound. During the transmission process, key performance factors such as delay, jitter and bit error rate must be strictly controlled to meet people's audio-visual sensory requirements. However, due to the large capacity of high-definition video streams and the limited bandwidth resources, certain compression must be performed, and the decompressed data needs to be optimized to ensure that the data meets the standards. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a flow chart of the cross-system collaborative processing method of multi-source heterogeneous data of the present invention;

[0024] Figure 2 It is a system block diagram of the multi-source heterogeneous data cross-system collaborative processing system of the present invention. DETAILED DESCRIPTION

[0025] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further explained below in conjunction with specific implementation methods.

[0026] In the description of the present invention, it should be noted that the terms "upper", "lower", "inner", "outer", "front end", "rear end", "two ends", "one end", "the other end" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance.

[0027] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "provided with", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0028] Please refer to Figure 1-2 As shown, the present invention is a method for cross-system collaborative processing of multi-source heterogeneous data, comprising the following steps:

[0029] S1: Data security levels are divided according to the data source and in combination with the relevant security regulations of the data source, and the level division identifier is used as the encoding suffix and attached to the data encoding backend. The data level division identifier is used to asynchronously encrypt the data and generate a set of decryption characters. During the file transmission process, all file contents will be encoded and converted into binary data encoding, which will be transmitted through data encoding and displayed through decoding. This is common knowledge and will not be repeated. After the file content completes the data encoding, the binary data encoding is obtained, and the data security level division identifier is used as the encoding suffix and attached to the data encoding backend;

[0030] S2: Data structures of different data types are identified. The data structure identifier is used as a coding prefix and attached to the front end of the data coding. Different data sources have different data types and different data structures, such as remote sensing data generated by satellites, video data generated by surveillance videos, and image data obtained by snap-shot surveillance.

[0031] S3: Establish a multi-source heterogeneous data processing system, and establish a calling unit, a processing unit, and a display unit in the processing system;

[0032] S4: The data acquirer first sends a digital signature carrying its own identity information to the calling unit. The digital signature simultaneously carries the data content identifier required by the data acquirer. The calling unit compares the digital signature with the data level classification identifier and determines whether they match. If the match is successful, the data calling unit directly calls the data content;

[0033] S5: The data calling unit sends the data to the processing unit. The processing unit adopts different ferrying mechanisms for different data forms. Its processing process mainly involves data reception, content security processing, data copying, format conversion, data encryption and data transmission. Different data attributes are processed individually and differentiated. The data ferrying function is completed in the information hub of the data processing unit, and other processing processes are all performed in the access gateway.

[0034] S6: The data presentation unit displays the data according to the ferry mechanism in combination with the data structure identifier, and meets the data usage requirements of the data acquirer.

[0035] Among them, in step S1, in the process of dividing the data security level according to the data source combined with the data source regulations, the remote sensing data management system, border monitoring video system, police PGIS system and police information comprehensive application platform transmitted through dedicated lines are divided into three-level security identification, the drone data acquisition and processing system and the municipal-level integrated video information command and dispatch system are divided into two-level security identification, and the remote sensing data management system and the public network system transmitted through the Internet are divided into one-level security identification.

[0036] Among them, in step S3, the data calling module first builds a collection unit, an external network proxy service unit, an isolated communication unit and an intranet proxy service unit, and collects the collected military satellite remote sensing image data, civilian satellite remote sensing image data, drone data, border monitoring data, and ground monitoring video data into the corresponding collection unit through the external network collection interface, and then transmits the data through different networks, and sends the data to the corresponding external network proxy service unit in different categories. The external network service unit then feeds back to the isolated communication units of different levels according to the data type for differentiated isolation processing. After the isolated communication unit completes the processing, it sends the data to the intranet proxy service unit to complete the data crossing from the external network to the intranet. The intranet proxy service unit will send the isolated security data to the intranet collection The collection unit and processing unit directly call the data in the intranet collection unit, including the electromagnetic information, business information, PGIS traffic information, and Internet data collected from the WIFI probe and mobile base station subsystem in the data source system, the police information comprehensive application platform, the police PGIS system, and the Internet. Because the data is inside the public security information network, there is no need to access the gateway. For the military satellite remote sensing image data, civil satellite remote sensing image data, drone data, border monitoring data, and ground monitoring video data collected by the military-civilian exchange system, the civilian satellite data management system, the drone aviation data link, the border monitoring video system, and the prefecture-level integrated video information command and dispatch system, they are outside the public security information network and need to be accessed through the gateway to ensure the security of the data during transmission. The data transmitted to the service bus through the access gateway realizes the logical link of physical isolation through data transmission, maps these data source system addresses to the complex networking security system address space, realizes the interconnection between the external network system and the multi-source heterogeneous data management platform, and realizes the intercommunication between the external network data source system data and the multi-source heterogeneous data management platform through the transmission mechanism. At the same time, the data demand instruction information issued from the multi-source heterogeneous data management platform and the information interaction instruction information during the data transmission process also complete the interconnection of internal and external network information through the access gateway. From then on, the data is processed by multiple units in a coordinated manner and safely sent from the external network to the internal network (level 3) for further data processing. The process of interactive instruction information from the external network to the internal network during data transmission is the same, and the process from the internal network to the external network is the opposite. According to the different types of data received by the access gateway, the access gateway is divided into file data access gateway and streaming data access gateway.

[0037] Among them, the processing unit uses DOC / Tiff / JPEG data formats in the process of processing file data, and supports protection mechanisms such as breakpoint resumption in the design of transmission and exchange services; for real-time data, private bit / character encoded data formats are used, mainly including point tracks, tracks and platform and sensor telemetry data of air and surface targets, which have the outstanding characteristics of small capacity and high frequency. Because of the need to process transmission in a timely manner, the requirement for reliability is relatively low, so the transmission requires real-time performance and efficiency is prioritized. For near real-time data, private bit / character encoded data formats are used, mainly including remote control commands, network messages and task phrases, which have certain reliability. For instant short data messages with high reliability requirements, the number of retransmissions and intervals need to be automatically set according to business needs to meet the transmission characteristics of various narrowband communication links such as satellites, radio stations and data links; for streaming media data, the data adopts the standard video format of H.264 / H.265, mainly including media data such as video and sound. During the transmission process, key performance such as delay, jitter and bit error rate must be strictly controlled to meet the requirements of people's audio-visual senses. However, due to the large capacity and limited bandwidth resources of high-definition video streams, certain compression must be performed, and the decompressed data needs to be optimized to ensure that the data meets the standards. The detailed processing process of the data is shown in the following table:

[0038] Table 1 Data classification processing logic

[0039] Serial number name Main content Maximum capacity Exchange frequency Encryption Transport Protocol QoS Data Format Virus detection Ferry Mechanism Remark 1 File data Mainly large-capacity data files, the integrity and correctness of the data must be strictly guaranteed during the transmission and exchange process. Due to the large data capacity and long transmission time, abnormal situations such as network interruption or service suspension may occur in the middle. Therefore, the transmission and exchange service design must support protection mechanisms such as breakpoint resumption. 2GB 100Mbps Source encryption FTP / P2P Resume download DOC / Tiff / JPEG yes 1. Data reception; 2. Message decryption / authentication; 3. Virus detection (external); 4. Format audit; 5. Data ferrying (copying); 6. Virus detection (internal); 7. Format conversion; 8. Data encryption / signature; 9. Data transmission. 2 Real-time data It mainly includes the point tracks, tracks, platforms and telemetry data of sensors of air and surface targets. It has the outstanding characteristics of small capacity and high frequency. It needs to be processed and transmitted in a timely manner and has relatively low requirements for reliability. 16KB 50 points / s Channel encryption Real-time / data link Efficiency First Private bit / character encoding No, format check 1. Data reception; 2. Format audit; 3. Data ferrying (copying); 4. Format conversion; 5. Data transmission. 3 Near real-time data It mainly includes instant short data messages with certain reliability requirements, such as remote control commands, network messages and mission phrases. According to business needs, the system can automatically set the number of retransmissions and intervals to meet the transmission characteristics of various narrowband communication links such as satellites, radio stations and data links. 64KB 10 packs / s Source encryption Beidou short message / MQ Retransmit N times Private bit / character encoding No, format check 1. Data reception; 2. Message decryption / authentication; 3. Format audit; 4. Data ferrying (copying); 5. Format conversion; 6. Data transmission. 4 Streaming data It mainly includes media data such as video and sound. During the transmission process, key performance such as delay, jitter and bit error rate must be strictly controlled to meet people's audio-visual sensory requirements. 1080pi 30Frame / s Channel encryption UDP / Rtmp Video Optimization H.264H.265 No, format check 1. Data reception; 2. Source group audit; 3. Format audit; 4. Data ferry (copy); 5. Data transmission.

[0040] If the match fails in step S4, the data acquirer will be displayed with an authority error, prompting the data acquirer to resend the digital signature, as the digital signature cannot obtain the data authority.

[0041] The multi-source heterogeneous data cross-system collaborative processing system also includes data providers and data acquirers. The data providers come from different sources. The data providers are mainly used to provide data content with different structures. The data providers and data acquirers are communicated with each other via a multi-source heterogeneous data processing system. The multi-source heterogeneous data processing system includes a calling unit, a processing unit and a display unit.

[0042] Among them, the calling unit generates a set of data codes according to the data structure. A set of data codes includes a coding suffix of a data security level identifier and multiple decryption characters. The coding suffix not only carries the data security level, but also encrypts the data. The data acquirer obtains the decryption characters corresponding to its own permissions in advance based on its own data viewing permissions. The decryption characters are integrated with the digital signature of the data acquirer. The digital signature of the data acquirer includes its own identity information, data content information to be obtained, and the corresponding decryption characters.

[0043] Among them, the processing unit is mainly used to adopt different ferry mechanisms for different data forms, and its processing process mainly involves data reception, content security processing, data copying, format conversion, data encryption and data transmission.

[0044] The processing unit also includes registering and fusing multi-source data to generate multi-dimensional fusion information; fusing the multi-dimensional fusion information with environmental information to generate a situation, thereby providing users with environment-assisted multi-dimensional spatial situation decision-making information, integrating scene changes, and realizing action effect evaluation. The steps of multi-source data registration and fusion processing include: fusing multispectral images and panchromatic images to obtain fused image data; pre-processing the point cloud data and registering and fusing it with the fused image data to obtain fusion information, specifically including coordinate conversion of the pre-processed point cloud data and the fused image data to the same coordinate system; respectively obtaining the first three-dimensional image point after point cloud data conversion and the second three-dimensional image point after fused image data conversion; for each point in the second three-dimensional image point set, searching with the nearest point of the Euclidean distance on the first three-dimensional image point set as the corresponding relationship to obtain all paired points; and matching the paired points belonging to the first three-dimensional image point set and The points of any set in the second three-dimensional image point set are set as static points, and the other point is set as a moving point. The static points of all pairs of points constitute a static point set, and the moving points of all pairs of points constitute a moving point set; the static point set and the moving point set are roughly aligned to obtain a rough alignment transformation matrix; the moving point set is aligned using the rough alignment transformation matrix to obtain a rough alignment moving point set, and the rough alignment moving point set and the static point set are precisely aligned using an improved nearest point search method to obtain a precise alignment transformation matrix; the moving point set is aligned using the precise alignment transformation matrix to obtain a precise alignment moving point set, and the precise alignment moving point set is resampled using a grid segmentation method to obtain fusion information. The alignment speed and accuracy are improved by the static and dynamic alignment fusion method.

[0045] The display unit is mainly used to display the data content required by the data acquirer. After the processing unit completes the processing of the data, the display unit directly selects the corresponding expression method according to the data structure coding prefix to display the data.

[0046] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A method for cross-system collaborative processing of multi-source heterogeneous data, characterized by: The following steps are involved: S1: Data security levels are divided according to the data source and in combination with the relevant security regulations of the data source, and the level division identifier is used as the encoding suffix and attached to the data encoding backend. The data is asynchronously encrypted through the data level division identifier, and a set of decryption characters is generated at the same time; S2: Data structure identification is performed on data of different data types, and the data structure identifier is used as the encoding prefix and attached to the data encoding frontend; S3: Establish a multi-source heterogeneous data processing system, and establish a calling unit, a processing unit, and a display unit in the processing system; S4: The data acquirer first sends the digital signature carrying its own identity information to the calling unit. The digital signature simultaneously carries the data content identifier required by the data acquirer. The calling unit compares the digital signature with the data level classification identifier of the data provider and determines whether they match. If the match is successful, the calling unit directly calls the data content; S5: The calling unit sends the data of the data provider to the processing unit. The processing unit adopts different ferrying mechanisms for data of different data types. The processing process involves data reception, content security processing, data copying, format conversion, data encryption and data transmission; S6: The display unit displays the data according to the ferrying mechanism combined with the data structure identifier, and meets the data use requirements of the data acquirer; In step S3, the calling unit first builds a collection unit, an external network proxy service unit, an isolated communication unit and an internal network proxy service unit, and collects the collected satellite remote sensing image data, drone data, border monitoring data, and ground monitoring video data into the corresponding collection unit through the external network collection interface, and then transmits the data through different networks, and sends the data to the corresponding external network proxy service unit in different categories. The external network service unit then feeds back the data type to the isolated communication units of different levels for differentiated isolation processing. After the isolated communication unit completes the processing, it sends the data to the internal network proxy service unit to complete the data crossing from the external network to the internal network. The internal network proxy service unit will send the isolated security data to the internal network collection unit, and the processing unit directly calls the data in the internal network collection unit.

2. The cross-system collaborative processing method for multi-source heterogeneous data according to claim 1 is characterized by: In step S1, in the process of classifying the data security level based on the data source and the relevant security regulations of the data source, the remote sensing data management system, border monitoring video system, police PGIS system and police information comprehensive application platform transmitted through dedicated lines are classified as three-level security identification, the drone data acquisition and processing system and the prefecture-level integrated video information command and dispatch system are classified as two-level security identification, and the remote sensing data management system and the public network system transmitted through the Internet are classified as one-level security identification.

3. The cross-system collaborative processing method for multi-source heterogeneous data according to claim 1 is characterized by: The processing unit adopts different ferrying mechanisms for different types of data, and its processing process involves data reception, content security processing, data copying, format conversion, data encryption and data transmission. Specifically, when the processing unit processes file data in DOC / Tiff / JPEG data format with large data capacity and long transmission time, since network interruption or service suspension abnormality may occur during the transmission process, the transmission and exchange service design must support breakpoint resumption protection mechanism; for small capacity and high frequency real-time data using private bit / character encoding data format, including point tracks, tracks and platform and sensor telemetry data of air and surface targets, real-time processing and transmission are required. Ensure efficiency first; for near real-time data using private bit / character encoding data formats, including remote control commands, network messages, and mission phrases with certain reliability requirements, the number of retransmissions and intervals need to be automatically set according to business needs to meet the transmission characteristics of various narrowband communication links such as satellites, radio stations, and data links; for video and sound streaming media data using the H.264 / H.265 standard video format, the key performance of delay, jitter, and bit error rate must be strictly controlled during transmission to meet the requirements of human visual and auditory senses, but due to the large capacity of high-definition video streams and the limited bandwidth resources, compression is required, and the decompressed data needs to be optimized to ensure that the data meets the standards.

4. The cross-system collaborative processing method for multi-source heterogeneous data according to claim 1 is characterized by: If the match is unsuccessful in step S4, it will be displayed that the data acquisition party has an authority error.

5. A system for implementing the multi-source heterogeneous data cross-system collaborative processing method according to any one of claims 1 to 4, characterized in that: The multi-source heterogeneous data cross-system collaborative processing system also includes a data provider and a data acquirer. The data providers come from different sources and are used to provide different types of data content. The data providers and the data acquirers are communicatively connected via a multi-source heterogeneous data processing system, which includes a calling unit, a processing unit, and a display unit.

6. The system according to claim 5, characterized in that: The calling unit generates a set of data codes according to the data structure. The set of data codes includes a coding suffix of a data security level identifier, multiple decryption characters, and a data coding prefix for identifying the data type. The coding suffix not only carries the data security level, but also encrypts the data. The data acquirer obtains the decryption characters corresponding to its own permissions in advance based on its own data viewing permissions. The decryption characters are integrated with the digital signature of the data acquirer.

7. The system according to claim 5, characterized in that: The processing unit is used to adopt different ferrying mechanisms for different data forms, and its processing process involves data reception, content security processing, data copying, format conversion, data encryption and data transmission.

8. The system according to claim 5, characterized in that: The display unit is used to display the data content required by the data acquirer. After the processing unit completes the processing of the data, the display unit directly selects the corresponding expression method according to the data structure coding prefix to display the data.

Images