Cross-domain information system-oriented real-time on-demand data aggregation method and system

An information system and data aggregation technology, applied in the direction of structured data retrieval, electronic digital data processing, database management system, etc., can solve the problems of not being able to effectively deal with distribution, autonomous real-time and flexibility, increasing network control and information leakage , No problems such as data aggregation framework and system were raised, to achieve the effect of rapid expansion, reduction of network load pressure, and rapid component update

Pending Publication Date: 2020-11-17
SHANGHAI JIAO TONG UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such an architecture can avoid the heterogeneity problem of distributed independent systems, but it has three important defects: 1. Direct communication between software in different security domains will increase the risk of network control and information leakage; 2. It cannot effectively deal with distributed, autonomous, H

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-domain information system-oriented real-time on-demand data aggregation method and system
  • Cross-domain information system-oriented real-time on-demand data aggregation method and system
  • Cross-domain information system-oriented real-time on-demand data aggregation method and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0042] Example 1

[0043] A real-time on-demand data aggregation system oriented to cross-domain information systems according to the present invention includes: an aggregation terminal deployed in a target information system and multiple source terminals deployed in multiple source information systems;

[0044] The source includes a filter and a connector;

[0045] The converging end includes a connector, a converging device and a configurator;

[0046] The converging-end connector and the source-end connector establish a virtual local area network tunnel to communicate with each other to form an overlay network;

[0047] The aggregator collects the aggregation requirements of various applications in the destination information system for the source data, forms an aggregation rule, and distributes the aggregation rule to all source-end filters; aggregates the data satisfying the aggregation rule in the source information system;

[0048] The filter performs a filtering op...

Example Embodiment

[0068] Example 2

[0069] Embodiment 2 is a modification of embodiment 1

[0070] 1 frame structure

[0071] like figure 1 As shown, the real-time on-demand data aggregation framework proposed by the present invention consists of two parts: the sink part deployed in the destination information system and the source part deployed in the source information system, wherein the source part There can be multiple, deployed in different source information systems. Each source consists of two modules: a filter and a connector, and each sink consists of three modules: a connector, an aggregator and a configurator.

[0072] 2 module process

[0073] (1) Connector

[0074] Both the sink end and the source end contain a connector, and a virtual local area network tunnel can be established between the connectors to communicate with each other, thereby forming an overlay network. The overlay network can shield the complex LAN design of each information system at the bottom layer, an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cross-domain information system-oriented real-time on-demand data aggregation system and method. The system comprises a convergence end deployed in a target information systemand a plurality of source ends deployed in a plurality of source information systems, a convergence end connector and a source end connector establish virtual local area network tunnel mutual communication to form an overlay network; an aggregator collects aggregation requirements of various applications in a target information system for source data to form an aggregation rule, and gathers the data meeting the aggregation rule in the source information system; and a filter performs filtering operation on the data in the source information system according to the aggregation rule of the aggregator and transmits the data meeting application requirements to the aggregator in the target information system, and the aggregator provides an interface for an upper-layer application to acquire thedata. The invention provides a real-time cross-domain data aggregation framework which can dynamically customize data aggregation requirements, is millisecond-level in data transmission delay and iseasy to expand and update.

Description

technical field [0001] The present invention relates to a cross-domain distributed system, in particular, to a cross-domain information system-oriented real-time on-demand data aggregation method and system, and more specifically, to a real-time on-demand data aggregation framework and system based on a publish / subscribe model . Background technique [0002] In the current information society, each institution has its own information system. With the rapid development of current data analysis technology and the enrichment of application logic, the demand for various types of data across institutions and systems is becoming stronger and stronger. However, the business systems built by each organization are designed to meet their own business needs. The construction time is early, and the subsequent cross-agency cooperation and sharing are not considered, and the overall design is lacking. Data aggregation aims to solve the current difficulties of distribution, heterogeneity...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/2458G06F9/455
CPCG06F9/45558G06F2009/45595G06F16/2471G06F16/252
Inventor 钱诗友徐加伟薛广涛曹健
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products