Interactive modeling analysis operator data exchange method

A data exchange and interactive technology, applied in the field of interactive modeling, can solve problems such as large time consumption, bloated data files or data streams, affecting data exchange efficiency, data processing execution efficiency, etc., to improve data transmission and exchange efficiency , the effect of reducing the size

Active Publication Date: 2020-07-17
NO 15 INST OF CHINA ELECTRONICS TECH GRP
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Generally, SOA-based XML files and REST service-based data streams are used for data exchange. When there are dozens of data features and data records of tens of millions or even hundreds of millions, XML files or REST service data streams The scale reaches tens of GB, and the data files or data streams are extremely bloated. The data exchange between operators through the network will consume a lot of time, seriously affecting the efficiency of data exchange and the execution efficiency of the entire data processing process.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive modeling analysis operator data exchange method
  • Interactive modeling analysis operator data exchange method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0052] The data exchange device access configuration file of the data exchange interface component is an XML format file, which configures the network address of the data exchange device, FTP service user name, password and FTP root directory information. An example of a data exchange device access configuration file is as follows:

[0053]

[0054]

[0055]

[0056]

[0057] The data set file format adopts binary file data files stored in the order of data items, and does not contain data description information. For example, a data set contains 10 million records, the data attribute contained in each record is "T|X|Y|Z", and the corresponding data format is "S|S|D|F" (S is String data , D means Double data, F means Float data), the content format of the generated dataset file is:

[0058] SSDFSSDFSSDFSSDFSSDFSSDFSSDFSSDFSSDFSSSDF...(contains 10 million sets of binary data in SSDF format)

[0059] Compared with data files in XML format or data streams of REST servic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an interactive modeling analysis operator data exchange method. The method aims at solving the problems of huge data content and low data exchange and transmission efficiency when data exchange between operators of an interactive modeling analysis platform deals with large data volume. According to the interactive modeling analysis operator data exchange method provided bythe invention, on one hand, redundant information in exchange data is removed by designing a scheme of data configuration file and data set file as a data exchange data file medium, so that the sizeof a data exchange file is greatly reduced; on the other hand, a high-performance data exchange device based on FTP service is constructed, and centralized storage and exchange of input and output data between operators are achieved; through the method, the data transmission exchange efficiency between operators can be remarkably improved, and the method is suitable for mass data modeling analysisapplication scenes such as weapon equipment tests and big data scientific calculation.

Description

technical field [0001] The invention belongs to the technical field of interactive modeling, and in particular relates to an interactive modeling analysis operator data exchange method. Background technique [0002] With big data, machine learning research and engineering applications, building an interactive modeling and analysis platform has become an effective way to support flexible data analysis applications. In practical engineering applications, such as weapon test data processing, industrial intelligent manufacturing and other fields, data characteristics, large data scale, and data network transmission and exchange have become the main bottlenecks restricting the performance of data analysis and calculation. Generally, SOA-based XML files and REST service-based data streams are used for data exchange. When there are dozens of data features and data records of tens of millions or even hundreds of millions, XML files or REST service data streams The scale is tens of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/16G06F16/81H04L29/08
CPCG06F16/13G06F16/16G06F16/81H04L67/06
Inventor 汤国防张寒雪姚尚胡长城高瑞明闫双平闫永恒
Owner NO 15 INST OF CHINA ELECTRONICS TECH GRP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products