Classified analysis and grid-based storage method for marine big data

A big data and grid technology, applied in database model, relational database, electronic digital data processing and other directions, can solve the problem of lack of classification analysis, sorting, de-duplication, filling and missing preprocessing, complex marine big data packets, etc. There are no problems such as unified storage standards, and the effects of easy data visualization, realization of data visualization, and reduction of data redundancy are achieved

Inactive Publication Date: 2018-05-04
THE 724TH RES INST OF CHINA SHIPBUILDING IND
View PDF1 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Ocean big data messages are complex, and there is no unified storage standard. Most ocean observation systems store the message data returned by sensors directly locally or after analysis, without performing classification analysis, eliminating differences, deduplication, and preprocessing. It is not suitable for large-scale unified processing; a series of preprocessing such as classification and analysis is performed on the original data to f

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Classified analysis and grid-based storage method for marine big data
  • Classified analysis and grid-based storage method for marine big data
  • Classified analysis and grid-based storage method for marine big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The concrete implementation method of the present invention is:

[0014] 1. The marine environment perception objects are regarded as variables distributed in different time and space. In space, variables in different locations can be stored in the form of data grids, and in time, they can be regarded as the state changes of data grids. Corresponding observations can be obtained at any given point (x, y, h, t). Establish the grid mapping rule model of the environment object P:

[0015] P=f(x,y,h,t,id)

[0016] Among them, x and y are the latitude and longitude of the grid point, h is the altitude, and id is the identification of different ocean perception objects. The data field models of multiple environmental objects are established and the corresponding data are stored separately. The vector model and the scalar model can be selected according to the different adaptability of the objects. For example, scalar fields can be used for air pressure and sea temperature,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a classified analysis and grid-based storage method for marine big data. The classified analysis and grid-based storage method can be applied to storing and processing marinedata. The classified analysis and grid-based storage method has the advantages that data grid mapping rule models are built according to features of marine observation data, data of marine explorationelements are regarded as data grids formed in certain time and spaces, and accordingly the multi-resolution requirements of different types of data can be met; data acquired by front-end sensors areanalyzed, basic data can be obtained after preprocessing such as classified analysis, anomaly rejection, de-duplication and replenishment is carried out, and then are mapped into the data grids, and accordingly the marine big data can be represented in a grid-based manner; data of buffer areas and magnetic disks can interact with one another by the aid of high-speed cache technologies and data migration technologies, and accordingly the marine big data can be stored and can be quickly scheduled and used; the marine data further can be quickly organized and retrieved, and accordingly the marinebig data further can be visualized.

Description

technical field [0001] The invention relates to a classification analysis, data preprocessing and storage method of marine big data. Background technique [0002] With the continuous implementation and deepening of the maritime power strategy, my country's sea-related industrial economy continues to develop steadily and healthily, and there is an increasingly strong demand for the collection, storage and sharing of marine information. In particular, the re-convergence, processing and storage of existing marine data will help form a three-dimensional, continuous, real-time, multi-element integrated observation capability, and gather massive, multi-source, multi-type, multi-dimensional, and multi-resolution ocean information elements , to meet the needs of marine-related industries and professions for accessing and sharing multi-source heterogeneous marine information at different scales; on the other hand, with the continuous convergence and growth of marine data, quantitativ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215G06F16/2282G06F16/2291G06F16/284
Inventor 鲍鹏飞黄孝鹏崔威威
Owner THE 724TH RES INST OF CHINA SHIPBUILDING IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap