Mixed type processing system and method oriented to industry big data diversity application

A hybrid, big data technology, applied in the field of big data, can solve problems such as low resource utilization, competition and performance interference, data redundancy, etc., to achieve the effect of ensuring ease of use

Inactive Publication Date: 2014-09-03
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF2 Cites 49 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current various big data systems are logically independent and lack unified centralized management. If they are deployed in separate clusters, there will be problems of data redundancy and low resource utilization that cannot be ignored; if resource utiliza

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mixed type processing system and method oriented to industry big data diversity application
  • Mixed type processing system and method oriented to industry big data diversity application
  • Mixed type processing system and method oriented to industry big data diversity application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0080] Hereinafter, the implementation of the present invention will be described in detail with reference to the accompanying drawings and embodiments, so as to fully understand how the present invention applies technical means to solve technical problems and achieve the realization process of technical effects and implement them accordingly. It should be noted that, if there is no conflict, the embodiments of the present invention and the mutual characteristics of the embodiments fall within the protection scope of the present invention.

[0081] In order to support the multi-source heterogeneous data storage and diversified processing requirements of the industry, embodiments of the present invention provide a data processing system oriented to big data processing, such as figure 1 As shown, the system includes:

[0082] Distributed data acquisition subsystem, hybrid distributed storage and parallel computing subsystem based on memory computing architecture, integrated resource a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mixed type processing system and method oriented to industry big data diversity application. The system comprises a distributed data collection subsystem used for collecting data from an external system, a storing and parallel calculating subsystem used for storing and calculating the collected data, and an integrated resource and system management platform used for managing the stored and calculated data. The storing and parallel calculating subsystem comprises a big data storing subsystem and a big data processing subsystem, wherein the big data processing subsystem comprises a memory calculating engine which is used for providing distributed memory abstract in a shared-nothing cluster and conducting parallel streamlined and thread lightweight processing on the collected data. The mixed type processing system and method can meet the requirements of industry big data diversity service application, the big data processing performance can be improved by ten or more times through acceleration of the memory calculating engine, and the usability, reliability and expandability of the system can be ensured through the integrated management platform.

Description

Technical field [0001] The present invention relates to the field of big data, in particular, to a hybrid processing system and a processing method for diversified applications of industry big data. Background technique [0002] With the vigorous promotion of informatization construction, the government, finance, energy and other industries have initially realized the integration, sharing and utilization of enterprise-level data sources. However, with the rapid development of sensor technology, network technology, and the digitization and networking of the entire society, human society has entered the era of big data. The number of terminals has increased sharply, the frequency of collection has increased significantly, and the amount of data has changed from TB to PB. With the development, the diversity and richness of data, the time-varying nature and the rapid growth have become increasingly prominent, making the management and utilization of traditional industry data facing t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F3/067G06F16/90
Inventor 亓开元张东刘正伟辛国茂
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap