Internet of things heterogeneous data storage method and system

A data storage system and heterogeneous data technology, applied in transmission systems, electrical components, etc., can solve problems such as increased network load, data disaster recovery difficulties, etc., and achieve the goals of improving reliability, improving reliability and access performance, and solving efficiency Effect

Active Publication Date: 2013-09-18
上海和伍物联网系统有限公司
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the network-attached storage device is directly connected to the Ethernet, there are certain problems in its security; a large amount of data storage is completed through the network, which increases the load of the network, and is not suitable for the storage of audio and video data; at the same time, the data Disaster recovery is difficult and often requires a bespoke solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of things heterogeneous data storage method and system
  • Internet of things heterogeneous data storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The technical solutions of the present invention will be further explained below in conjunction with the drawings and embodiments, but the following content is not intended to limit the protection scope of the present invention.

[0029] Such as figure 1 As shown, this embodiment provides a heterogeneous data storage system for the Internet of Things. The system is composed of five modules: an interface module, a data storage module, a capacity expansion module, a large file storage module, and a redundant storage module. The specific details of each module The implementation application is as follows:

[0030] (1) Interface module—unified analysis of data in different formats, receiving specified unified query and feedback data types, and realizing loose coupling between the data providing layer and the data access layer;

[0031] (2) Data storage module - use HBase technology to build a large-scale storage cluster, and store data in the specified column family (Colum...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Internet of things heterogeneous data storage method and a storage system. The internet of things heterogeneous data storage method comprises the steps that various types of data are stored in a column-based mode through an HBase distributed storage system, an MySQL metadatabase carries out registration management on the stored data, and finally the data access layer is configured in a centralized manner, so that applications based on the database can use the unified data interface. According to the Internet of things heterogeneous data storage method and the storage system, the unified storage mode is adopted through the unified data interface, the storage of different types of data and data from different sources is effectively supported; the column-oriented storage mechanism is extended by utilizing the HBase technology, so that the storage volume can be extended horizontally; the memory mapping file mechanism is adopted to effectively improve the storage and management efficiency of large files; and the data redundancy storage technology is adopted to greatly improve the system reliability and the accessibility. The Internet of things heterogeneous data storage method and the storage system can well solve the storage problem of various types of data, has efficient storage and utilization capability on large files, and is also low in cost and high in robustness.

Description

technical field [0001] The present invention relates to a method in the field of data storage, in particular to a method and system for storing heterogeneous data in the Internet of Things. Background technique [0002] The Internet of Things (IoT: Internet of Things) is an important part of the new generation of information technology. On today's Internet, data interaction has almost become our ultimate appeal, but the ensuing data diversity, distributed storage and loose coupling of information, and the geometric expansion of data volume have also brought data The difficulty of organization is increasing. At the same time, with the development of Ajax, RIA and service-oriented network applications, the complexity of the client data processing logic required by them continues to increase, making development more difficult. [0003] Traditional data storage technologies are based on relational databases, mainly through mathematical concepts and methods such as set algebra t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 孙琦江文王伊凡李生红陈乐生
Owner 上海和伍物联网系统有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products