Unlock instant, AI-driven research and patent intelligence for your innovation.

Big data distributed storage method and device, electronic equipment and storage medium

A distributed storage and big data technology, applied in the field of big data, can solve the problems of not improving overall performance, time-consuming transmission of massive data, slow output of big data, etc. effect of speed

Active Publication Date: 2020-04-24
JIANGSU MANYUN SOFTWARE TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the transmission of massive data to the big data platform is very time-consuming. If the calculation time is fast, but the data transmission is slow, the output of big data will be very slow, and the overall performance will not be improved.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data distributed storage method and device, electronic equipment and storage medium
  • Big data distributed storage method and device, electronic equipment and storage medium
  • Big data distributed storage method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0041] Furthermore, the drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be impleme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a big data distributed storage method and device, electronic equipment and a storage medium. The big data distributed storage method comprises the steps of receiving a to-be-stored data source input by a first user in a user interaction interface and a storage address of the to-be-stored data source; accessing a to-be-stored data source input by the first user by utilizing storm, consuming data of the to-be-stored data source, and writing the consumed data of the to-be-stored data source into a distributed file system of a big data cluster; and enabling the distributed file system to store the written data of the to-be-stored data source into a big data cluster according to the storage address of the to-be-stored data source. According to the method and the device provided by the invention, no cache exists in a big data storage process, so that real-time big data distributed storage is realized.

Description

technical field [0001] The present invention relates to the field of big data technology, in particular to a big data distributed storage method, device, electronic equipment, and storage medium. Background technique [0002] In recent years, with the advent of the information age, data processing capabilities related to big data are particularly important for the development of information technology. [0003] In the early days of big data, there were not many time requirements for the computing power of big data. For the calculation of massive data that cannot be solved by relational databases, as long as the calculation can be completed stably, but with the development of big data technology stack and the original With the forward iteration of technology, big data users have new requirements for data computing efficiency. [0004] At present, big data technology mainly uses distributed mode to calculate in parallel on multiple machines, which solves the problem of massiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27G06F3/0481G06F3/0486
CPCG06F16/27G06F3/04817G06F3/0486Y02D10/00
Inventor 董延峰
Owner JIANGSU MANYUN SOFTWARE TECH CO LTD