Data storage method and device, equipment and storage medium

A technology of data storage and storage media, which is applied in the computer field, can solve problems such as different designs, and achieve the effects of reducing storage complexity, simplifying data storage steps, and facilitating unified storage

Pending Publication Date: 2021-03-19
BEIJING GRIDSUM TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a data storage method, device, equipment and storage medium to solve the pro

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, equipment and storage medium
  • Data storage method and device, equipment and storage medium
  • Data storage method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0023] In order to make the objects, technical solutions, and advantages of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0024] According to an embodiment of the present invention, a data storage method is provided. This embodiment can be performed on the platform layer, i.e., executed in the data reception and the storage end. Such as figure 1 As shown, a flow chart of a data storage method according to an embodiment of the present invention.

[0025] Step S110 collects data from the target data source.

[0026] The target data source refers to the data source that needs to collect data. In other words, the target data source is the source platform of data. Further, the target data source refers to the upstream data. For example: Weibo data source, WeChat data source, question and answer data source, etc. The embodiment of the present invention does not limit the spe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method and device, equipment and a storage medium. The method comprises the steps of collecting data from a target data source; determining a field type mapped by the field information according to the field information in the data; and storing the data into a storage space corresponding to the field type in a database table corresponding to the target data source. By setting different field types for the storage space of the database table, a unified storage structure is provided for the data sources with different data structures, the situation that different data storage structures are set for the data sources with different data structures is avoided, the storage complexity of different target data sources is reduced. The data storage steps are simplified, the data storage efficiency is improved, the target data sources of different data structures can reuse the storage logic, and unified storage of the data of the target data sources of different data structures is facilitated.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data storage method, device, equipment and storage medium. Background technique [0002] In the prior art, the collection and storage of massive data is a project with a huge workload. From the perspective of performance and stability, the collection and storage of massive data needs to be processed in a streaming manner. At present, different data sources use different data structures, such as WeChat data sources, Weibo data sources, Q&A data sources, etc., and each data source follows its own data structure. This leads to the need to design a matching data structure for each data source when designing the underlying storage in order to store data from the data source, that is to say, it is necessary to provide customized data structures for different data sources . [0003] To sum up, since different data sources correspond to different data structures, the effici...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22
CPCG06F16/2282
Inventor 林志强
Owner BEIJING GRIDSUM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products