Data storage method and device, computer equipment and storage medium

A data storage and data storage technology, applied in the field of data processing, can solve the problems of heterogeneous data storage that cannot be stored from different sources, unfavorable integration of discrete data, etc., and achieve the effect of integration

Pending Publication Date: 2021-12-31
GUANGDONG POWER GRID CO LTD +2
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The data storage method in the existing technology cannot store heterogeneous data from differe

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, computer equipment and storage medium
  • Data storage method and device, computer equipment and storage medium
  • Data storage method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0022] Example one

[0023] figure 1 Is a flowchart of a method of storing data according to a first embodiment of the present invention, embodiments of the present embodiment is applicable to a case of extracting the data from different sources and storage, the method may be performed by the data storage device, the device may be by software and / or hardware, and integrated in a general computer device.

[0024] like figure 1 As shown, the technical solution of the embodiments of the present invention includes the following steps:

[0025] S110, obtaining the source data through a data source connector, and the source data format conversion by the data converter.

[0026] Wherein the data source connector different data sources, optionally, the data source connector, for connection to the data source through the data source matches the data source connector plug; said data source comprises a structured data source, and / or unstructured data sources. The source data needs to be...

Example Embodiment

[0035] Example 2

[0036] Figure 2A Is a flowchart of a method of storing data according to a second embodiment of the present invention, the embodiment of the present invention based on the above-described embodiment, the source data format conversion process, the process of generating an index file of the source data, and stores the index process file are further specified and added to the process data in the database MapReduce process, and the process of reading data.

[0037] Corresponding, such as Figure 2A As shown, the technical solution of the embodiments of the present invention includes the following steps:

[0038] S210, obtaining the source data from the data source connector.

[0039] In an embodiment of the present invention deploying a data source and the data converter is connected in a docker container. docker container is an open source application container engine that allows developers to package applications in a uniform manner and dependencies into a portabl...

Example Embodiment

[0082] Example three

[0083] image 3 Is a schematic structural diagram of a data storage device according to embodiment III of the present invention, the apparatus comprises a source data format conversion module 310, source module 320, and data storage module 330 stores the index file, wherein:

[0084] The source data format conversion module 310, configured to obtain the source data through a data source connector, and the source data format conversion by the data converter; wherein said data source connector connected to at least two pre-established data source;

[0085] Source data storage module 320, if the source data for the data storage format conversion condition determining compliance, the save source data format to the database through the data memory;

[0086] Index file storing module 330, configured to generate the source data indexed by the index file generation unit, and by means to store the index cache index file to the index storage unit.

[0087]The technica...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring source data through a data source connector, and performing format conversion on the source data through a data converter, wherein the data source connector establishes connection with at least two data sources in advance; if it is determined that the source data after format conversion meets the data storage condition, storing the source data after format conversion in a database through a data storage device; and generating an index file of the source data through an index generation unit, and storing the index file into an index storage unit through an index cache unit. By means of the technical scheme, heterogeneous data from different sources can be stored, and therefore integration of discrete data is achieved.

Description

technical field [0001] Embodiments of the present invention relate to data processing technologies, and in particular, to a data storage method, device, computer equipment, and storage medium. Background technique [0002] With the development of power grid management informatization and the passage of time, power supply enterprises have accumulated a large amount of special data. In order to provide decision-making reference support for subsequent risk prediction and energy management construction, it is necessary to coordinate and integrate these scattered data. [0003] Data storage in the prior art is to establish a mapping relationship between a source system and a data storage unit, and import source data in the source system into the data storage unit for storage. The data storage method in the prior art cannot store heterogeneous data from different sources, which is not conducive to the integration of discrete data in power grid management. Contents of the inventi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/25G06Q50/06
CPCG06F16/22G06F16/252G06F16/258G06Q50/06
Inventor 李海东杨月吴信时光俊红杨晶晶阮国恒江嘉铭戴争干余恒奇
Owner GUANGDONG POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap