Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data storage method and device, computer equipment and storage medium

A data storage and data storage technology, applied in the field of data processing, can solve the problems of heterogeneous data storage that cannot be stored from different sources, unfavorable integration of discrete data, etc., and achieve the effect of integration

Pending Publication Date: 2021-12-31
GUANGDONG POWER GRID CO LTD +2
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The data storage method in the existing technology cannot store heterogeneous data from different sources, which is not conducive to the integration of discrete data in power grid management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, computer equipment and storage medium
  • Data storage method and device, computer equipment and storage medium
  • Data storage method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] figure 1 It is a flow chart of a data storage method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of extracting and storing data from different sources. The method can be executed by a data storage device, which can be implemented by software and / or hardware, and generally integrated in computer equipment.

[0024] Such as figure 1 As shown, the technical solution of the embodiment of the present invention specifically includes the following steps:

[0025] S110. Acquire source data through a data source connector, and perform format conversion on the source data through a data converter.

[0026] Wherein, the data source connector connects to different data sources. Optionally, the data source connector connects to the data source through a data source connector plug-in that matches the data source; the data source includes a structured data source and / or unstructured data sources. The source data is the data th...

Embodiment 2

[0036] Figure 2a It is a flow chart of a data storage method provided by Embodiment 2 of the present invention. On the basis of the above embodiments, the embodiment of the present invention includes the process of converting the format of the source data, the process of generating the index file of the source data, and storing the index The process of the file has been further specified, and the process of processing the data in the database with MapReduce and the process of reading the data have been added.

[0037] Correspondingly, such as Figure 2a As shown, the technical solution of the embodiment of the present invention specifically includes the following steps:

[0038] S210. Acquire source data through a data source connector.

[0039] In the embodiment of the present invention, a data source connector and a data converter are deployed in a docker container. The docker container is an open source application container engine that allows developers to package appl...

Embodiment 3

[0083] image 3 It is a schematic structural diagram of a data storage device in Embodiment 3 of the present invention. The device includes a source data format conversion module 310, a source data storage module 320, and an index file storage module 330, wherein:

[0084] A source data format conversion module 310, configured to obtain source data through a data source connector, and perform format conversion on the source data through a data converter; wherein, the data source connector establishes connections with at least two data sources in advance;

[0085] The source data storage module 320 is used to save the source data after the format conversion into the database through the data storage if it is determined that the source data after the format conversion meets the data storage conditions;

[0086] The index file storage module 330 is configured to generate an index file of source data through the index generation unit, and store the index file into the index storag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data storage method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring source data through a data source connector, and performing format conversion on the source data through a data converter, wherein the data source connector establishes connection with at least two data sources in advance; if it is determined that the source data after format conversion meets the data storage condition, storing the source data after format conversion in a database through a data storage device; and generating an index file of the source data through an index generation unit, and storing the index file into an index storage unit through an index cache unit. By means of the technical scheme, heterogeneous data from different sources can be stored, and therefore integration of discrete data is achieved.

Description

technical field [0001] Embodiments of the present invention relate to data processing technologies, and in particular, to a data storage method, device, computer equipment, and storage medium. Background technique [0002] With the development of power grid management informatization and the passage of time, power supply enterprises have accumulated a large amount of special data. In order to provide decision-making reference support for subsequent risk prediction and energy management construction, it is necessary to coordinate and integrate these scattered data. [0003] Data storage in the prior art is to establish a mapping relationship between a source system and a data storage unit, and import source data in the source system into the data storage unit for storage. The data storage method in the prior art cannot store heterogeneous data from different sources, which is not conducive to the integration of discrete data in power grid management. Contents of the inventi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/25G06Q50/06
CPCG06F16/22G06F16/252G06F16/258G06Q50/06
Inventor 李海东杨月吴信时光俊红杨晶晶阮国恒江嘉铭戴争干余恒奇
Owner GUANGDONG POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com