Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

File moving method based on data warehouse, device and storage medium

A data warehouse and file movement technology, applied in the computer field, can solve the problem that the storage performance cannot meet the needs of enterprises, and achieve the effect of reducing labor costs, reducing storage costs, and ensuring integrity

Pending Publication Date: 2020-12-22
SUZHOU LANGDONG NET TEC CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if a storage system with low price but low performance is used, its storage performance cannot meet the requirements of enterprises for daily business analysis and use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File moving method based on data warehouse, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be described in detail below in conjunction with specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, method, or functional changes made by those skilled in the art according to these embodiments are included in the protection scope of the present invention.

[0031] The storage system of the data warehouse of the present invention is divided into a hot storage area and a cold storage area. The hot storage area is an hdfs file storage system built using the isilon storage system; the cold storage area is an object storage system built using ceph. A data warehouse stores hot data in a hot storage area and cold data in a cold storage area. The definition of the hot and cold data can be defined through preset rules, which will be introduced in detail later.

[0032] The present invention provides a method for moving files based on a data warehouse. After the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a file moving method based on a data warehouse, a device and a storage medium. The method comprises the steps of: obtaining to-be-screened data information, and transmitting the data information to an executable file; enabling the executable file to traverse the data information according to a preset data movement rule to obtain to-be-moved data information; and enabling the executable file to move the to-be-moved data information from a hot storage area to a cold storage area, and modify a mapping path of the to-be-moved data information in the data warehouse to pointto the cold storage area. Compared with the prior art, the file moving method based on the data warehouse has the following advantages that: a third-party storage is used as the hot storage area, a common self-built storage system is used as the cold storage area, and then the cold and hot data is automatically stored in the corresponding areas in time, so that the storage cost is reduced, and thestorage efficiency is improved; the storage performance of an enterprise during analysis and use of daily businesses can be met.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a data warehouse-based file moving method, device and storage medium. Background technique [0002] The storage of the existing enterprise data warehouse adopts the Isilon storage system provided by the third party. The Isilon storage system has the advantages of fast speed, good performance, and high security, but the disadvantage is that the price is relatively high. With the rapid expansion of enterprise business, the total amount of data that needs to be stored increases exponentially. At this time, the cost of using the Isilon storage system provided by a third party is relatively high. However, if a storage system with low price but low performance is used, its storage performance cannot meet the requirements of enterprises for analyzing and using daily business. [0003] In this case, how to reduce the storage cost and meet the storage performance when the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/185G06F16/215G06F16/28
CPCG06F16/185G06F16/215G06F16/283
Inventor 何鑫王斌吕电福
Owner SUZHOU LANGDONG NET TEC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com