Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data management method and system, computer equipment and storage medium

A data management and computer program technology, applied in the field of big data, can solve the problems of data requester's wrong computing task, heavy workload, inability to query the full amount of data, etc., to avoid access failure, reduce complexity, and improve user performance. Effect

Pending Publication Date: 2022-02-01
TAIKANG LIFE INSURANCE CO LTD +1
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This article is used to solve the problem of heavy workload in the maintenance of ViewFS in the prior art. Because the access directories mounted by different storage systems are different, after data migration, the same HIVE table cannot query the full amount of data, which affects the data. The management and use of the data, which leads to the problem that the data requester calculates the wrong task

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data management method and system, computer equipment and storage medium
  • Data management method and system, computer equipment and storage medium
  • Data management method and system, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] The following will clearly and completely describe the technical solutions in the embodiments herein in conjunction with the accompanying drawings in the embodiments herein. Obviously, the described embodiments are only some of the embodiments herein, not all of them. Based on the embodiments herein, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the scope of protection herein.

[0073] It should be noted that the terms "first" and "second" in the description and claims herein and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments herein described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data management method and system, computer equipment and a storage medium, and the data management method comprises the steps: receiving and analyzing a data migration request of a data requester, and obtaining an access directory of a virtual file system and an access directory of a migrated storage system; according to the access directory of the virtual file system, newly adding the access directory of the migrated storage system to a pre-established routing configuration table, wherein the incidence relation between the access directory of the virtual file system and the access directory of each storage system is configured in the routing configuration table; and after the routing configuration table is modified, responding to the data migration request. According to the embodiment of the invention, the complexity of data management and use of the storage system can be effectively reduced, the user embodiment is improved, cross-storage system data migration of a single routing configuration table is realized, the data can be accessed in the data migration process, and the access failure is avoided.

Description

technical field [0001] This article relates to the field of big data, in particular to a data management method, system, computer equipment and storage medium. Background technique [0002] Accessing data across HDFS clusters and cloud storage can be achieved using the Hadoop ViewFS technical solution. The full name of ViewFs is View File System, which can be simply understood as a virtual logical file system. ViewFs mainly does two important things: path mapping and request forwarding. ViewFs mounts different cluster HDFS storage and cloud storage to different directories of the ViewFS file system. However, in the era of data explosion, limited by the number of HDFS files in a single cluster, there is a bottleneck in the storage space of HDFS in a single cluster. It is common to regularly delete useless data or migrate infrequently used historical data from HDFS storage to cloud storage. practice. Because the ViewFs mount directories of different storage systems are diff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/13G06F16/172G06F16/182
CPCG06F16/13G06F16/172G06F16/119G06F16/182
Inventor 兰筱明
Owner TAIKANG LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com