Data processing method and device based on distributed storage system, equipment and medium

A distributed storage and data processing technology, applied in the computer field, can solve problems such as slow speed and long data time, achieve the effect of optimizing operation efficiency, improving data processing speed, and shortening data reading cycle

Pending Publication Date: 2021-05-25
ZHEJIANG UNIVIEW TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a data processing method, device, device, and medium based on a distributed storage system, which are used to solve the problem of long time and slow speed for reading or deleting data stored in a distributed storage system, so as to improve distributed storage. System data processing performance issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device based on distributed storage system, equipment and medium
  • Data processing method and device based on distributed storage system, equipment and medium
  • Data processing method and device based on distributed storage system, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The embodiments of the present invention will be further described in detail below in conjunction with the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the embodiments of the present invention, rather than to limit the embodiments of the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the embodiments of the present invention.

[0027] The embodiments of the present invention aim at the problem of how to improve the performance of data processing in the distributed storage system in related technologies, and propose a data processing method based on the distributed storage system.

[0028] In the embodiment of the present invention, the target storage device is determined according to the target data identifier of the target data, and according to the target data identifier, the mapping relat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and a device based on a distributed storage system, equipment and a medium. The method comprises the following steps: in response to a processing request for target data, determining target storage equipment according to a target data identifier of the target data; matching the target data identifier with a mapping relationship between a data identifier in a first-class database of the target storage device and writing time, and determining the writing time of the target data; selecting a target second-class database from second-class databases of target storage equipment according to the write-in time of the target data; and reading the target data from the target second-class database, and processing the target data. According to the embodiment of the invention, the target data is quickly read from the database according to the write-in time of the data so as to process the target data, so that the data reading period is shortened, a large amount of invalid reading is avoided, the data processing speed and the performance of the distributed storage system are improved, and the operation efficiency of the database is optimized.

Description

technical field [0001] Embodiments of the present invention relate to the field of computer technology, and in particular, to a data processing method, device, device, and medium based on a distributed storage system. Background technique [0002] With the deployment of large-scale video surveillance such as safe cities, a large number of back-end storage devices are required to store the collected video data, especially picture data. The distributed storage system can provide external storage services through multiple storage devices, such as Object Storage Device (OSD for short), and has the advantages of easy expansion, no data loss in a single point of failure, and fast fault recovery. The storage system can be deployed in large quantities in the field of surveillance video. [0003] In actual use, each storage device in the distributed storage system is configured with a database, and the database is used to store metadata information of data. In related technologies,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/27
CPCG06F16/252G06F16/27Y02D10/00
Inventor 郭永强徐言林
Owner ZHEJIANG UNIVIEW TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap