Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system

A technology for sharing files and reading files, which is applied in transmission systems, electrical components, and special data processing applications. Guaranteed continuity of effect

Inactive Publication Date: 2012-07-04
BEIJING DAYANG TECH DEV
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this common SAN shared file system has the characteristics of high efficiency and wide applicability, the metadata server is the bottleneck and single point of failure. Once there is a problem with the metadata se

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0022] Example one:

[0023] This embodiment is a method for reading files offline in the SAN shared file system. The hardware system used in the method, such as figure 1 Shown. The thick solid line in the figure represents the SAN network, and the thin solid line represents the LAN network. This embodiment includes: multiple clients are connected to a metadata server and a disk array through a SAN network that transmits video files, and the multiple clients are connected to the metadata server through a LAN network that transmits metadata. The client can be an ordinary PC workstation or a server, which has the ability to connect to a SAN network and can process large files, such as high-definition video files. The SAN network described in this embodiment is an optical fiber network composed of fiber optic switches and optical cables. It is a broadband network with a bandwidth exceeding 1G. It can transmit high-definition video files. It can also form a SAN with a thousand or t...

Example Embodiment

[0045] Embodiment two:

[0046] This embodiment is an improvement of the first embodiment, and is a refinement of the first embodiment about the steps of reading files, such as image 3 Shown. This embodiment is performed when metadata is stored in the local memory or hard disk of the client. Although the metadata is stored in the local memory or the hard disk, this embodiment still acquires the metadata in a traditional way, and the locally stored metadata is only used when the communication between the client and the metadata server is not smooth. The sub-steps in the step of reading the file described in this embodiment are as follows:

[0047] 1a. The sub-step of obtaining the metadata segment from the metadata server: for the client to obtain the metadata segment from the metadata server, and if successful, enter the "initiate a block data request for the file to be read to the disk array to complete the metadata The segment corresponds to the block data reading, and the met...

Example Embodiment

[0053] Example three:

[0054] This embodiment is an improvement of the first embodiment, and is a refinement of the first embodiment about the steps of reading files, such as Figure 4 Shown. This embodiment is performed when metadata is stored in the local memory or hard disk of the client. Because the metadata is already stored locally, the local metadata can be used directly. If it fails to get the metadata from the local, then get the metadata from the metadata server. The sub-steps in the step of reading the file described in this embodiment are as follows:

[0055] 1b. The sub-step of obtaining the metadata segment from the local memory or hard disk: it is used for the client to obtain the metadata segment from the local memory or hard disk. If it succeeds, it will enter the “initiate block data request for the file to be read to the disk array, Complete the reading of the block data corresponding to the metadata segment, and read the metadata segment and the block data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for realizing off-line reading files in an SAN (Storage Area Networking) shared file system. The method comprises the steps of opening a file, obtaining metadata, reading the file and ending file-reading, wherein the step of obtaining the metadata comprises a sub-step of detecting whether an original record exists, a sub-step of detecting the metadata validation, a sub-step of opening up a storage space; a sub-step of selecting and processing and a sub-step of obtaining all the metadata. In the invention, the fact that a client side also keeps a metadata backup locally is used, and the accordance and effectiveness of the metadata are guaranteed through a synchronized method, therefore, when a metadata server or an LAN (local area network) breaks down, a client server can continue to read files normally according to the local metadata backup. The method in the invention is adopted to realize the function that the client server can also continue to read SAN shared files according to the local backup metadata after the metadata server stops working.

Description

technical field [0001] The invention relates to a method for realizing off-line reading of files in a SAN shared file system, a method for reading video files in a network system, and a method for offline reading of files under the SAN shared file system applicable to the application field of radio and television. Background technique [0002] At present, the general SAN shared file system is composed of metadata server (MDS), shared storage and multi-client through LAN network and SAN network. Both metadata server and client can directly access shared storage through FC or ISCSI protocol, respectively FC-SAN and IP-SAN architecture. Due to the optical fiber transmission, the SAN network has large bandwidth, large capacity, and fast speed. It is often used to transmit files with a huge amount of data, such as video files. [0003] The metadata in the SAN shared file system is a data structure describing the data organization method. The metadata mainly records the division ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 刘强张跃孙轶玮龙玛娜朱诗波刘昌鑫
Owner BEIJING DAYANG TECH DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products