Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system

A technology for sharing files and reading files, which is applied in transmission systems, electrical components, and special data processing applications. Guaranteed continuity of effect

Inactive Publication Date: 2012-07-04
BEIJING DAYANG TECH DEV
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this common SAN shared file system has the characteristics of high efficiency and wide applicability, the metadata server is the bottleneck and single point of failure. Once there is a problem with the metadata server, the entire SAN network will be paralyzed and unable to work; , if there is a problem in the LAN network and the client cannot communicate with the metadata server, it will also cause the paralysis of the SAN network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system
  • Method for realizing off-line reading files in SAN (Storage Area Networking) shared file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] This embodiment is a method for realizing offline file reading in a SAN shared file system. The hardware system used by the method, such as figure 1 shown. The thick solid line in the figure indicates the SAN network, and the thin solid line indicates the LAN network. This embodiment includes: multiple clients are connected to the metadata server and the disk array through the SAN network for transmitting video files, and the multiple clients are connected to the metadata server through the LAN network for transmitting metadata. The client can be an ordinary PC workstation or a server, which has the ability to connect to a SAN network and can process large files, such as high-definition video files. The SAN network described in this embodiment is an optical fiber network made up of optical fiber switches and optical cables. It is a broadband network with a bandwidth exceeding 1G. It can transmit high-definition video files, and can also use 1000M or 10,000M high-speed...

Embodiment 2

[0046] This embodiment is an improvement of Embodiment 1, and it is a refinement of the steps of reading files in Embodiment 1, such as image 3 shown. This embodiment is performed under the condition that metadata is stored in the client's local memory or hard disk. Although the metadata is stored in the local memory or the hard disk, this embodiment still obtains the metadata in the traditional way, and the locally stored metadata is only used when the communication between the client and the metadata server is not smooth. The sub-steps in the step of reading the file described in this embodiment are as follows:

[0047] 1a. The sub-step of obtaining the metadata segment from the metadata server: it is used for the client to obtain the metadata segment from the metadata server, and if it is successful, enter "initiate a block data request for the file to be read to the disk array to complete the metadata Read the block data corresponding to the segment, read the metadata s...

Embodiment 3

[0054] This embodiment is an improvement of Embodiment 1, and it is a refinement of the steps of reading files in Embodiment 1, such as Figure 4 shown. This embodiment is performed under the condition that metadata is stored in the client's local memory or hard disk. Because the metadata has been stored locally, the local metadata can be used directly. If obtaining metadata locally fails, obtain metadata from the metadata server. The sub-steps in the step of reading the file described in this embodiment are as follows:

[0055] 1b. The sub-step of obtaining the metadata segment from the local memory or the hard disk: it is used for the client to obtain the metadata segment from the local memory or the hard disk. Complete the reading of the block data corresponding to the metadata segment, read the metadata segment and read the block data corresponding to the metadata segment, until the entire file to be read is completed, and if it fails, enter the next step.

[0056] Thi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method for realizing off-line reading files in an SAN (Storage Area Networking) shared file system. The method comprises the steps of opening a file, obtaining metadata, reading the file and ending file-reading, wherein the step of obtaining the metadata comprises a sub-step of detecting whether an original record exists, a sub-step of detecting the metadata validation, a sub-step of opening up a storage space; a sub-step of selecting and processing and a sub-step of obtaining all the metadata. In the invention, the fact that a client side also keeps a metadata backup locally is used, and the accordance and effectiveness of the metadata are guaranteed through a synchronized method, therefore, when a metadata server or an LAN (local area network) breaks down, a client server can continue to read files normally according to the local metadata backup. The method in the invention is adopted to realize the function that the client server can also continue to read SAN shared files according to the local backup metadata after the metadata server stops working.

Description

technical field [0001] The invention relates to a method for realizing off-line reading of files in a SAN shared file system, a method for reading video files in a network system, and a method for offline reading of files under the SAN shared file system applicable to the application field of radio and television. Background technique [0002] At present, the general SAN shared file system is composed of metadata server (MDS), shared storage and multi-client through LAN network and SAN network. Both metadata server and client can directly access shared storage through FC or ISCSI protocol, respectively FC-SAN and IP-SAN architecture. Due to the optical fiber transmission, the SAN network has large bandwidth, large capacity, and fast speed. It is often used to transmit files with a huge amount of data, such as video files. [0003] The metadata in the SAN shared file system is a data structure describing the data organization method. The metadata mainly records the division ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F17/30
Inventor 刘强张跃孙轶玮龙玛娜朱诗波刘昌鑫
Owner BEIJING DAYANG TECH DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products