Unlock instant, AI-driven research and patent intelligence for your innovation.

A method for supporting middleware in a transaction form to access an HDFS system and middleware

A middleware and transaction technology, applied in the direction of file system, file access structure, file system function, etc., can solve the problem that HDFS cannot provide transaction support, and achieve the effect of improving reliability and security, ensuring correctness, and simplifying recovery

Inactive Publication Date: 2019-05-24
AEROSPACE INFORMATION
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the transaction support of the middleware of the distributed file system has not been researched and implemented, and HDFS cannot provide transaction support

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for supporting middleware in a transaction form to access an HDFS system and middleware
  • A method for supporting middleware in a transaction form to access an HDFS system and middleware
  • A method for supporting middleware in a transaction form to access an HDFS system and middleware

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The specific implementation manners of the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be understood that the specific implementations described here are only used to illustrate and explain the embodiments of the present invention, and are not used to limit the embodiments of the present invention.

[0025] Transaction refers to the program execution unit that accesses and may update various data items in the database. The operations to access the HDFS system are divided into transactional and non-transactional. Transactional operations refer to if multiple file operations are performed, either all succeed or fail; non-transactional operations refer to if multiple file operations are performed, then There is no relationship between multiple file operations, independent of each other. The inventor of the present application found that none of the current middleware that supports access to the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a method for supporting middleware in a transaction form to access an HDFS system and the middleware, and belongs to the field of data access and storage. Themethod comprises the following steps: receiving an HDFS access operation; judging whether the HDFS access operation is transactional or non-transactional; and under the condition that the HDFS accessoperation process is transactional, executing the following operations: initializing a middleware object; Calling one or more of a file reading method, a file deleting method and / or a file writing interface method to perform file operation according to the HDFS access operation; judging whether the file operation is successful or not; and under the condition that the file operation is successful,submitting the object operation to the HDFS, recording an object log, otherwise, rolling back the object operation, and recording the object log. According to the technical scheme, transactional fileoperation is supported, a user can conveniently access the HDFS, and recovery of transaction faults can be simplified.

Description

Technical field [0001] The present invention relates to the field of data storage access, in particular to a method for accessing an HDFS system by middleware in the form of transactions and a middleware for accessing the HDFS system in the form of transactions. Background technique [0002] With the rapid development of Internet technology, the data circulating on the Internet has grown rapidly, reaching an unpredictable order of magnitude. Traditional relational databases cannot meet the high-efficiency storage requirements of massive data, especially when the data volume reaches the order of terabytes or even petabytes. How to store these massive amounts of data has become a major technical problem for Internet companies. The emergence of the distributed file system has effectively solved the problem of massive data storage. The GFS (Google File System) model designed and proposed by Google is recognized by the industry because of its ability to effectively solve the storage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/17G06F16/13G06F11/14
Inventor 王杰斌林文辉
Owner AEROSPACE INFORMATION