Big data access method

An access method and big data technology, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of no solution, reduce the overall performance of the file system, etc., and achieve the effect of improving retrieval efficiency

Inactive Publication Date: 2015-06-03
成都创屹远景科技有限公司
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the design of the existing distributed file system is mainly aimed at the reading and writing of large files. The storage of a large number of small files will reduce the overall performance of the file system, and cannot be well applied in systems that mainly store small files such as medical retrieval.
Therefore, for the above-mentioned problems existing in related technologies, effective solutions have not yet been proposed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data access method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The following and accompanying appendices illustrating the principles of the invention Figure 1 A detailed description of one or more embodiments of the invention is provided together. The invention is described in connection with such embodiments, but the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details.

[0020] One aspect of the present invention provides a large data access method for reading and writing small files, which provides a new solution for large data access and utilization. figure 1 is a flow chart of a big data access meth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data access method used for accessing file resources in a cloud storage platform. The big data access method comprises the following steps: combining files of which the sizes are smaller than preset sizes in a distributed file system to form a new storage file; establishing a primary index and a secondary index for the combined file; buffering the indexes before a user requests by utilizing a pre-access mechanism. According to the big data access method, the response speed of a cloud storage platform and the overall performance of the distributed file system are kept under the condition that a great number of small files are read and written.

Description

technical field [0001] The invention relates to data storage, in particular to a large data file access method. Background technique [0002] With the rapid development of smart medical care and the emergence of massive medical data, corresponding large databases are needed as carriers to store these data, but the scheduling of big data has become a big problem. The number of documents retrieved in the medical field has also increased exponentially with network resources, especially the update speed and accumulation of small files have continued to increase, which has become an urgent problem to be solved in medical cloud storage. Although distributed file systems have been widely used in the storage and analysis of large-scale data, many organizations have adopted distributed file systems to solve the problem of rapidly growing data. However, the design of the existing distributed file system is mainly aimed at reading and writing large files, and the storage of a large nu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 刘颖
Owner 成都创屹远景科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap