65results about How to "Improve data access performance" patented technology

A spanning storage interface facilitates the use of cloud storage services by storage clients and may perform data deduplication. The spanning storage interface may include local storage for caching data from storage clients. A disaster recovery application includes at least first and second spanning storage interfaces at first and second network locations. The second spanning storage interface is provided for at least disaster recovery operations. The second spanning storage interface includes second local storage for improving data access performance. A copy of the local cache of the first spanning storage interface is transferred to the second local storage while the first network location is operating. In the event of a disaster affecting the first network location, the second spanning storage interface can provide data access to the first network location's data with improved performance from using the copy of local cache in the second local storage.

Aspects for achieving efficient data access to data elements in a relational database management system are provided. In a computer-implemented method aspect, the efficient data access occurs by establishing a hash table for data elements of a database in a predetermined continuous space of allocated storage, and optimizing utilization of the hash table during database query operations through linear hashing, wherein extension of the hash table occurs automatically to increase a number of pages in the hash table without discernible interruptions of data access to the data elements.

The invention provides a processing method and a system of data access. The method comprises the following steps: accessed times of data are counted; whether the accessed times in scheduled time exceed the preset reference value or not is judged, if the times exceed the preset value, the data are identified to hot spot data; the hot spot data are obtained from a data server and cached; whether the data requiring to access are the hot spot data or not is judged, if the data are the hot spot data, the hot spot data are obtained from the caching, and if the data are not the hot spot data, the data requiring to access in the data server are obtained. The processing method and the system of the data access can reduce the pressure of the data server, and therefore capacity of data access is improved.

This invention relates to technology field of cloud storage and especially relates to a cloud storage data access method. The method comprises: a step of data storing and a step of data retrieving. The data storing step comprises: converting a file to be stored into a group of data blocks to form a physical part of the file, saving a logical part of the file, which is formed by information of restoring the physical part back to original file; distributing the physical part to multiple cloud storage data centers for storage; and saving storing location information of the data blocks of the physical part in the cloud storage data centers in the logical part; the step of data retrieving comprises: acquiring the file's logical part according to a file access request; retrieving the physical part of the file from at least one of the cloud storage data centers according to the logical part information and restoring the physical part to the original file according to the logical part information. This invention also provides a cloud storage data access apparatus and system. This invention improves cloud storage data access performance, facilitates storage space saving, increases data transmission bandwidth, and strengthens data security.

An apparatus, system, and method are presented for utilizing tape storage media segmentation to improve data access performance. A segmented tape storage medium within a tape cartridge having a first and second segment is utilized. A selection module allows a user to select a user-defined capacity of the tape storage medium that is less than the usable capacity of the tape storage medium. The user-defined capacity allows the user to prefer improved data access over tape storage capacity. Data, when written to the tape, is written only within the user-defined capacity. Data may be written exclusively on the first segment or written on both the first segment and second segment allowing data access to be improved. In addition, the user-defined capacity may correspond to the full capacity of the tape storage media.

The invention discloses a converting method from an open EHR Template to a relation database. The converting method includes the steps: analyzing an open EHR prototype, and building a prototype object model; restraining the prototype object model, and building a template object model; generating an entity object meeting JPA standards; mapping the entity object into a specific database table; analyzing an inputted AQL (acceptable quality level) statement to generate an operating statement of the database table; running the database table, and operating the AQL statement to obtain corresponding data operation results; generating a new data result dADL file, and returning the dADL file to a calling party. According to the method, storage data corresponding to the database table are constructed through the open HER template, data of each open HER template example are stored into the corresponding database table, the data are dispersedly stored and can be accessed according to specific database table, data access performance is improved, and the requirements of actual medical businesses can be met.

The invention discloses a video data storage format, a video data storage method and a video data search method. The storage format is that: a logical volume in a memory is divided into two types, namely an equipment head and a plurality of pages, wherein the equipment head stores related information of the pages; the related information comprises a current page field and a current offset field into which video data is written; each page is divided into two parts, namely a page head and at least one data block, wherein the page head comprises a start time field when the video data is stored into the page; and each data block is divided into two parts, namely a block head and a real video data storage area, wherein the block head comprises a data block size field and a time offset field opposite to the page head. Received video data is directly stored into a raw device based on the storage method disclosed by the storage format, disk fragmentation can be reduced, and search efficiency can be improved. In addition, the video data takes data blocks as units, is stored in the pages of each logical volume, is convenient to manage and has high data access performance.

The embodiment of the invention discloses a file storage processing method and system. The method comprises the following steps: obtaining a content association degree between a target file and a hot file and the file access time and the file access frequency of the target file in a hybrid cloud storage system, calculating the hot weight of the target file, storing the target file of which the hot weight meets a local storage condition into a user terminal locality, and uploading the target file of which the hot weight does not meet the local storage condition to a cloud storage system. By use of the embodiment of the invention, on the basis of the full consideration of relevance among files, the hierarchical management of the files is realized; when a user reads one file, the user can directly read other files which have high relevance to the file from the user terminal locality instead of downloading the other files from the cloud, user experience is improved, and data access performance in the hybrid cloud storage system is improved.

The invention discloses a storage method of mass filling stream data, aiming at solving the storage of mass filing stream data and improving the management scale, access performance and reliability of the filling stream data according to the characteristics of filling stream data. The technical scheme is as follows: firstly building a loading pool which stores the filing stream data generated at high speed in real time and a filing pool which stores larger-scale filing data transferred from the loading pool; periodically generating read-only database file MiniRDB and storing MiniRDB into the filing pool; and when nodes of a plurality of filing databases in the filing pool are in fault, adopting a parallel distributed recovery method for recovering. Compared with the prior art, by adopting the invention, the scale of data capable of being stored and managed is larger, the storage and enquiry performances of data are higher, and the reliability of data is higher.

In an information processsing unit with key controlled protection, since it takes a long time to fetch a storage key from key storage, an instruction and computation unit of a CPU receives data from a memory control unit of the CPU before a key is received, and then the transferred storage key is checked.

The invention discloses a metadata management method, system and a medium. All directories and files in a file system are organized by adopting a tree structure, and all the directories and sub-filesunder a single directory are used as a whole and are sequentially stored in a continuous address space of bottom-layer storage equipment according to a creation sequence. When the metadata is updated,updating operations of all the subdirectories / subfiles in one directory are added to the tail of the directory in sequence in a log form, so that only one IO request is initiated in each metadata operation. When metadata retrieval is carried out, a sub-catalog is analyzed under a parent catalog, all data on a continuous address space corresponding to the parent catalog are firstly read, and thenmultiple acceleration methods are adopted for searching and matching. According to the method, the large directory problem can be effectively solved, directory path analysis has lower delay, the IO request number in the metadata access process can be reduced, and metadata access of a file system can be accelerated.

An apparatus, system, and method are presented for scaling storage media to improve data access performance. A scaling module is provided and configured to receive a dataset, identify storage characteristics of the dataset, make a determination based upon user-defined storage criteria, and select a storage instruction. In one embodiment, the storage instruction is configured to scale the storage medium to a predefined capacity. The predefined capacity of the storage medium is configured to optimize data access performance. Alternatively, the storage instruction is configured to not scale the storage medium. Additionally, the present invention may be configured to map and track the storage medium while the dataset is being written to or read from the storage medium.

The invention provides an access control method for data sources. According to the invention, via an elimination mechanism implemented through cooperation of a temporary cache layer, a prereading cache layer and a write-back cache layer in a stack cache architecture, data accessed repeatedly and continuously by a data source reading-writing access initiator can be responded to quickly. For the condition of different-place deployment of a data source reading-writing access initiator and a data source layer, cache resources in a stack storage architecture can be wholly or partially arranged in a local storage medium of the data source reading-writing access initiator, so that data repeatedly and continuously accessed by the data source reading-writing access initiator can be retained in local cache resources and thus original slower remote access for the data source layer can be converted to faster local access for the cache resources. Therefore, data access properties of a data source reading-reading access initiator are improved.

The invention discloses a data reading / writing method and system. The method comprises the steps of writing to-be-stored data in a master database when a data writing request is received; writing data stored in the master database into corresponding slave databases according to a predetermined rule; and determining slave database identifiers stored in to-be-read data when a data reading request is received, and reading the data from the corresponding slave databases according to the slave database identifiers. According to the method and the system provided by embodiments, the data is all written in the master database, the master database writes the data in different slave databases, and the slave databases only make a response to the data reading request, so that data reading and writing are separated and data access performance is improved; and a database system is isolated from a business system through a unified data platform, so that underlying data maintenance and expansion do not influence normal operation of the business system. The invention furthermore discloses the database system, which also can achieve the abovementioned technical effects.

Data transfer between storage apparatuses is reduced, and performance of data access of a storage system is improved. In a case where a processor of a first storage apparatus receives a write request from a host computer as a request for data access to a virtual volume and a cache memory of any of the storage apparatuses is not allocated to a virtual storage area in the virtual volume designated by the data access request, the processor of the first storage apparatus selects a second storage apparatus and a third storage apparatus among candidates satisfying a predetermined state condition among the storage apparatuses based on connection information indicating connection between the storage apparatuses through a communication line.

The invention discloses an electric power system safety and stability analysis data storage system and storage method. The storage system comprises a data storage module, a storage management module and a data reading service module, and the data storage module comprises a plurality of storage units and is used for storing electric power system safety and stability analysis data in a classified manner; The storage management module is used for carrying out optimal scheduling on data of a storage unit in the data storage module according to the access frequency of the power system security andstability analysis data; The storage unit is also used for obtaining the data access request sent by the data reading service module and pointing to the data storage module; And the data reading service module is used for receiving a data access request and obtaining request data from a storage unit of the data storage module. Efficient storage of power system safety and stability assessment analysis data is achieved, and the technical problem that power system safety and stability assessment analysis data access cannot meet application requirements is solved.

A method for enhancing performance of data access between a personal computer and a USB Mass Storage is provided. The personal computer is equipped with a plurality of layers of drivers regarding USB data access, and a lower layer of the layers of the drivers includes a USB Bus Driver. The method includes: monitoring commands sent from an operating system (OS) file system to an upper layer; and when a command sent from the OS file system to the upper layer is utilized for accessing data of a data amount that is greater than a predetermined threshold value, omitting a portion of a plurality of IRPs, automatically generating a plurality of replies for replying to the omitted IRPs, and altering at least one IRP of remaining IRPs in order to correctly access the data with a lower IRP count, wherein the plurality of IRPs is associated with the command.

A method is presented for utilizing tape storage media segmentation to improve data access performance. A segmented tape storage medium within a tape cartridge having a first and second segment is utilized. A selection module allows a user to select a user-defined capacity of the tape storage medium that is less than the usable capacity of the tape storage medium. The user-defined capacity allows the user to prefer improved data access over tape storage capacity. Data, when written to the tape, is written only within the user-defined capacity. Data may be written exclusively on the first segment or written on both the first segment and second segment allowing data access to be improved. In addition, the user-defined capacity may correspond to the full capacity of the tape storage media.

A method for detecting logical addresses of a nonvolatile storage medium is proposed, which defines the nonvolatile storage medium into several zones each comprising a plurality of blocks. Only an address mapping table of the first zone or a commonly used zone is built and stored in a RAM so that the system can quickly obtain logical addresses in the nonvolatile storage medium. Therefore, the effects of quick access speed and no occupied memory space can be accomplished. Moreover, the cost can be effectively lowered, and the performance of data access of the system can be enhanced.

The invention discloses a DFS-oriented client persistent caching method and system in a global namespace, and belongs to the field of large-scale distributed systems, and the method comprises the steps that a metadata server maintains a view of a global directory tree, all clients share the view, and all the clients can access any file through the view; the client identifies a file needing to be prefetched according to the cache prefetching rule, and migrates the file from the object storage server to the local for persistent caching; when the data volume of the local cache of the client exceeds a cache threshold, the data locally cached by the client is replaced; when the client performs file operation, if the to-be-operated file is cached to the local of the client and the client has thecorresponding operation authority, the locally cached file is directly accessed and the operation is finished; otherwise, the file is remotely accessed in the object storage server through the network and the operation is finished. According to the invention, the data management of the distributed file system can be simplified, and the network resource overhead is reduced.

The invention discloses a local caching method and device based on a lease lock mechanism. The method comprises the steps of when a storage system receives a data access request sent by a client, determining a priority of the client; sending lease authority to the client according to the priority of the client; and sending target data to the client for caching, thereby enabling the client to operate the cached target data according to the lease authority. Through the lease lock mechanism, the client can cache data in the storage system to the local client, so data exchange processes between the client and a server in which the storage system is located are reduced, read operations for files and the operations for a path list are reduced, paths are shortened, the delay is reduced, and the data access capability of the storage system is improved.

The invention discloses a data processing system based on a human resource management system. The system comprises a data processing platform, a data processing system and a task scheduling server, wherein the data end of the data processing platform is respectively connected with a data application server and a database, the data end of the database is connected to a cloud server through a wireless network, the input end of the data processing platform is connected to the data processing system, the data processing system is internally provided with a data fusion module, the input end of thedata processing system and task scheduling server are connected, the signal end of the task scheduling server is connected to a task running host through a task feedback bus, the data processing platform solves the problem of data collection and storage, a distributed message queue log collecting system is proposed, and the data processing system can accept multiple data, and supports both bulk and real-time strategies to import the data into a distributed file system for storage.

The invention provides a database access control method. The method comprises the steps of receiving a data access request of a business end; if the data access request meets a cache query rule, processing the data access request in a distributed cache system; and if the data access request does not meet the cache query rule, processing the data access request in a MySQL database, wherein data inthe MySQL database is synchronous with data in the distributed cache system.

Data transfer between storage apparatuses is reduced, and performance of data access of a storage system is improved. In a case where a processor of a first storage apparatus receives a write request from a host computer as a request for data access to a virtual volume and a cache memory of any of the storage apparatuses is not allocated to a virtual storage area in the virtual volume designated by the data access request, the processor of the first storage apparatus selects a second storage apparatus and a third storage apparatus among candidates satisfying a predetermined state condition among the storage apparatuses based on connection information indicating connection between the storage apparatuses through a communication line.

An apparatus, system, and method are presented for scaling storage media to improve data access performance. A scaling module is provided and configured to receive a dataset, identify storage characteristics of the dataset, make a determination based upon user-defined storage criteria, and select a storage instruction. In one embodiment, the storage instruction is configured to scale the storage medium to a predefined capacity. The predefined capacity of the storage medium is configured to optimize data access performance. Alternatively, the storage instruction is configured to not scale the storage medium. Additionally, the present invention may be configured to map and track the storage medium while the dataset is being written to or read from the storage medium.

The invention relates to a data access method and device and a data storage method and device. The data access method comprises the following steps: when a data reading request is received, analyzingthe data reading request to obtain a query condition; when the query condition conforms to a preset high-frequency access condition, querying data conforming to the query condition in a non-relationaldatabase; when the query condition conforms to a preset complex access condition, querying data conforming to the query condition in a relational database, wherein the data stored in the non-relational database is consistent with the data stored in the relational database; and responding to the data reading request based on the queried data. By adopting the method, the high-frequency access requirement can be met, and the complex query requirement can also be met.

The invention discloses a remote monitoring system of a gas pipeline. According to the technical scheme, the remote monitoring system of the gas pipeline is characterized by comprising a plurality ofremote terminal stations and a dispatching center, wherein the remote terminal stations are distributed at a pipe network or a site and are used for collecting related data, computing gas flow and sending the collected data and gas flow to the dispatching center through a communication system; and the dispatching center is used for receiving the collected data and gas flow from the remote terminalstations and processing and displaying the collected data and gas flow. The remote monitoring system of the gas pipeline has the advantage that the gas flow of a user can be detected in real time andstatistics is made.

A memory control method for a rewritable non-volatile memory module is provided according to an exemplary embodiment of the disclosure. The method includes: reading a first physical unit based on a first read voltage level to obtain first data; reading the first physical unit based on a second read voltage level to obtain second data; reading the first physical unit based on a third read voltage level to obtain third data; obtaining a first reference value which reflects a data variation status between the first data and the second data; obtaining a second reference value which reflects a data variation status between the first data and the third data; reading the first physical unit based on a fourth read voltage level to obtain fourth data according to the first reference value and the second reference value; and decoding the fourth data by a decoding circuit.

Embodiments of the present disclosure relate to methods and apparatuses for data copy avoidance where after a data access request is received from the first storage node, what is sent by a second storage node to the first storage node is not an address of a second storage space in a second mirrored cache, but an address of a first storage space in a first cache corresponding to the second storage space. In this way, data access may be implemented directly in the first cache on the first storage node, and can reduce data communication across different storage nodes, eliminate potential system performance bottlenecks, and enhance data access performance.

The invention aims to provide a caching method and device for a distributed storage system, and the method comprises the steps: reading a to-be-read file from a caching device if the corresponding to-be-read file is stored in the caching device, and adjusting an LRU index heap; and if there is no corresponding to-be-read file in the cache device, reading the to-be-read file from the underlying storage system based on the guidance of the to-be-read file in the request, storing the to-be-read file in the cache device, and respectively adjusting the LRU index heap and the LFU index heap. According to the invention, the data structure of the LRU and LFU index heap is adopted; due to the fact that the index heap is a complete binary tree, for operations such as element adding, element deletingand list reconstructing, the time complexity is the O(logn) level, through the LRU index heap and the LFU index heap, the operation efficiency is improved, the hit rate of cache equipment can be increased, and therefore the data access performance is improved.