9results about How to "Improve access performance" patented technology

The application discloses a kind of multi-source big data acquisition and pre-processing database construction method and system, it is related to database technical field, the present application completes multi-source heterogeneous data acquisition using edge-center two-level distributed architecture, and the security of data transmission is guaranteed by transmission encryption and integrity check mechanism, hierarchical pre-processing is carried out to data to realize heterogeneous data semantic alignment and multidimensional fusion;Distributed hybrid storage architecture is constructed, adaptive database index mechanism is set, and through multidimensional data quality evaluation, the incremental update and full-amount synchronization of database are realized.The present application can realize the unified collection of various source data, standardized processing, effectively break the data island barrier, significantly improve data processing efficiency and storage running performance, and stably guarantee the overall data quality and data consistency of database.

The application relates to the technical field of data processing, can be applied to business scenes such as financial technology and medical health, and discloses a data hierarchical storage method and device based on access representation, equipment and a medium, which comprises the following steps: collecting access behavior features of original data, identifying the heat state, writing data into a matched first target storage equipment according to a preset equipment performance corresponding relationship; after data storage, continuously monitoring subsequent access features, dynamically judging whether the heat state changes; if the heat state changes and meets specific migration conditions, a second target storage equipment is re-allocated and a data migration operation is completed, so that automatic hierarchical storage management of cold and hot data is realized. Through the acquisition of data access representation and the dynamic identification of the heat state, hierarchical migration of different heat data between different performance storage equipment is realized, the resource use efficiency and the access performance of the storage system are improved, and the storage cost is reduced.

A method for remote storage of node metadata partition, which binds independent logical acceleration pool for object storage device process based on mechanical hard disk to remotely store metadata. In the formatting stage, a globally unique identifier is generated, virtual block devices are created for database and log partition respectively, and acceleration pool is connected; continuous address space is divided into discrete storage objects according to preset object size, and a mapping relationship between logical offset and object and object internal offset is established; database label and log clipping record are written into corresponding objects of acceleration pool. When a write request is received, log entries are written into log storage objects according to the mapping, and after the memory table is flushed as a sorted string table, the database storage objects are written according to the mapping; when a read request is received, data is read from the acceleration pool according to the mapping relationship, and pre-reading cache is used for acceleration. The method can eliminate the single point failure risk of local high-speed storage medium, realize the pooling sharing and elastic expansion of storage resources, and guarantee the metadata access performance.

The application provides a data hierarchical storage evidence method, a data encoding method, a device, equipment, a medium and a product, comprising: receiving a storage evidence request submitted by a data owner, the request carrying a data digest, data fragments, a timestamp and a data signature generated based on to-be-stored data, obtaining the access heat of each data fragment, dividing the data fragments into hot data fragments and cold data fragments according to the access heat, and respectively storing the hot data fragments and the cold data fragments into high-performance storage nodes and cold data storage nodes; calculating the hash values of the data fragments, constructing a Merkle tree based on the hash values and determining the root node hash value, storing the data digest, the timestamp, the data signature and the root hash value as storage evidence metadata into a main chain; and when a fragment verification request of a data access requester is responded, performing integrity check on the data fragments based on the storage evidence metadata on the main chain. Thus, under the premise of ensuring data tamper resistance and completeness, the storage efficiency, access performance and scalability of the data are significantly improved.

The application discloses a file pre-reading cache allocation method and device based on access heat, and the method comprises the following steps: calculating the cache upper limit of each file through the access heat; judging whether the sum of the pre-reading cache usage and the preset pre-reading step length of the corresponding file is greater than the cache upper limit of the corresponding file, and adjusting the pre-reading step length; performing data pre-reading according to the pre-reading step length, judging whether the pre-reading cache reaches the cache overall capacity, marking and selecting replacement; judging whether the replaced old data block has been used, if yes, ending the operation, otherwise, updating the pre-reading step length of the file corresponding to the old data block, and ending the operation. The device comprises a statistical module, a first judging module, a second judging module, a cache allocation module, a pre-reading step length calculation module, a hit updating module and a third judging module, which are used for executing corresponding programs. The application can adapt to different load conditions, improve the hit rate and use efficiency of the cache, and further improve the access performance of the file system.

This invention provides a field-granular storage layout optimization method for incremental version management of JSON data, belonging to the field of data version management. The method includes: S1, constructing a storage graph model that supports field-granular materialization; S2, converting the version graph into a storage graph with minimized total storage overhead based on the storage graph model; S3, if the minimized total storage overhead is less than the storage space constraint, performing optimization operations on all versions at both the field and version granularity levels to generate a set of candidate change edges for optimizing the storage graph; S4, introducing user access preferences as a moderating factor to evaluate the value of all change edge sets; S5, adding the change edge sets sequentially to the storage graph in descending order of value without violating storage space constraints to update the storage graph. This invention can correctly adapt to user preferences for full version queries and historical queries for specific fields while ensuring that the total storage overhead is less than the storage space constraint.

The application relates to the technical field of application development, and discloses a smart resource and color management method, device and system for a mobile application, which comprises the following steps: performing a resource enumeration definition generation operation on a target resource file to obtain a resource attribute method definition result; performing a color definition operation according to color configuration file information to obtain a color definition result; performing resource resolution and loading access operations according to demand access loading object types and target definition information and target cache sets to obtain an object access result; and performing corresponding resource comparison and cleaning operations according to resource file list information and resource reference list information. It can be seen that the application can improve the resource and color management efficiency, flexibility, accuracy and reliability of the mobile application, avoid repeated loading and resolution of resources, significantly improve resource access performance, improve the timeliness, efficiency and accuracy of cleaning of abandoned resources, and thus improve the development and operation stability and safety of the mobile application.

The invention discloses a method and a system for improving access performance of a distributed file system. The method comprises the following steps: firstly, receiving an access request of a client to form a to-be-processed request sequence; performing access mode analysis on the sequence to obtain an access mode category and a related first access feature item, and analyzing a second access feature item containing suppression feature information and a corresponding suppression action range; determining a target access feature item belonging to the inhibition action range from the first access feature items, and adjusting the access mode category in combination with the second feature item to obtain a target access mode judgment result; and determining a file system performance optimization type according to the result, and generating, triggering and executing a corresponding resource configuration or strategy adjustment instruction. According to the method, by combining the access mode and the suppression feature optimization mode judgment, the adaptability of the optimization strategy is improved, and the access performance of the distributed file system is effectively enhanced.

The application provides a memory controller, a memory access method, a chip and a computer device, and belongs to the technical field of memory access. The memory controller is connected with a memory. The memory controller comprises a synchronization module, a plurality of pseudo channels and a merging module. The synchronization module is connected with the plurality of pseudo channels respectively, and the merging module is connected with the plurality of pseudo channels respectively. The synchronization module sends a synchronization command to one pseudo channel, sends the synchronization command to the memory through the pseudo channel, and sends a synchronization flag signal to the plurality of pseudo channels respectively. After each pseudo channel receives the synchronization flag signal, the pseudo channel generates check information based on an access command, sends the check information and the access command to the merging module. The merging module merges the check information of the plurality of pseudo channels to obtain target check information, merges the access commands of the plurality of pseudo channels to obtain a target access command, and sends the target check information and the target access command to the memory. The scheme can improve the access efficiency and overall performance of the memory subsystem.