42results about How to "Improve access performance" patented technology

The invention relates to the technical field of big data storage, in particular to a storage control method and device based on big data. The method comprises the following steps: acquiring an original data stream and application demand information; performing data dynamic correlation analysis on the original data flow according to the application demand information to obtain a dynamic update data correlation graph; performing feature vector generation on the dynamic update data association graph to obtain a data feature vector; performing intelligent quality evaluation on the data feature vector to obtain a data quality label; performing timeliness evaluation according to the data feature vector, and performing access popularity evaluation to obtain a timeliness score and an access popularity score; and acquiring system resource load condition information. The storage resource utilization rate, the data access performance and the overall efficiency of the system are improved by solving the limitation of a traditional method in the aspects of static data management and resource allocation.

The invention provides an intelligent access method and system for small accessories of an unmanned aerial vehicle, and relates to the technical field of intelligent access. Generating an action feature vector through an action semantic understanding model; identifying key action nodes and generating a basic action sequence; constructing an action semantic mapping model; performing mapping analysis based on the execution equipment capability; generating an equipment control instruction; collecting action execution state data; establishing an execution evaluation model; generating a compensation instruction and updating the control instruction; and intelligent access operation is completed. According to the method, intelligent storage and taking of the unmanned aerial vehicle accessories are achieved, and the operation efficiency and precision are improved.

The invention relates to the technical field of data distributed storage, and discloses a distributed storage method and system for clinical test data, and the method comprises the steps: carrying out the ring signature encryption processing of the patient test data of a plurality of data centers, and obtaining a patient anonymization identifier and standardized clinical data; performing two-stage random storage node configuration to obtain an optimal storage node configuration scheme; constructing an LPPMM-DA data aggregation model based on the optimal storage node configuration scheme, and performing fragmentation processing on the patient test data to obtain a plurality of target data fragments; performing dynamic operation envelope analysis and alliance graph game calculation on the multiple target data fragments to obtain a storage resource scheduling scheme; according to the storage resource scheduling scheme and the anonymization identifier, distributed data block storage and access authentication are executed on the multiple target data fragments, data block storage distribution information is generated, a complete data access control system is constructed, and safe and reliable storage of clinical test data is ensured.

The invention relates to the technical field of data processing, and discloses a BIM model storage system and method based on lightweight data, and the system comprises a tree segment management module which is used for constructing a tree segment structure, and taking each segment as a storage unit; the segment multiplexing creating module is used for creating multiplexing segments in the tree-shaped segment structure, realizing data multiplexing in a reference mode, and creating style segments for centralized management of drawing attribute information; the parallel rendering module is used for rendering the model primitives by adopting a parallel computing method based on the geometric information and the attribute information in the multiplexing segments; the lightweight data generation module is used for organizing the BIM model data according to a tree-shaped segmentation structure and generating a binary data file; and the data compression module is used for compressing the binary data file to generate a compressed format storage file. The technical problem that efficient storage, transmission and application requirements of the BIM model are difficult to meet in the prior art is solved.

The invention relates to the field of storage, and discloses a storage array system and a storage access method, and the system comprises a plurality of link ports, a plurality of controllers, a central command scheduler, a central processor and a storage array. The link port receives operation commands sent by a plurality of hosts, and transmits the operation commands to the corresponding controllers according to the identification information of the operation commands; if the controller judges that each operation command is a first type of operation command, the controller sends each operation command to a central command scheduler; and the central command scheduler stores each operation command into a corresponding scheduling queue according to the namespace correspondingly accessed by each operation command. Uniform scheduling is achieved based on the namespaces correspondingly accessed by the commands, the command scheduling complexity can be effectively reduced, scheduling conflicts can be reduced, and then the system access efficiency and the overall performance are improved.

The present invention relates to the field of solid-state drive fault prediction, and in particular to a solid-state drive fault prediction method and system based on artificial intelligence. The method comprises the following steps: fine-grained division of the solid-state drive into storage units, and serialization of the storage units to construct a storage unit sequence for each partition; obtaining a solid-state drive operation log; performing multi-time point state evolution on the storage unit sequence for each partition based on the solid-state drive operation log, and performing deep dynamic evolution learning to generate a state evolution law for each storage unit; performing periodic access load peak calculation on the solid-state drive operation log, thereby generating a simulated access data packet for each storage unit; performing dynamic pressure access simulation based on the state evolution law of each storage unit and the simulated access data packet of each storage unit to obtain response state evaluation data for each storage unit. The present invention realizes efficient and accurate solid-state drive fault prediction.

The invention provides a container resource management method and device, electronic equipment and a medium, and relates to the technical field of cloud computing. The method comprises the following steps: scanning stock resources of each node device of a service node, and constructing a resource topology model; on the basis of the resource topology model, according to the access performance parameters among the resources in the service node, determining a cost factor of the Pod for performing cross-domain access on the resources on the service node; the optimal resource combination of the Pod in the resource topology model is determined by minimizing a target function according to the Qos type of resource allocation of the Pod on the service node, and the target function is obtained based on cost factor construction. Through the technical scheme provided by the invention, the problems of high access cost, limited performance and low refinement degree of resource allocation when Pod uses hardware resources of a service node in related technologies are solved, resource optimization allocation is performed according to different service types of Pod, the access cost of Pod node-level resource allocation is reduced, and the resource allocation efficiency is improved. And the access performance and the refinement degree are improved.

The invention provides a database all-in-one machine based on NVMe and a distributed storage architecture, and belongs to the technical field of distributed storage, the database all-in-one machine comprises a distributed file system and a data disk, and an interface of the data disk is an NVMe interface; the distributed file system has a striping function and a mirroring function; and the distributed file system is used for combining the data disks into a disk array based on the striping function and the mirroring function, and storing data files to the disk array. According to the method, RAID0 is replaced by a striping function to improve the disk access performance, RAID1 is replaced by a mirroring function to realize a disk redundancy mechanism, namely, the hard RAID is realized by the striping function and the mirroring function, and meanwhile, various requirements of users on high performance, high data security and high reliability of the system are met; and high security and high availability of database issues are ensured.

The present invention discloses an operating system protection method based on the combination of soft and hard read-only. The method realizes soft read-only control from the system level and realizes bottom-level data read-only control at the hardware level. It is compatible with GPT and MBR partitioning forms, improves system access performance, and also ensures the stability and reliability of the operating system, and also ensures the security of the operating system. At the same time, this method can greatly reduce the number of read and write times of SSD solid-state storage disks, improve the read and write performance and life of SSDs, and the invention has good application prospects in key areas such as data security.

The embodiments of the present application disclose a data access method, apparatus, device, computer storage medium and computer program product, including: determining basic information of the data to be accessed corresponding to an access request; wherein the basic information represents the storage status of the data to be accessed; based on the basic information of the data to be accessed, determining a target request group corresponding to the access request; determining a target file protocol server corresponding to the target request group from multiple file protocol servers; sending the access request to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through an access interface corresponding to the target file protocol server.

The invention relates to a database high-performance storage system for an electric power intelligent terminal, which is characterized by comprising a database function unit, a data cleaning unit based on a lightweight rule engine and an asymmetric data compression unit based on bit back coding, the database function unit comprises a data access engine and an OpenAPI interface; the data cleaning unit based on the lightweight rule engine comprises a data deduplication module, a rule configuration module, a rule loading module, a regularization verification module and a mode matching module adopting a mode matching algorithm mainly based on a regular expression. The asymmetric data compression unit based on bit-back coding introduces an asymmetric data compression technology based on bit-back coding to perform data compression on the basis of Huffman coding and arithmetic coding. According to the invention, the storage and access performance of the data is improved in an intelligent terminal environment with limited resources.

The application discloses a kind of multi-source big data acquisition and pre-processing database construction method and system, it is related to database technical field, the present application completes multi-source heterogeneous data acquisition using edge-center two-level distributed architecture, and the security of data transmission is guaranteed by transmission encryption and integrity check mechanism, hierarchical pre-processing is carried out to data to realize heterogeneous data semantic alignment and multidimensional fusion;Distributed hybrid storage architecture is constructed, adaptive database index mechanism is set, and through multidimensional data quality evaluation, the incremental update and full-amount synchronization of database are realized.The present application can realize the unified collection of various source data, standardized processing, effectively break the data island barrier, significantly improve data processing efficiency and storage running performance, and stably guarantee the overall data quality and data consistency of database.

The invention discloses a VNode architecture design for improving multi-thread efficiency based on an NUMA (Non Uniform Memory Access) system, which belongs to the field of virtual node VNode architectures and comprises a client and N virtual nodes (VNode). According to the technical scheme, by distributing the working threads and the memory data to the same NUMA node, delay caused by far-end memory access is reduced, so that the data access speed and the overall performance are remarkably improved, the architecture can better utilize hardware resources of a server, a working thread group on each NUMA node can be customized according to CPU and memory configuration of the node, and the service life of the NUMA node is prolonged. According to the method, resources are reasonably distributed and efficiently utilized, the service is divided into a plurality of virtual nodes, so that the architecture is excellent in expandability, and in a distributed system, each virtual node can be regarded as an independent unit, which means that when a certain node fails, the virtual node can be used as an independent unit. And the influence range can be limited in the node without affecting other nodes.

The application relates to the technical field of data processing, can be applied to business scenes such as financial technology and medical health, and discloses a data hierarchical storage method and device based on access representation, equipment and a medium, which comprises the following steps: collecting access behavior features of original data, identifying the heat state, writing data into a matched first target storage equipment according to a preset equipment performance corresponding relationship; after data storage, continuously monitoring subsequent access features, dynamically judging whether the heat state changes; if the heat state changes and meets specific migration conditions, a second target storage equipment is re-allocated and a data migration operation is completed, so that automatic hierarchical storage management of cold and hot data is realized. Through the acquisition of data access representation and the dynamic identification of the heat state, hierarchical migration of different heat data between different performance storage equipment is realized, the resource use efficiency and the access performance of the storage system are improved, and the storage cost is reduced.

The invention provides a method for performing data access control for a host device, a controller, a data access device and an electronic device. The method may include receiving a plurality of host commands from a host device for data access to media according to the plurality of host commands; and performing a data access optimization procedure to maintain the correctness of data reception, for example: performing data reception on the media to obtain at least one codeword; performing a first low density parity check (LDPC) code decoding operation on the plurality of row segments, wherein a part of the row segments are abnormal row segments corresponding to puncture variable nodes; searching at least one row segment satisfying at least one predetermined selection condition to perform at least one second LDPC code decoding operation on the at least one row segment; performing a plurality of third LDPC code decoding operations on the plurality of line segments; and returning the error-free data to the host device.

A method for remote storage of node metadata partition, which binds independent logical acceleration pool for object storage device process based on mechanical hard disk to remotely store metadata. In the formatting stage, a globally unique identifier is generated, virtual block devices are created for database and log partition respectively, and acceleration pool is connected; continuous address space is divided into discrete storage objects according to preset object size, and a mapping relationship between logical offset and object and object internal offset is established; database label and log clipping record are written into corresponding objects of acceleration pool. When a write request is received, log entries are written into log storage objects according to the mapping, and after the memory table is flushed as a sorted string table, the database storage objects are written according to the mapping; when a read request is received, data is read from the acceleration pool according to the mapping relationship, and pre-reading cache is used for acceleration. The method can eliminate the single point failure risk of local high-speed storage medium, realize the pooling sharing and elastic expansion of storage resources, and guarantee the metadata access performance.

The present invention discloses a method and system for scripted sequence calculation and backweaving of time series data, which relates to the technical field of script calculation of time series database, including writing and executing JS scripts, managing the connection with the time series database through a connection pool, and preloading commonly used time series data into a cache pool; processing time series data calculation and logical judgment, generating calculation tasks in real time and assigning them to a calculation thread pool for parallel processing; performing data management on time series data, reading time series data and writing back time series data, updating system status, and optimizing the JS script execution engine. The scripted sequence calculation and backweaving method for time series data provided by the present invention improves data processing speed and system responsiveness by establishing an internal cache pool, and improves calculation efficiency and the dynamic adaptability of the system by generating calculation tasks in real time according to calculation point information. The present invention achieves better results in terms of flexibility, adaptability, and calculation efficiency.

The invention belongs to the technical field of storage space distribution, and particularly relates to a distributed storage space distribution method which comprises the following steps: creating a cache hard disk pool and a data hard disk pool; configuring different minimum allocation units for the cache hard disk pool and the data hard disk pool; selecting a written hard disk pool according to the data length and a redundancy strategy of the data hard disk pool; and merging the data of the cache hard disk pool, and writing the merged data into the data hard disk pool. The storage space distribution process does not depend on the length of the data written by the user. A data hard disk pool adopts a large distribution unit, space debris and metadata are reduced, meanwhile, data merging is performed in combination with a merging termination condition based on the space waste rate, the data merging condition and the data merging termination condition are both the space waste rate, and the length of merged data is smaller than and close to integral multiples of the distribution unit. And space waste is effectively reduced.

A method for remote storage of node metadata partition, which binds independent logical acceleration pool for object storage device process based on mechanical hard disk to remotely store metadata. In the formatting stage, a globally unique identifier is generated, virtual block devices are created for database and log partition respectively, and acceleration pool is connected; continuous address space is divided into discrete storage objects according to preset object size, and a mapping relationship between logical offset and object and object internal offset is established; database label and log clipping record are written into corresponding objects of acceleration pool. When a write request is received, log entries are written into log storage objects according to the mapping, and after the memory table is flushed as a sorted string table, the database storage objects are written according to the mapping; when a read request is received, data is read from the acceleration pool according to the mapping relationship, and pre-reading cache is used for acceleration. The method can eliminate the single point failure risk of local high-speed storage medium, realize the pooling sharing and elastic expansion of storage resources, and guarantee the metadata access performance.

The invention relates to a cloud storage processing method and device, computer equipment, a computer readable storage medium and a computer program product, and relates to the technical field of cloud storage. The cloud disk access delay can be reduced, and the cloud disk storage access performance can be improved. The method comprises the steps of determining a block storage engine node where a cloud disk server is located; the block storage engine node starts a node optimizer; binding a service scheduling unit to a block storage engine node, and sending an address of the block storage engine node to a redirector; according to a login request of a cloud disk client mounted on the service scheduling unit, providing an address to the cloud disk client for login through a redirector, so that the service scheduling unit logs in the block storage engine node to perform input and output operation of the cloud disk service; wherein the node optimizer is used for starting a kernel service of the extended Berkley data packet filter at a block storage engine node, and forwarding an input / output request of an input / output operation at a kernel level.

The embodiment of the invention provides a host system, a memory system, electronic equipment, an operation method and a storage medium. The host system comprises a host controller, the host controller is coupled with a memory system, the memory system comprises a memory device, the memory device comprises a plurality of memory blocks, the plurality of memory blocks comprise a first memory area and a second memory area, the storage bit number of each storage unit in the second storage area is smaller than that of each storage unit in the first storage area; the memory device includes a plurality of regions; the host controller is configured to send a first instruction, wherein the first instruction indicates that data of a hot area in the plurality of areas is stored in the second storage area; the hot area is determined according to the access information of the computer program and the data access condition of the computer program.

The invention relates to a system positioning method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: in response to an access request initiated by a first service system, obtaining first position information corresponding to the first service system and system type information carried in the access request; determining candidate second service systems based on the system type information, and determining second position information corresponding to each candidate second service system; determining a matching result of the first position information and each piece of second position information according to a preset path matching strategy, determining a second service system in each candidate second service system according to the matching result, and sending address information of the second service system to the first service system; the address information is used for guiding the first service system to access the second service system. By adopting the method, the performance of accessing the service system in the distributed system can be improved.

The present application provides a page access method and device, which relates to the field of communication technology. The method comprises: obtaining an access message; obtaining a security domain name group, wherein the security domain name group includes a secure primary domain name and multiple subdomain names of the primary domain name; determining a target primary domain name and a target subdomain name that hit the security domain name group in the access message; and displaying data corresponding to the target primary domain name and data corresponding to the target subdomain name in a target page corresponding to the access message. Thus, the access effect based on domain name access is improved, and the problem that some secure content cannot be displayed in the access page is solved.

The present invention provides an erasure code method, system and readable storage medium for cross-domain data centers, and the method includes the following steps: S1, using a two-layer coding method to divide k data blocks into p local check groups, and using MSR coding to generate l local check blocks in each local check group, and then using RS coding to generate g global check blocks, all global check blocks are combined into a global check group, and a total of p+1 groups are generated together with the local check groups; S2, the placement strategy of p+1 groups in N data centers is modeled, and the optimization problem of access delay and recovery transmission delay is solved to obtain the group placement probability matrix P; S3, according to the group placement probability matrix P, the p+1 block groups are placed in N data centers. The present invention effectively solves the problems of large cross-data center transmission traffic and high user access delay during data recovery by using MSR and RS double-layer coding and optimizing the placement strategy.

The application provides a data hierarchical storage evidence method, a data encoding method, a device, equipment, a medium and a product, comprising: receiving a storage evidence request submitted by a data owner, the request carrying a data digest, data fragments, a timestamp and a data signature generated based on to-be-stored data, obtaining the access heat of each data fragment, dividing the data fragments into hot data fragments and cold data fragments according to the access heat, and respectively storing the hot data fragments and the cold data fragments into high-performance storage nodes and cold data storage nodes; calculating the hash values of the data fragments, constructing a Merkle tree based on the hash values and determining the root node hash value, storing the data digest, the timestamp, the data signature and the root hash value as storage evidence metadata into a main chain; and when a fragment verification request of a data access requester is responded, performing integrity check on the data fragments based on the storage evidence metadata on the main chain. Thus, under the premise of ensuring data tamper resistance and completeness, the storage efficiency, access performance and scalability of the data are significantly improved.

The invention provides a software defined network access method and device, equipment and a medium, and effectively solves the problems that the accuracy is reduced, the timeliness is insufficient and the security is reduced when network access is carried out in an existing solution. The method comprises the following steps: the terminal equipment generates a corresponding out-of-group access process based on an out-of-group access request of a user, and pushes the out-of-group access process to the service platform; the service platform responds to the out-of-group access process and generates a modification instruction; the service platform modifies a data network identifier of the terminal device based on the modification instruction to obtain a modification result, and the service platform generates a target security policy based on the modification result and outputs the target security policy to a target security gateway of the target virtual network group, and the target security gateway allows the user to access the target branch mechanism through the terminal equipment.

The application discloses a file pre-reading cache allocation method and device based on access heat, and the method comprises the following steps: calculating the cache upper limit of each file through the access heat; judging whether the sum of the pre-reading cache usage and the preset pre-reading step length of the corresponding file is greater than the cache upper limit of the corresponding file, and adjusting the pre-reading step length; performing data pre-reading according to the pre-reading step length, judging whether the pre-reading cache reaches the cache overall capacity, marking and selecting replacement; judging whether the replaced old data block has been used, if yes, ending the operation, otherwise, updating the pre-reading step length of the file corresponding to the old data block, and ending the operation. The device comprises a statistical module, a first judging module, a second judging module, a cache allocation module, a pre-reading step length calculation module, a hit updating module and a third judging module, which are used for executing corresponding programs. The application can adapt to different load conditions, improve the hit rate and use efficiency of the cache, and further improve the access performance of the file system.

This invention provides a field-granular storage layout optimization method for incremental version management of JSON data, belonging to the field of data version management. The method includes: S1, constructing a storage graph model that supports field-granular materialization; S2, converting the version graph into a storage graph with minimized total storage overhead based on the storage graph model; S3, if the minimized total storage overhead is less than the storage space constraint, performing optimization operations on all versions at both the field and version granularity levels to generate a set of candidate change edges for optimizing the storage graph; S4, introducing user access preferences as a moderating factor to evaluate the value of all change edge sets; S5, adding the change edge sets sequentially to the storage graph in descending order of value without violating storage space constraints to update the storage graph. This invention can correctly adapt to user preferences for full version queries and historical queries for specific fields while ensuring that the total storage overhead is less than the storage space constraint.

The present invention discloses a mobile solid-state hard disk system and a method for improving the performance and data retention of a mobile solid-state hard disk, and relates to the technical field of data storage. The mobile solid-state hard disk system includes: a resistive random access memory, a redundant check algorithm module and a check comparison module; when the mobile solid-state hard disk is working normally, the resistive random access memory is used to cache data; when the mobile solid-state hard disk is powered off, the resistive random access memory is used to store the check value of the data of the low-retention page; when the mobile solid-state hard disk is powered on, the check comparison module is used to compare the check value of the data of the page in the flash memory with the check value in the resistive random access memory, and if they are different, the redundant check algorithm module is used to recover the data of the page. The present invention can effectively enhance the performance and data retention of the mobile solid-state hard disk, and improve the stability and reliability of the data.

The application relates to the technical field of application development, and discloses a smart resource and color management method, device and system for a mobile application, which comprises the following steps: performing a resource enumeration definition generation operation on a target resource file to obtain a resource attribute method definition result; performing a color definition operation according to color configuration file information to obtain a color definition result; performing resource resolution and loading access operations according to demand access loading object types and target definition information and target cache sets to obtain an object access result; and performing corresponding resource comparison and cleaning operations according to resource file list information and resource reference list information. It can be seen that the application can improve the resource and color management efficiency, flexibility, accuracy and reliability of the mobile application, avoid repeated loading and resolution of resources, significantly improve resource access performance, improve the timeliness, efficiency and accuracy of cleaning of abandoned resources, and thus improve the development and operation stability and safety of the mobile application.