15results about How to "Improve reading and writing efficiency" patented technology

The invention discloses a thread data reading and writing-back method and device, equipment and a storage medium, and relates to the field of data read-write, and the method comprises the following steps: marking a plurality of operands based on operand types of the operands in a current branch thread to obtain a plurality of corresponding marked operands; if a reading request is received, determining whether an operand corresponding to the request is marked as a reusable operand or not; if yes, reading cache data corresponding to the operand from a preset cache; if not, reading target data corresponding to the operand, and storing the target data to a preset cache; if the write-back request is received, determining whether an operand corresponding to the request is marked as a reusable operand or not; if yes, the requests are added to a local cache queue, and merging and data writing-back are carried out based on the requests in the queue when the queue is full; and if not, writing the data corresponding to the operand into the target register. Therefore, the read-write efficiency of the data can be improved.

A massive telemetering data characteristic value processing method based on time fragmentation and double compression comprises the following steps: receiving satellite telemetering original stream data in real time, performing formatting analysis, extracting a baseband timestamp, a telemetering code and an engineering value field, and generating a standardized telemetering engineering value frame; fragmenting the telemetering engineering value frame based on a timestamp, determining a triple composed of the timestamp, a date to which the timestamp belongs and a telemetering code as a storage sub-partition key, and dynamically allocating data to a corresponding storage partition according to the key for storage in a disk; carrying out historical archiving on the stored telemetering engineering value frames by adopting double-compression processing; constructing a shared bulletin board task model, and registering all to-be-calculated feature tasks to a shared bulletin board queue by taking a combination of a telemetering code, a processing time slice and a processing identifier as a bulletin board key value; and the thread pool obtains task entries in the shared bulletin board queue in parallel based on a shared lock queue mechanism, and reads satellite telemetering point information from the shared memory.

This invention discloses a controller and control method for SRAM erase protection verification in an MCU architecture, belonging to the field of memory technology. This invention solves the problem that existing devices cannot simultaneously include multiple functions. By employing an SRAM erase protection verification device, write protection can be configured for each page individually, achieving write protection for SRAM data. The entire SRAM data is erased, and after erasure, write protection and data verification functions continue to be executed, improving read / write efficiency. Furthermore, SRAM data can be verified. When the SRAM controller reads any address, it latches that address and pulls up the read verification flag for that address. Then, an even-number verification is performed on the byte with the verification bit and the latched address. If the verification result is low, the verification passes; otherwise, it indicates a data error, and the error verification result is fed back to the system, thereby meeting the high requirements of the system for the SRAM controller.

The embodiment of the invention discloses an optical disk, an optical drive and an optical drive control method. A guide layer in the optical disc is provided with a spiral groove, a first groove brim of the groove is provided with a waveform, the waveform is used for carrying guide information, and a second groove brim of the groove is not provided with a waveform. According to the invention, the groove brim at one side of the groove has a waveform, and the groove brim at the other side has no waveform, so that when the position of the optical head corresponds to the groove, the waveform-free groove brim does not interfere with information reading, and guiding information can be read. Besides, for a bank structure formed between two adjacent circles of grooves, the groove brim on one side of the bank structure has a waveform, and the groove brim on the other side of the bank structure has no waveform, so that when the position of the optical head corresponds to the bank structure, the waveform-free groove brim does not interfere with information reading, and the guide information can be read. Therefore, read-write operation can be performed in the recording layer, at the position corresponding to the groove and at the position corresponding to the bank structure, and thus the storage density of the optical disc can be improved.

The invention discloses a data management method and device of a weak current system, computer equipment and a storage medium, and the method comprises the steps: collecting initial data through sensors disposed at a plurality of nodes of the weak current system, and transmitting the initial data to data collection equipment through a first communication protocol; performing first preprocessing on the initial data through the data acquisition equipment to obtain target data, and sending the target data to a data processing center through a second communication protocol; dividing the target data into a plurality of data fragments through the data processing center, and sending the plurality of data fragments to a plurality of first storage nodes in a distributed manner; and executing a corresponding copy strategy through each first storage node, and copying the data fragment to a second storage node, so that the second storage node stores the data fragment. Therefore, a huge amount of data generated by the weak current system can be safely and effectively managed.

The invention provides an SSD bad block remapping method and device and computer equipment, and the method comprises the steps: reading a first-level remapping table and a second-level remapping table from an NAND to an SSD when the SSD is powered on; wherein remapping summary information of each super block is recorded in the primary remapping table, and remapping detailed information of each super block is recorded in the secondary remapping table; when a read-write instruction of a host is received, inquiring the first-level remapping table to judge whether physical block remapping exists in the super block needing to be read and written currently or not; if the super block has physical block remapping in the first-level remapping table, querying and obtaining the position of physical block remapping from the second-level remapping table according to summary information recorded in the first-level remapping table; and performing read-write operation according to the remapping position of the physical block. The method has the beneficial effects that the remapping bad block can be quickly queried on the basis of small memory overhead, so that the read-write efficiency is improved, and the read-write performance of the SSD is improved.

The present invention discloses a HDFS protocol data mapping and transmission method for a distributed file system, comprising: determining an obj size consistent with a block size in advance according to a block size, and establishing a mapping relationship between a block and obj; receiving a read and write request sent by an HDFS client, and determining the current obj according to the current block and the mapping relationship between the block and obj; calculating the target node IP where the main disk corresponding to the current obj is located according to the information of the current obj; returning the target node IP to the HDFS client, so that the HDFS client sends the corresponding data to the HDFS file server corresponding to the target node IP, and stores the data on the main disk through the HDFS file server; the present invention does not require a distributed storage client to forward data during use, thereby improving data reading and writing efficiency, reducing network bandwidth consumption, and being beneficial to improving system performance.

The invention discloses a method for effectively improving read-write efficiency and concurrency of small file use storage, which comprises the following steps of: merging a plurality of small files in storage, and packaging the plurality of small files into a storage block; adjusting a read-write scheduling algorithm according to the access mode of the file to ensure that the frequently accessed file is preferentially loaded; and a lock mechanism and read-write priority control are introduced to realize concurrency control, so that data conflicts cannot be generated during concurrent access of multiple threads or processes to small files, and meanwhile, the concurrency capability is maximized. According to the method, storage fragments are reduced by combining the small files, the scheduling algorithm is optimized, the access response speed is increased, concurrency is controlled, data conflicts are avoided, the read-write efficiency and concurrent processing capacity of small file storage are effectively improved, and the method is suitable for small file intensive storage scenes.

This specification provides a transaction processing method and apparatus for use in a database management terminal, which manages relational databases. The transaction processing method includes: determining a target transaction based on the database logs of the relational database; determining the data file corresponding to the target transaction in the relational database and the memory object corresponding to the target transaction in memory space; establishing a mapping relationship between the target transaction, the memory object, and the data file, and storing data from the data file into a memory block contained in the memory object based on the mapping relationship; wherein the memory blocks storing the data constitute a storage link; and reading the target data corresponding to the target transaction from the memory block contained in the memory object based on the storage link, for executing the target transaction. Storing data based on the mapping relationship achieves ordered data writing, avoiding the performance overhead of random writes; and reduces the number of bytes read during data reading, improving data reading efficiency.

The invention relates to a block chain data storage method and device and computer equipment, and the method comprises the steps: determining a storage position of historical data under the condition of modifying the historical data stored in a current data storage structure, and storing the current data obtained by modifying the historical data into the current data storage structure; if the storage position is a temporary storage area of the current data storage structure, storing historical data in the temporary storage area into a historical data storage structure; if the storage position is a permanent storage area of the current data storage structure, determining a data identifier corresponding to the historical data; and storing the historical data extracted from the permanent storage area based on the data identifier into a historical data storage structure. By adopting the method, the read-write efficiency of the block chain data can be improved.

A persistent storage method for consensus data is applied to any consensus node participating in consensus in a blockchain system. The process address space of the consensus process running on the consensus node includes a reserved mapping region. A one-to-one mapping relationship is established between the virtual memory address in the mapping region and the physical storage address in the non-volatile physical storage space on the consensus node used for persistent storage of consensus data. The method includes: acquiring consensus data generated by the consensus process during the execution of the consensus protocol; persistently storing the consensus data in the mapping region; and, in response to the consensus data being successfully written to the mapping region, determining the physical storage address that has established a mapping relationship with the virtual memory address of the consensus data in the mapping region, and further writing the consensus data back to the physical storage space based on the physical storage address.

The invention discloses a cache control method and system based on file data volume, a terminal and a medium, the method comprises the following steps: determining the file data volume of written files, classifying the files based on the file data volume to obtain a first type of files and a second type of files, the file data volume of the first type of files being smaller than the file data volume of the second type of files; starting a first data caching program corresponding to the first type of files, and caching the first type of files to a local storage device based on the first data caching program; target storage equipment corresponding to local storage equipment in the distributed file system is obtained, the first class of files are synchronized to the target storage equipment, and both the local storage equipment and the target storage equipment interact with the Ceph cluster. According to the method and the device, the files with small file data volume can be firstly cached to the local storage device and then run to the corresponding target storage device, so that the data reading and writing efficiency can be improved, and the problem of cache single-point fault is solved.

The application relates to a grid unit data query method and system, and belongs to the technical field of data processing. The method solves the problems that the storage space occupied by large-scale grid data is large, and the read-write and transmission occupation time is long in the prior art. The method comprises the following steps: receiving an index of a grid unit to be queried and a grid grouping ID to which the grid unit belongs; acquiring each grid unit set contained in a grid grouping according to the grid grouping ID; the grid unit set is a data set of the same type of grid unit, and comprises a unit type, a unit quantity, a starting index and a unit topology array; sequentially calculating the grid unit set to which the index of the grid unit to be queried belongs according to the starting index and the unit quantity of each grid unit set, and taking the grid unit set as a target unit set; extracting the index of each grid point in the grid unit to be queried from the unit topology array of the target unit set, and obtaining the coordinates of each grid point of the grid unit to be queried in a global grid point array. Efficient access of grid unit data is realized.

The invention relates to a data management method and device, a storage medium and a computer program product. The data management method comprises the steps that a process tree structure is adopted to store optimized process data, an optimized process is an optimized process of multidisciplinary optimization, the process tree structure comprises process nodes and application nodes, the process nodes are used for storing scheduling program data of the optimized process, and the application nodes are used for storing application information; and generating a historical data table of the optimization process according to the process tree structure to store historical data of the optimization process. According to the method and the device, the huge historical data of the multidisciplinary optimization process can be efficiently organized and managed, so that the storage space is reduced, and the read-write efficiency is improved.

The invention relates to a data file processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the steps of obtaining a to-be-stored data file, performing file partitioning processing on the data file to obtain a plurality of file blocks, respectively writing the file blocks into a plurality of first storage spaces of a first storage medium, generating a plurality of temporary verification blocks for the file blocks, writing the temporary verification blocks into a second storage space of the first storage medium, and storing the temporary verification blocks in the second storage space of the first storage medium. By the adoption of the method, on one hand, under the condition that writing of the temporary check blocks is completed, the temporary check blocks are migrated into the second storage medium, so that the data blocks stored in the first storage medium are multiple file blocks, and the storage space utilization rate is increased; the file block is stored in the first storage medium, the temporary verification block is stored in the second storage medium, the read-write speed of the first storage medium is higher than that of the second storage medium, the overall read-write efficiency of data storage is improved, and then the storage performance is improved.