4results about How to "Reduce read volume" patented technology

The application discloses a distributed adaptive framing output method based on large-range remote sensing images, and relates to the technical field of remote sensing image processing. The preprocessed large-range remote sensing images are stored in a COG format, the framing size and quantity are dynamically adjusted in combination with the target area range and resolution, the tasks are distributed by a data locality perception scheduler after Z-order curve sorting, the computing nodes load the framing data with a buffer area, the framing data is interpreted by a random forest, and the buffer area is cropped, finally, the virtual data set is aggregated, efficient distributed parallel processing of the large-range images is realized, the I / O bottleneck and the computing resource limitation are effectively relieved, the context missing problem on the framing boundary is solved, the intelligent interpretation efficiency and precision are improved, and the multi-resolution on-demand rendering and elastic expansion are supported to adapt to the data scale growth.

The invention belongs to the technical field of communication data processing, and particularly relates to a preprocessing device and method for multi-dimensional communication index data, and the device comprises a collection module which is used for collecting original communication index data from an original index library or a file server, and storing the original communication index data into a preset collection library; the configuration module is used for constructing a configuration table to form a configuration library; the initial summarizing module is used for combining all original communication index data in the acquisition library and network element information in the configuration table into a large-width table according to a preset initial dimension and storing the large-width table to form an index database; the dimension summarizing module is used for summarizing according to a preset summarizing dimension by taking the initial dimension as a base table and storing the summarizing dimension into the index database; and the index pre-summarizing module is used for performing pre-summarizing processing on complex indexes on the basis of the dimension data according to the query demand information. According to the method, the defect that multi-table query must be associated when multiple tables are stored in the prior art can be avoided, so that the application requirement of quick response of the query request is met.

A method and device for reducing read latency of lightweight LDPC hard decoding for TLC-type NAND Flash, relating to the field of solid-state storage. In order to solve the technical problem in the prior art that when the original bit error rate of data in the flash memory is high, LDPC code decoding requires not only more perception levels but also a large number of decoding iterations, thereby causing serious read latency problems, the technical solution provided by the present invention is: a method for reducing read latency, the method comprising: collecting block numbers in a storage device and determining feature word line numbers; reading LSB page data of feature word lines and recording the number of iterations; calculating the voltage offset of at least one overlapping area according to the number of iterations; adjusting the read reference voltage position according to the voltage offset, and reading all data. A method for reducing read latency of hard decoding implemented according to the read latency reduction method. Suitable for application in lightweight LDPC hard decoding of TLC-type NAND Flash.

The invention discloses a spark-based spatial incremental data processing method, and belongs to the field of spatial data processing. Comprising the following steps: establishing an equalization space intelligent partitioning algorithm based on a spark parallel analysis principle; constructing a distributed storage format for the spatial data; during data reading, filtering the original partition data file by using the spatial index file; a spatial analysis mode is constructed based on an intelligent partitioning algorithm and a distributed storage format, and is used for executing the following steps: reading newly-added spatial data, and obtaining the data volume and the spatial range of the newly-added spatial data; carrying out space partitioning operation on the newly-added space data by utilizing an equalized space intelligent partitioning algorithm, and reducing each partition according to a data range; establishing a spatial secondary index in each partition; and writing the processed partition data into a database in parallel. The working efficiency of space incremental data processing can be improved, the labor cost is reduced, it is ensured that the processing process adopts a unified standard, human errors are reduced, and the accuracy is improved.