44results about How to "Improve the efficiency of reading data" patented technology

The invention discloses an encryption copy organization method under a distributed storage environment. In the method, the management unit data block of system data is divided into a plurality of data segments with the same size; the system carries out management by taking the block as the unit; and a client side encrypts the data by taking the data segment as the unit so as to provide finer granularity control to the data block. Because the data block is encrypted by segments, the ciphertext data segments have no dependence and can be encrypted and decrypted in parallel so as to avoid the phenomenon that read-write of small data amount brings great cost for carrying out encryption and decryption on the whole data block; for read of a large data amount, read requests are grouped, and different grouping requests are sent in parallel to each storage node maintaining a requested file data block copy; and each grouping is read in parallel to improve the efficiency of reading data. The invention realizes that the encryption technology and the copy technology are applied in the distributed storage environment. The provided encryption copy organization method greatly improves the efficiency of reading and writing data.

The embodiment of the invention discloses a data caching method. The data caching method includes the steps that to-be-cached data and caching instructions are received, wherein the caching instructions are instructions sent by users to a system according to characteristics of the to-be-cached data, the instructions comprise first instructions or second instructions, the first instructions are used for that the to-be-cached data is indicated to be stored into a memory cache, and the second instructions are used for that the to-be-cached data is indicated to be stored into a magnetic disk cache; according to the caching instructions, corresponding executive strategies are matched from an executive strategy set, the executive strategy set comprises a memory-cache storage strategy and a magnetic-disk-cache storage strategy, and the caching instructions correspond to the executive strategies in a one-by-one mode; if the executive strategy is the magnetic-disk-cache storage strategy, the capacity of each single data in the to-be-cached data is judged; if the single data is larger than a first threshold value, the single data is cached with files. According to the data caching method, the advantages of all caching modes can be achieved according to different characteristics of caching data.

The embodiment of the invention provides a method and device for reading data. The method includes the steps that a controller of storage equipment receives a data reading request sent by a host, the data reading request includes a logic address of data to be read, the controller of the storage equipment sends the logic address to a controller of a solid state disk, the controller of the solid state disk inquires in a mapping table stored in a nonvolatile storage medium of the solid state disk according to the logic address to obtain a physical address of the data to be read, the controller of the solid state disk obtains the data to be read according to the physical address of the data to be read and sends the data to the controller of the storage equipment, and the controller of the storage equipment sends the data to be read to the host. According to the method and device for reading the data, the number of the mapping table is one, the physical address can be directly looked for according to the logic address, compared with the prior art with two mapping, the method and device greatly reduce cost of the storage equipment and the host and improves efficiency of obtaining the data.

The invention provides an embedded file system-based reading method for streaming data. The method comprises the following steps: receiving a request for reading the streaming data, creating a reading task for the request when the requested streaming data exist in a disk, distributing storage space for the new reading task and initializing relevant parameters; decomposing the reading task into a plurality of subtasks, wherein each subtask is responsible for reading a piece of physically continuous data, and caching the data; fetching the data from subtask cache, performing encapsulation according to the format of the streaming data, submitting to a calling party of the reading task after a piece of data is encapsulated each time, and releasing the subtask after data submission is competed and triggering the next subtask; when all the subtasks are successfully finished, reporting that the tasks are normally finished to the task calling party, and waiting the task calling party to end the current reading task. According to the embedded file system-based reading method provided by the invention, high-throughput and high-concurrence reading of the streaming data is facilitated, and the problem that the concurrence performance of a server is low when a large number of users visit hot data is effectively solved.

The invention discloses a data ahead-reading method, device, equipment and computer readable storage medium. The method comprises in advance storing data of a preset byte size of every file in a hardsick into preset storage equipment, wherein the data reading speed of the preset storage equipment is higher than that of the hard disk; receiving a data reading request sent by a client; determiningwhether data to be read exist in a cache space, if so, returning corresponding data to be read in the cache space to the client according to the data reading request, else, returning corresponding data to be read in the preset storage equipment to the client according to the data reading request. According to the data ahead-reading method, device, equipment and computer readable storage medium, data in the preset storage equipment is read, and the speed of reading the data of the preset storage equipment is higher than that of reading the data of the hard disk, so that the data ahead-reading method, device, equipment and computer readable storage medium can increase the speed of primary data reading and further improve the data reading efficiency.

The invention discloses a data transmission method and a data transmission device for a micro control unit (MCU) and a data transmission system for solving the problem of lower efficiency of reading data from an external memory element by the MCU in the prior art. The method comprises the following steps of: reading the data from a memory device through a serial port and storing the data in a cache, wherein the read data is converted from serialization to parallelism when the data is stored, and the serial clock frequency is higher than the parallel clock frequency; and determining a corresponding address in the cache of a specified address in the memory device of the MCU according to a corresponding relationship between a memory address of the cache and the memory address of the memory device, and then sending the data in the corresponding address to the MCU through a parallel port. The technical scheme of the invention can be used for improving the efficiency of accessing external memory devices by the MCU.

The invention discloses a method and a device for reading data, which belong to the technical field of computers. The method comprises the following steps: determining a head-pointer position and a tail-pointer position of a channel; comparing the height of the head-pointer position and the height of the tail-pointer position; and sequentially reading a data packet according to a comparison result. The device comprises a determining module, a comparing module and a reading module. According to the invention, through sequentially reading the data packet, the times for reading the data can be reduced; and in addition, since the times for reading the data is reduced, the efficiency for reading the data can be improved, and thus the probability that data overflow from the channel is reduced.

The invention discloses a DCT (Discrete Cosine Transform) method and a circuit system. The method comprises the following steps of: storing residual blocks into different first storage units according to columns; after each row of residual blocks is read in parallel from each first storage unit for row transformation, writing each data in the data after row transformation into different second storage units according to a preset diagonal read-write rule; and after a column of data subjected to row transformation is read out from each second storage unit in parallel according to a diagonal read-write rule for column transformation, storing each coefficient in the obtained column of transformation coefficients in different third storage units, so that a column of transformation coefficients is read out from each third storage unit in parallel for quantization operation each time. Through the optimization design of the row-column conversion circuit and the intermediate transpose storage, especially the improvement of the read-write rule of the intermediate storage structure, the reading period of the row-column conversion circuit to the intermediate storage structure is reduced, the large throughput rate can be achieved on the small circuit area, and the circuit performance is improved.

The disclosure relates to a method and device for data reconstruction, and belongs to the technical field of data storage. The method includes: determining at least one data block to be reconstructed; determining the priority of the at least one data block according to the current attribute of the at least one data block; according to the priority of the at least one data block, and the the stripe to which each data block in the at least one data block belongs, and determine at least one stripe to be reconstructed and the priority of each stripe in the at least one stripe; according to the determined stripe to be reconstructed The priority of at least one stripe is to perform data reconstruction on the data block to be reconstructed included in the at least one stripe. With the present disclosure, the efficiency of reading data can be improved.

The invention discloses an encryption copy organization method under a distributed storage environment. In the method, the management unit data block of system data is divided into a plurality of data segments with the same size; the system carries out management by taking the block as the unit; and a client side encrypts the data by taking the data segment as the unit so as to provide finer granularity control to the data block. Because the data block is encrypted by segments, the ciphertext data segments have no dependence and can be encrypted and decrypted in parallel so as to avoid the phenomenon that read-write of small data amount brings great cost for carrying out encryption and decryption on the whole data block; for read of a large data amount, read requests are grouped, and different grouping requests are sent in parallel to each storage node maintaining a requested file data block copy; and each grouping is read in parallel to improve the efficiency of reading data. The invention realizes that the encryption technology and the copy technology are applied in the distributed storage environment. The provided encryption copy organization method greatly improves the efficiency of reading and writing data.

The invention provides a thermal flying-height control slider for a hard disk drive. In the thermal flying-height control slider, according to a principle that the read-write magnetic head area of the slider can be subjected to thermal expansion so as to further reduce flying height by electrifying a write coil in a magnetic head write process, a microheater is additionally arranged at a selected middle position of a read-write magnetic head on the hard disk slider, and a unique and efficient W-shaped microheater structure is designed. By means of the structure, the magnetic reading head can obviously move downwards in a read operation process, the flying height of the hard disk magnetic head in the read operation process is decreased, and the precision and the efficiency of data read are increased.

The embodiment of the invention provides a data reading method and device, electronic equipment and a readable storage medium. The method comprises the following steps: setting a machine room identifier for each data storage node DN in the HDFS, and setting a copy distribution attribute for to-be-backed-up data; determining a target machine room corresponding to the machine room identifier, and selecting a data storage node DN with the copy number from the target machine room; storing the data to be backed up in the selected DN; when a data reading request which is sent by a client and aims attarget data is received through an NN, sending DN identifiers of all DNs storing the target data to the client through the NN; determining whether the machine room identifier of each DN storing the target data is the same as the machine room identifier of the client through the client; and reading the target data from the target DN under the condition that the client determines that all the DNs comprise the target DN of which the machine room identifier is the same as the machine room identifier of the client.

The invention discloses an oblique scan display method in a direct writing photoetching system. N2 rows of data are combined and stored in a memory in sequence according to an obliquity factor N and on the basis of left-justified N rows and N lines of pixel data, and an FPGA (field programmable gate array) selects the data in the corresponding rows in sequence according to the platform motion to a DMD (digital micro-mirror display) to display. According to the invention, the data are stored in a DDR2 (double data rate 2), the DMD is controlled by the FPGA, and the oblique scan display is a method for updating an image according to the obliquity factor and a platform scanning manner, so that the operating mode of the FPGA can be conveniently designed and optimized, and the data reading efficiency of the DDR2 can be improved.

A data reading method and device. The data reading method comprises: during a process of scanning an index clustering table, scanning leaf nodes and recording page numbers of the leaf nodes (S10); and merging I / O requests of the leaf nodes with consecutive page numbers into one I / O request (S11). Because data of multiple leaf nodes in physically consecutive storage locations is read by means of one I / O request, the data volume read by each I / O request is increased, thereby fully utilizing the overall disk throughput. In addition, to read data of the same storage volume, the number of I / O requests that need to be initiated can be reduced, thereby avoiding the limitation of the disk IOPS parameter, and effectively improving the data reading efficiency.

The invention provides a data caching method and device to solve the problem of low data caching efficiency in the prior art. Including: obtaining the first read cost used to indicate the time required to read a piece of data from the disk, and the second read cost used to indicate the time required to read a piece of data from the preset memory; obtain the disk The first space occupancy and the number of accesses of each disk file in the multiple disk files stored on the computer; the first space occupancy is used to characterize the storage space occupied by hot data in the disk file; according to the first read cost, the second 2. Read cost, first space occupation and access times of each disk file, determine the access cost of each disk file; determine among multiple disk files according to the first space occupation and access cost of each disk file Output the disk file to be cached, and cache the hotspot data in the disk file to be cached to the preset memory.

The present application discloses a data readdir method, system, device and computer medium, which are applied to a server in a distributed file system to receive a data readdir request sent by a client in the distributed file system; determine each corresponding data readdir request Target metadata server; split the data readdir request into data readdir sub-requests corresponding to each target metadata server; concurrently send data readdir sub-requests to the corresponding target metadata server; receive the target data transmitted by each target metadata server and transmitted to the client. The data readdir method, system, device and computer-readable storage medium provided by the present application improve the efficiency of data read by a client by concurrently sending data readdir sub-requests to a corresponding target metadata server.