56results about How to "Improve data reading efficiency" patented technology

The invention discloses a data management method for a distributed data storage system. The distributed data storage system comprises a plurality of data servers. The data management method comprises the following steps of: at least acquiring respective load state information and physical position labels of the data servers; receiving a data request from a data requester; at least selecting one of the data servers to process the data request according to the respective load state information and the physical position labels of the data servers, wherein each data server stores requested data corresponding to the data request; reading the requested data from the selected data server; and returning the requested data to the data requester.

The invention provides a real-time data read-write method, device and system and an NFS server. The method includes the steps that when data is written, an NFS server places data needing to be written in a preset caching space, determines the pressure information change trend of a distributed file system, adjusts the capacity of the preset caching space according to the change trend and adjusts the data writing speed of the distributed file system; when the data is read, the NFS server judges whether data needing to be read exists in the preset caching space or not, if yes, the data, needing to be read, in the preset caching space is returned to an NFS client side, if not, the pressure information change trend of the distributed file system is determined, the capacity of the preset caching space is adjusted according to the change trend, and the speed of reading the data to the distributed file system is adjusted. While interface compatibility and stability of the distributed file system are ensured, the NFS server adjusts a caching mechanism and data refreshing speed in real time, and therefore the distributed file system is adaptive to all different application scenes.

The embodiment of the invention provides a data reading method and device and a distributed storage system. The data reading method comprises the steps that a server where a primary copy is located receives a data reading request of a user; the server where a copy with the smallest load is located is selected according to load information of servers where all copies are located; if the server where the primary copy is located is not the server with the smallest load, the data reading request is sent to a server where a standby copy with the smallest load is located, so that data reading operation is carried out; data read by the server where the standby copy with the smallest load is located is received and shown to the user. According to the technical scheme, the server where the copy with the smallest load is located is selected for data reading operation, data reading operation is not all carried out by the server where the primary copy is located, therefore, load balance of the servers where the copies are located can be achieved, data reading efficiency is improved, and the problems of resource waste of the server where the standby copy is located and too heavy loads of the server where the primary copy is located in the prior art are solved.

The invention belongs to the technical field of data storage, and provides a clustered database distributed storage method and device. The method comprises the following steps: receiving data processing request information, wherein the processing request information comprises keywords of data to be processed; inquiring whether the data to be processed exists in a cache of a storage server or not according to the keywords; and if the data to be processed does not exist, inquiring whether the data to be processed exists in node databases of the storage server or not, and if so, processing the data to be processed, and feeding a processing result back to the cache of the storage server in order that the cache of the storage server transmits the processing result to a client. Through adoption of the method and the device, the data reading efficiency of the storage server is increased.

The invention discloses an index establishing method for audio/video data. The method comprises the following steps that a disc space is divided into an index area and a data area, the index area is used for storing record section information and a disc area index, the data area is divided into a plurality of data areas, serial numbers are distributed for the data areas, and then the recovery process of the disc space and establishment of an index are performed. The index establishing method for audio/video data has the advantages that an index layer is simple, an index operation is atom operation, space recovery is simple, and space debris does not exist. During abnormal outage, saved data cannot be lost, simultaneously, the data operation has strong locality, data reading efficiency is improved, service life of a disc is prolonged, and the method in the index establishing method for audio/video data has high reliability, stability and performance.

The invention provides a point cloud scene rendering method, device and equipment, and the method comprises the steps: obtaining a first viewpoint, a first visual angle and origin coordinates of all voxels in a target point cloud scene; determining voxels in a visual area according to the first viewpoint, the first visual angle and the origin coordinates of all the voxels in the target point cloudscene; storing the point cloud data corresponding to the voxel in the visual area into a cache; respectively adding the point cloud data corresponding to the voxels in the visual area stored in the cache to a plurality of levels of detail levels; and rendering the target point cloud scene according to the point cloud data in each level of the detail level. In the embodiment of the invention, thepoint cloud data corresponding to the voxel in the visual area in the target point cloud scene can be loaded in blocks by taking the voxel as a unit, and the data reading efficiency is effectively improved, so that the point cloud scene can be efficiently and smoothly rendered.

The invention relates to a hash table data storage management method and device, a medium and electronic equipment, and the method comprises the steps: obtaining the data in a to-be-processed hash table, wherein each piece of data carries a hash value, an address offset and the identification of the hash table to which the data belongs; on the basis of the identification and the hash value of the hash table to which each data belongs, searching an address of each data in a corresponding storage area in a memory and an address of a corresponding storage unit in the corresponding storage area in a pre-established hash lookup table, and determining an actual physical address to be written of the data on the basis of the address offset; and finally, writing the data into a corresponding storage unit in the memory. According to the embodiment of the invention, the transportability of the hash table can be improved, and the data storage is more aggregated, so that the subsequent data reading efficiency of the hash table is relatively high.

The invention relates to a method for showing real live-action space by a navigation map. A storing and processing mode of data is that: a part of the data is inputted from the external part, the data needs to be compressed after being inputted in order to solve a problem that the amount of original data is too large. Basic ideas of the solution provided by the invention are that: the original data is organized and ranked again, and the data is ensured not to be damaged; the data is mainly composed of two parts which are object models and model textures, wherein the object models are divided into two parts, one part is single models having no commonality, and the other part is common models having the commonality; original vertex coordinates and texture coordinates are stored by floating-point numbers. The method provided by the invention has the advantages that a problem that the storage medium capacity is restricted is solved through compression of the data, and the utilization rate of the storage medium is improved. The method improves the efficiency of data reading of programs, has an especially obvious effect on guidance and prompts for a complex intersection, and is an essential live-action display technology for navigation in metropolis in the future.

A data management method for a data storage device is provided. The data storage device includes a non-volatile memory. The non-volatile memory includes a plurality of pages. Each of the pages is configured to store a plurality of records of data. The data management method includes steps of: receiving a read command; reading target data from a data buffering storage device when the target data corresponding to the read command is stored in the data buffering storage device; determining whether an amount of data of remaining data in the data buffering storage device is greater than a threshold, wherein the remaining data is a part of subsequent data, and the target data and the remaining data have a sequential relationship in terms of data reading; and if the determination result is false, storing data in at least one subsequent page of the target data into the data buffering storage device.

The embodiment of the invention provides a data processing method and device, a medium and electronic equipment, and the method comprises the steps: recording the data size read from a database each time, and the reading efficiency of the data size read each time during actual reading; determining the data volume read next time according to the data volume read each time and the reading efficiency; and reading data from the database based on the determined data volume read next time. According to the technical scheme of the embodiment of the invention, the next data reading task can be adjusted according to the historical effect of data reading, so that the data reading efficiency can be improved. Furthermore, according to the technical scheme of the embodiment of the invention, the data can be pushed to the service system according to the data read from the database, so that when the data is provided for the service system, the data in the database does not need to be opened, the datasecurity in the database is ensured, and meanwhile, the dependence of the service system on the database is decoupled.

The invention discloses a remote monitoring device based on a GPRS module, wherein the device relates to the field of remote control. The remote monitoring device includes a PLC control system, a frequency converter, a GPRS module and an upper computer. The GPRS module is connected with the PLC control system and upper computer respectively. The PLC control system is connected with the frequency converter for collecting the operating parameters of the frequency converter, compressing and packaging the operation parameters, and transmitting the running parameters to the GPRS module. The GPRS module is used for receiving the operation parameters and sending the operation parameters to the upper computer, which realizes the real-time remote monitoring of many equipments of the large-scale production-oriented enterprises, improves the data reading efficiency, and solves the defects that the real-time remote monitoring of many equipments of the large-scale production-oriented enterprises isdifficult and the data reading efficiency is low in prior art.

The invention provides a method for duplicate checking of massive data by using DBCursor cursor and hashMap. The method adopts the DBCursor cursor to read data of massive resource data, uses .next ()to read data in database in sequence, and closes connection with close () after reading. The invention also discloses a method for checking duplicate of massive resource data by using DBCursor cursor.Traversing the resource data list in batches, using simHash algorithm to calculate the text in the resource database as simHash fingerprint signature, storing it as String type, and dividing the fingerprint signature into n fragments, where n is a natural number; the fragment divided into simHash signatures obtained above is used as key and the corresponding sinHash+ heap number is used as value;duplicate checking of the target text is performed by using the key assignments of hashMap. The method overcomes the problems of low efficiency and high memory occupancy of a traditional method, andgives consideration to the balance between efficiency and accuracy.

A decoding method, a memory controlling circuit unit, and a memory storage device are provided. The method includes: reading a first physical programming unit by using a first read voltage to obtain first data; determining whether a first ratio of a first quantity of a first bit value and a second quantity of a second bit value in the first data is greater than a threshold; when the first ratio is not greater than the threshold, performing a decoding operation according to the first data to generate first decoded data and outputting the first decoded data; and when the first ratio is greater than the threshold, not performing the decoding operation according to the first data.

The embodiment of the invention discloses a data providing method and system for model training, relates to the technical field of computers, and can effectively improve the data acquisition efficiency of a model training task. The method comprises the steps of receiving a data request of a model training task, wherein the data request carries a data set identifier and a file identifier of a target file required by the model training task; positioning a storage position of a target object corresponding to the target file in an object storage server in a hierarchical directory according to the data set identifier and the file identifier; outputting the target object from the object storage server according to the storage position; converting the target object into a corresponding file in a preset file system, wherein the preset file system is a file system on which the model training task is based. The method and system can be applied to machine learning.

The invention discloses a method and device for software moving. The software moving method comprises the following steps: determining that a terminal has an external memory device in a preset time interval; generating moving prompt information including guide information about moving the movable software to the external memory device when the memory inside the terminal has movable software; receiving a moving instruction input by a user according to the moving prompt information; moving the movable software to the external memory device according to the moving instruction. According to the embodiment of the invention, an available internal space of the terminal can be managed in time, so that the data reading efficiency and the operation speed of the terminal are increased.

The embodiment of the invention discloses a data processing method and device, equipment and a storage medium. The method comprises the steps of obtaining a data writing request carrying a service table; storing the service table into a matched data source according to a preset data distribution strategy; generating data source information according to the data source and a preset physical table in a data storage database; judging whether a target service column with the same field name as the service column in the service table exists in the service columns in the physical table or not according to a mapping relation list between the service table and the physical table; and if so, generating a mapping relationship between the service table matched with the service table and the physicaltable according to the table column information of the service table, the table column information of the target service column and the table column information of the physical table, and writing theservice data in the service table into the physical table according to the mapping relationship. According to the embodiment of the invention, the compression ratio of the physical storage column canbe improved, the size of the compressed physical storage column is reduced, and the data reading efficiency during data query is improved.

The invention relates to the technical field of communication, and discloses a data reading method and device of an SIM card. The data reading method comprises the steps that when a file selection instruction is received, a corresponding file is selected from an SIM card; when a first record reading instruction for the corresponding file is received, safety condition checking is conducted firstly,and then the corresponding record data is read from the corresponding file and returned after the safety condition checking is passed; if the safety condition check is passed, when other record reading instructions for the corresponding file are received, the safety condition check is not performed, and the corresponding record data are directly read from the corresponding file according to the current record reading instruction and returned. According to the embodiment of the invention, the security condition check is executed only when the first read record instruction of the current file is received, and the security condition check is not executed for other subsequent read record instructions of the current file, so that the reading time of each piece of subsequent record data is greatly shortened, and the data reading efficiency of the whole file is effectively improved.

The present application provides a data reading method and apparatus based on a RAID disk array. The method comprises: determining target logical partitions corresponding to to-be-read video data, wherein the number of the target logical partitions is M, M is a natural number that is greater than 1 and is not greater than S, S is the total number of logical partitions included in a RAID disk array, and S is not less than 2; assigning the target logical partitions to each mirror group; and reading video data in the assigned target logical partition on a member disk of each mirror group. Application of the method can improve data reading efficiency during multi-channel video playback in a video surveillance application scenario.

The embodiment of the invention provides a memory control method, which is used for a rewritable nonvolatile memory module. The rewritable nonvolatile memory module comprises a plurality of entity units. The method comprises the following steps: receiving at least one first reading instruction from a host system; and determining whether to start a pre-reading operation or not according to the total data volume of the to-be-read data indicated by the at least one first reading instruction. Wherein the pre-reading operation is used for pre-reading data stored in at least one first logic unit, and the at least one first logic unit is mapped to at least one of the plurality of entity units. The invention also provides a memory storage device and a memory control circuit unit.

The invention relates to a power network resource GIS application grid segmentation method based on a GIS platform. The method comprises the following steps: compiling and disposing GIS power network resource platform rear-end server codes; performing grid division on geological area in a GIS platform by use of a finite element grid automatic generation parallel area division algorithm; dynamically scheduling the compiling and disposition of a layer algorithm; a GIS platform rear end pushing integrated equipment information to a GIS platform front end; and a GIS platform front-end displaying container displaying a correlation effect. The geological area grid division is quite high in automation and satisfies the demands for space data diversification and resource dynamics. Reasonable indexes are established for GIS platform power network resource equipment position and power network running state information, the data reading efficiency is accelerated, the uniqueness of the data of the platform power network resource equipment position and power network running state information is ensured, the frequency of the GIS platform accessing into a disc is reduced, and the retrieval efficiency is improved.

The invention discloses a liquid crystal lens zoom processing method and system. The method comprises the steps: obtaining the maximum optical path difference and the minimum optical path difference of a liquid crystal lens, and calculating the optical path difference variation which is the difference value between the maximum optical path difference and the minimum optical path difference; dividing the optical path difference variation into N equal parts according to preset focal length adjustment precision, obtaining N + 1 optical path differences by taking the optical path difference variation/N as a step length, and obtaining a focal length corresponding to each optical path difference; and according to the optical path difference distribution curve corresponding to the focal length, simulating each group of driving voltage corresponding to each focal length so as to establish a focal length-voltage lookup table. The preset focal length and the driving voltage established by the method have high focal length adjustment precision when the target object is observed in a close range, the focal length adjustment precision is reduced along with increasing of the distance between the target object and the human eyes, and the method is more in line with general human eye visual features.

One or more embodiments of the present specification provide a storage device and storage equipment. The storage device includes: a non-volatile memory; a peripheral circuit adapted to the non-volatile memory; and a decoder electrically connected with the peripheral circuit and used for reading target data from the nonvolatile memory through the peripheral circuit and carrying out error correction decoding on the target data.