143results about How to "Improve data storage efficiency" patented technology

The invention relates to a parallel data processing method based on a distributed structure. The storing comprises steps as follows: (1) a data master key value is extracted from master nodes according to types of master key values, directed slave nodes distributed by data are determined according to data attribute values and a section comparison result in the master nodes, and simultaneously, a global keyword B+ tree index is established; (2), the data are distributed to the slave nodes corresponding to the master key values according to the global keyword B+ tree index on the basis of a share-nothing principle; and (3), the slave nodes receive a data distributing request, and the data are stored in child nodes locally on the basis of the share-nothing principle. According to the method, an effective index mechanism is combined, and the storage and management efficiency of system data is improved; on one hand, the reasonable data distribution is guaranteed, the storage throughput of the slave nodes is reduced, the local query performance is improved, and the system flexibility is guaranteed by utilizing high expandability of the slave nodes; and on the other hands, local transcript safety is guaranteed through local duplication of multiple transcripts.

The invention discloses a website monitoring system and method applicable to a power industry. The system comprises an interaction layer, a data layer, a scheduling layer and a detection engine. The scheduling layer is used for scheduling the detection engine to carry out periodic automatic detection on tasks issued by users and summarizing detection results to the data layer after the detection is finished. The detection engine is used for receiving detection commands issued by the scheduling layer, detecting target websites, identifying Web security vulnerabilities, carrying out deep security physical examination on the website, monitoring website operation security states in real time, identifying the condition that a webpage is illegally tampered, malicious code is embedded into the webpage, a domain name is hijacked, an access page is refused and sensitive information occurs in the webpage, collecting internal security information on site by employing a vulnerability scanning device and a vulnerability detection tool, checking hidden vulnerabilities and deep security events, collecting website security physical examination results, website operation security state and onsite security checking results and transmitting the data to a database for storage.

The invention provides a data storage method and system and a data visiting method and system. The data storage method includes the following steps: obtaining file identifications of files to be stored and all objects under the files; taking the file identifications as keys, taking all the objects under the files as values to constitute key value pairs, and sending the key value pairs to a storage server corresponding to the keys; storing the key value pairs through the storage server. According to the data storage method, the file identifications and all the objects under the files are stored in a key value pair mode. Compared with a traditional transaction model storage method of a relation database, the data storage method is good in availability and partition expansibility, and high in data storage efficiency. Besides, the invention provides the data visiting method, a data storage system and a data visiting system.

The invention discloses a distributed storage method, which comprises the following steps: when a first block chain node in the block chain network initiates a transaction request, the first block chain node performs a consensus operation on the blocks carrying the transaction request, and broadcasts the blocks after the consensus operation to other block chain nodes in the block chain network; The remaining block chain nodes obtain transaction request data from the blocks after the common operation, and issues a creation, insertion or table query request through the intelligent contract initiation table to invoke the key-value pair interface and the storage engine to transmit the transaction request to the AMDB data proxy; The remaining block chain nodes execute corresponding database operation on the database according to the transaction request data through the AMDB data agent. The invention also discloses a distributed storage system and a device. The invention can improve the datastorage efficiency in the block chain and reduce the data update time.

The invention discloses a data storage method and device, a data query method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a data storage requestwhich comprises a data identifier; obtaining to-be-stored data according to the data identifier; performing serialization processing on the to-be-stored data to obtain serialized json character strings, the serialized json character strings comprising N sub json character strings, and then performing one-to-one matching on each sub json character string and a preset fixed field in a target data table; finally writing the sub-json character string successfully matched with the fixed field into a list area corresponding to the fixed field; and writing the sub-json character string which fails tobe matched with the fixed field into a list area corresponding to the custom field in the target data table. According to the method, serialization processing is carried out on frequently-changed data, and then the json character string subjected to serialization processing is written into the list area corresponding to the self-defined field in the target data table, so that the data storage efficiency in the relational database is improved.

The embodiment of the present invention provides a method for constructing and mining a monitoring-oriented video map, equipment, by constructing graph database and key-value database as data persistence storage of knowledge map, the depth convolution neural network is used for face recognition automatically, greatly reducing the intensity of manual scrutiny, Using a combination of shared convolution neural network and deep deconvolution network to automatically label the attributes of pedestrian objects, the unstructured video data is converted into structured graph data storage, it can satisfy the character retrieval based on censorship surveillance video, Trajectory mining, group center mining and other security requirements, can efficiently query node attribute information, can effectively visualize the relationship between nodes, using backbone information database and detailed information database storage methods, play their respective advantages, data storage and retrieval efficiency is high.

The embodiment of the invention provides a data processing method and device, an SMR storage system and a storage medium. The method comprises steps of obtaining a data writing instruction; determining a target object block of the target data to be written in in an SMR area of the target SMR disk according to the data writing instruction; generating target main index information and target standbyindex information for the target data and the target object block; writing the target data and the target standby index information into a target object block; writing the target main index information into a CMR area or other storage media; and writing database index information of the target data into other storage media, wherein the database index information of the target data comprises the target Unit key and the identifier of the target object block. Through the database index information, the main index information and the standby index information, the data writing sequence among thedata blocks in the SMR area is not limited, the operability of SMR disk data storage is improved, and the data storage efficiency is high.

The embodiment of the invention provides a telescopic distributed resource description framework (RDF) data storage method and device. The method provided by the invention comprises the following steps: distributing all the RDF data into memory of at least two storage nodes to be stored; backing up data in the memory of each first storage node into a persistent memory of a second storage node, wherein the first storage node and the second storage node are any one storage node of at least two storage nodes, and the second storage node is adjacent to the first storage node. By adopting the telescopic distributed RDF data storage method and device which are provided by the embodiment of the invention, data storage and query efficiency can be improved, and data can be rapidly restored locally from the adjacent storage node of the storage node when one storage node is failure, so that a data storage and query service is continuously provided.

The embodiment of the invention provides a data processing method and device and a mobile terminal, wherein the request end adds a reserved field in the to-be-stored data, constructs the to-be-storeddata into the target data and sends the target data to a storage end, the storage end distributes a memory to cache the target data, generates the data metadata of the to-be-stored data in the targetdata and writes the data metadata into a memory position corresponding to the reserved field in the distributed memory. According to the embodiment of the invention, the zero data copy is realized, the data storage efficiency is ensured, and the system performance is improved.

There is provided a timestamp value controlling apparatus that can improve storage efficiency of data as maintaining quality of data. In the apparatus, a timestamp value difference calculating section 103 obtains a timestamp value difference indicating a difference between an input timestamp value and a previous timestamp value timestamp value. A judging section 104 judges whether the timestamp value difference is within a reference timestamp value range in which a predetermined permissible range is added to the reference frame interval value. The outputting and selecting section 105 outputs a value, which is obtained by adding the reference frame interval value to the previous timestamp value, as an output timestamp value when the timestamp value difference is within a reference timestamp value range, and outputs the input timestamp value as an output timestamp value when the timestamp value difference is out of the reference timestamp value range.

The invention is applicable to the technical field of artificial intelligence, and provides a data storage method based on a distributed storage system, a storage node and a medium, and the method comprises the steps: if a data storage instruction sent by a server is received, detecting whether the storage node meets a preset storage condition or not at present; if the current storage node does not meet the preset storage condition at present, obtaining the value of a preset influence factor in a preset statistical period corresponding to the current moment of each of other storage nodes in the same distributed storage system as the current storage node; determining the current total storage score values of the other storage nodes based on the values of the preset influence factors of theother storage nodes in the preset statistical period corresponding to the current moment; based on the current total storage score value of each other storage node, determining the target storage nodefrom all other storage nodes, and returning the identifier of the target storage node to the server, so that the computing resources of the server are greatly saved, and the data storage efficiency is improved.

The invention discloses a data storage method, equipment and system and aims to overcome the defects of long consumed time and low efficiency of copy-on-write operation executed on a file in a Base storage by a container in the prior art. In some feasible embodiments of the invention, the data storage method includes starting to create a copy of the file in a first container storage unit when the circumstance that the file stored in a Base storage unit is opened by application in a first container by a writable mode is detected; when the circumstance that write operation is performed on the file by the application in the first container is detected, acquiring update data of the file, and establishing and storing a data item according to the update data; when the circumstance that the copy of the file is created is detected, acquiring the update data of the file from the data item, and synchronizing the update data of the file into the copy of the file.

The invention relates to the field of artificial intelligence, time division is carried out on a to-be-processed data table, and to-be-processed data in a time division range is sequentially stored ina target database, so that the data query performance and the data storage efficiency of a system are improved. The invention relates to the field of data processing, in particular to a data processing method and device, computer equipment and a storage medium, and the data processing method comprises the steps: obtaining to-be-processed data, and distributing the to-be-processed data to a to-be-processed data table according to a preset distribution strategy; determining time segmentation information corresponding to the to-be-processed data table according to the acquisition time corresponding to the to-be-processed data and the data volume corresponding to the to-be-processed data table; and according to the time division information corresponding to the to-be-processed data table, determining a plurality of to-be-executed tasks corresponding to the to-be-processed data table, and executing the plurality of to-be-executed tasks so as to store the to-be-processed data in the to-be-processed data table into the target database. In addition, the invention also relates to a blockchain technology, and the to-be-processed data table can be stored in the blockchain.

The invention provides a self-adaptive geospatial grid indexing method, and relates to the technical field of indexing methods. The self-adaptive geospatial grid indexing method comprises a self-adaptive geospatial grid index establishing method and a method for carrying out spatial data retrieval by using a self-adaptive grid index. The self-adaptive geospatial grid index establishing method comprises the following steps: S1, dividing primary grids, namely uniformly dividing the whole geospatial grid into primary grids with the length and the width of S0 according to longitude and latitude, and correspondingly storing storage objects into the corresponding primary grids. According to the self-adaptive geospatial grid indexing method designed by the invention, the balance between the queryefficiency and the storage efficiency can be ensured, the advantages of a quadtree index and a grid index are integrated, the grid searching efficiency is improved, the method is particularly suitable for storing and retrieving offline data on vehicle-mounted equipment with limited computing performance and storage space, and the data storage and query efficiency of vehicle-mounted navigation isimproved.

The invention discloses a data storage method of a network cloud storage tool. The method comprises: a client logs in a network cloud storage tool, obtains a data file needing to be stored locally, and uploads a hash value of the file; a cloud storage server determines whether the data file is stored based on the hash value; if so, the client is notified not to carry out uploading and the operation is ended; and if not, the client is notified to upload the data file to the cloud storage server; and the cloud storage server carries out data block division on the data file based on a predetermined algorithm and stores the processed data.

The embodiment of the invention discloses a data sharing method, a device, an apparatus and a storage medium of a moving window. The method comprises the following steps of: determining a target shared object according to the object to be shared, wherein the target shared object is a key value pair structure, and the data type of the target value of the target shared object is an ancestor class Object type; taking the target context object corresponding to the target active window object as the function input parameter, calling the object to obtain the function through the data cache class, and obtaining the target data cache object corresponding to the target active window object one by one from the target mapping relation object; calling the data storage function in the target data cacheobject to store the target key and target value of the target shared object correspondingly to the target data object in the target data cache object. By adopting the technical proposal, the data sharing in the scope of the active window page in the Android system is more accurately and quickly realized, and the mutual influence of the shared data among the active window pages can be effectivelyavoided.

The invention relates to a seismic data storage technology, in particular to a method for improving storage efficiency of multi-azimuthal stratigraphic dip information. According to characteristics of the stratigraphic dip information, with byte as a unit, the multi-azimuthal stratigraphic dip information at one measuring point is compressed and stored in a combined way, so that the data storage space is significantly reduced on the premise of ensuring the dip data accuracy, the efficiencies of data transmission, data storage and data acquisition are improved, the storage and acquisition processes of the stratigraphic dip information are simplified, and a requirement on consistency of a two-dimensional seismic dip and a three-dimensional seismic dip is met.