143results about How to "Improve data storage efficiency" patented technology

The invention relates to a parallel data processing method based on a distributed structure. The storing comprises steps as follows: (1) a data master key value is extracted from master nodes according to types of master key values, directed slave nodes distributed by data are determined according to data attribute values and a section comparison result in the master nodes, and simultaneously, a global keyword B+ tree index is established; (2), the data are distributed to the slave nodes corresponding to the master key values according to the global keyword B+ tree index on the basis of a share-nothing principle; and (3), the slave nodes receive a data distributing request, and the data are stored in child nodes locally on the basis of the share-nothing principle. According to the method, an effective index mechanism is combined, and the storage and management efficiency of system data is improved; on one hand, the reasonable data distribution is guaranteed, the storage throughput of the slave nodes is reduced, the local query performance is improved, and the system flexibility is guaranteed by utilizing high expandability of the slave nodes; and on the other hands, local transcript safety is guaranteed through local duplication of multiple transcripts.

The invention discloses a website monitoring system and method applicable to a power industry. The system comprises an interaction layer, a data layer, a scheduling layer and a detection engine. The scheduling layer is used for scheduling the detection engine to carry out periodic automatic detection on tasks issued by users and summarizing detection results to the data layer after the detection is finished. The detection engine is used for receiving detection commands issued by the scheduling layer, detecting target websites, identifying Web security vulnerabilities, carrying out deep security physical examination on the website, monitoring website operation security states in real time, identifying the condition that a webpage is illegally tampered, malicious code is embedded into the webpage, a domain name is hijacked, an access page is refused and sensitive information occurs in the webpage, collecting internal security information on site by employing a vulnerability scanning device and a vulnerability detection tool, checking hidden vulnerabilities and deep security events, collecting website security physical examination results, website operation security state and onsite security checking results and transmitting the data to a database for storage.

A 3D NAND memory device is provided and includes: a substrate, a bottom select gate (BSG) disposed over the substrate, a plurality of word lines disposed above the BSG and having a stepped configuration, and a plurality of insulation layers disposed between the substrate, the BSG, and the plurality of word lines. In the disclosed memory device, one or more first dielectric trenches are formed in the BSG and extend along the length of the substrate to separate the BSG into a plurality of sub-BSGs. Further, one or more common source regions are formed over the substrate and extend in the lengthdirection of the substrate. One or more common source regions also extend through the BSG, the plurality of word lines, and the plurality of insulating layers.

The invention provides a data storage method and system and a data visiting method and system. The data storage method includes the following steps: obtaining file identifications of files to be stored and all objects under the files; taking the file identifications as keys, taking all the objects under the files as values to constitute key value pairs, and sending the key value pairs to a storage server corresponding to the keys; storing the key value pairs through the storage server. According to the data storage method, the file identifications and all the objects under the files are stored in a key value pair mode. Compared with a traditional transaction model storage method of a relation database, the data storage method is good in availability and partition expansibility, and high in data storage efficiency. Besides, the invention provides the data visiting method, a data storage system and a data visiting system.

The invention discloses a distributed storage method, which comprises the following steps: when a first block chain node in the block chain network initiates a transaction request, the first block chain node performs a consensus operation on the blocks carrying the transaction request, and broadcasts the blocks after the consensus operation to other block chain nodes in the block chain network; The remaining block chain nodes obtain transaction request data from the blocks after the common operation, and issues a creation, insertion or table query request through the intelligent contract initiation table to invoke the key-value pair interface and the storage engine to transmit the transaction request to the AMDB data proxy; The remaining block chain nodes execute corresponding database operation on the database according to the transaction request data through the AMDB data agent. The invention also discloses a distributed storage system and a device. The invention can improve the datastorage efficiency in the block chain and reduce the data update time.

This invention discloses a data storage method, a device and a data looking up, adding and deleting method to increase the data storage efficiency of TCAM list, in which, the data storage method includes: dividing data into several stages of sub-data according to the length of the data, setting up the corresponding relations among the sub-data, storing the sub-data and the corresponding relations in a three state content addressing storage list. This invented device includes: a splitting unit, a set up unit and a storage and control unit, said splitting unit is used in splitting data into several stages of sub-data based on the length of the data then sending them to the set up unit to set up the corresponding relations among the sub-data, said storage and control unit is used in storing the sub-data and the corresponding relations in a three-state content addressing storage list. This invention also provides an operation method for related TCAM list.

The invention discloses a system and a method for controlling the membrane-base reflecting mirror surface shape. The system comprises a standard reflecting mirror surface shape designing module, an emulational analyzing module, a reflecting mirror surface shape monitoring module, a fuzzy logic controlling module, a reflecting mirror surface shape controlling actuator and a reflecting mirror surface shape feeding back module. The aperture and the F number of a membrane-base reflecting mirror needed for design are used as the parameters and the Zernike polynomial coefficient form is adopted to determine the standard reflecting mirror surface shape parameter; the real-time membrane-base reflecting mirror surface shape is detected; the errors of the arc rises for the central cross sections of both a membrane-base reflecting mirror and a standard reflecting mirror are used as control variables, and the control variables are processed by a fuzzy logic controller; the voltage needed for forming the membrane-base reflecting mirror is outputted; and the membrane-base reflecting mirror surface shape is changed with the electrostatic method. The invention adopts the emulational reflecting mirror surface shape control analysis based on the finite-element analysis method to predict the reflecting mirror surface shape control effect, optimize the fuzzy control rule base and reduce the difficulty of designing the fuzzy logic controller. The method provides the technological base for the effective membrane-base reflecting mirror surface shape.

The invention discloses a data storage method and device, a data query method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a data storage requestwhich comprises a data identifier; obtaining to-be-stored data according to the data identifier; performing serialization processing on the to-be-stored data to obtain serialized json character strings, the serialized json character strings comprising N sub json character strings, and then performing one-to-one matching on each sub json character string and a preset fixed field in a target data table; finally writing the sub-json character string successfully matched with the fixed field into a list area corresponding to the fixed field; and writing the sub-json character string which fails tobe matched with the fixed field into a list area corresponding to the custom field in the target data table. According to the method, serialization processing is carried out on frequently-changed data, and then the json character string subjected to serialization processing is written into the list area corresponding to the self-defined field in the target data table, so that the data storage efficiency in the relational database is improved.

The embodiment of the present invention provides a method for constructing and mining a monitoring-oriented video map, equipment, by constructing graph database and key-value database as data persistence storage of knowledge map, the depth convolution neural network is used for face recognition automatically, greatly reducing the intensity of manual scrutiny, Using a combination of shared convolution neural network and deep deconvolution network to automatically label the attributes of pedestrian objects, the unstructured video data is converted into structured graph data storage, it can satisfy the character retrieval based on censorship surveillance video, Trajectory mining, group center mining and other security requirements, can efficiently query node attribute information, can effectively visualize the relationship between nodes, using backbone information database and detailed information database storage methods, play their respective advantages, data storage and retrieval efficiency is high.

The invention discloses a data storage method and device. The method comprises the following steps: receiving a data pack which is needed to be stored and transmitted from a data channel, judging whether enough residual space for storing the data pack to be stored is in a storage area corresponding to the data channel; if so, determining the storage information of the data pack, storing the data pack in the storage place of the storage area according to the indication of the storage information; if not, determining the number of data packs needed to deleted according to preset conditions, deleting the same number of data packs with earliest storage time in the storage area, and then executing the judgment operation. The data storage method and device can not generate fragment during the data storage process and increase the stability and efficiency of the data storage.

The embodiment of the invention provides a data processing method and device, an SMR storage system and a storage medium. The method comprises steps of obtaining a data writing instruction; determining a target object block of the target data to be written in in an SMR area of the target SMR disk according to the data writing instruction; generating target main index information and target standbyindex information for the target data and the target object block; writing the target data and the target standby index information into a target object block; writing the target main index information into a CMR area or other storage media; and writing database index information of the target data into other storage media, wherein the database index information of the target data comprises the target Unit key and the identifier of the target object block. Through the database index information, the main index information and the standby index information, the data writing sequence among thedata blocks in the SMR area is not limited, the operability of SMR disk data storage is improved, and the data storage efficiency is high.

The invention discloses a method and a device for storing data and belongs to the technical field of computers. The method comprises the following steps of: configuring an extensible two-dimensional data cache array into a local shared memory according to a preset configuration strategy, wherein the two-dimensional data cache array comprises a plurality of logic data blocks, and each logic data block comprises a plurality of subdata blocks used for storing the data; and loading data in a network storage device into the corresponding subdata blocks according to the business logic requirement. According to the method and the device for storing the data disclosed by the invention, through configuring the extensible two-dimensional data cache array into the local shared memory according to the preset configuration strategy, and loading the data in the network storage device into the corresponding subdata blocks of the two-dimensional data cache array according to the business logic requirement, local data storage is realized, and therefore, the efficiency of data storage and interaction can be improved. Moreover, as the two-dimensional data cache array for storing the data is extensible, the extendibility of a data structure is improved, and the business logic requirement can be met.

The invention discloses a relational database-based power grid CIM model data storage method. The method comprises the steps of (1) establishing class and attribute mapping; (2) establishing inter-class relationship mapping of a model; (3) establishing a data maintenance method; and (4) establishing a topology maintenance method. Through the method, object-oriented CIM model data is mapped into a relational database mode for storage, and the relational database mode is matched with a relational database used by most power systems at present, so that efficient storage is realized on the premise of ensuring CIM model data integrity, all power grid model data including a complex model object can be stored, the data storage and access efficiency is high, the standardability and maintainability of model data storage are well ensured, the extension is easy, and the maintenance efficiency of power grid resource data is improved.

The invention provides data storage and query methods and apparatuses, an electronic device and a readable storage medium. The calculation overhead of a cloud storage service provider and a user end can be greatly reduced; data privacy and query privacy of a user can be better protected; and the data query efficiency is improved. The data storage method comprises the steps of splitting a key nameand a key value of a key-value pair into a key name section and a key value section, and generating a unique random number to correspond to the key-value pair data; and associating the random number with the key name section and the key value section and sending the random number to a specified server for performing storage.

The embodiment of the invention provides a telescopic distributed resource description framework (RDF) data storage method and device. The method provided by the invention comprises the following steps: distributing all the RDF data into memory of at least two storage nodes to be stored; backing up data in the memory of each first storage node into a persistent memory of a second storage node, wherein the first storage node and the second storage node are any one storage node of at least two storage nodes, and the second storage node is adjacent to the first storage node. By adopting the telescopic distributed RDF data storage method and device which are provided by the embodiment of the invention, data storage and query efficiency can be improved, and data can be rapidly restored locally from the adjacent storage node of the storage node when one storage node is failure, so that a data storage and query service is continuously provided.

The embodiment of the invention provides a data processing method and device and a mobile terminal, wherein the request end adds a reserved field in the to-be-stored data, constructs the to-be-storeddata into the target data and sends the target data to a storage end, the storage end distributes a memory to cache the target data, generates the data metadata of the to-be-stored data in the targetdata and writes the data metadata into a memory position corresponding to the reserved field in the distributed memory. According to the embodiment of the invention, the zero data copy is realized, the data storage efficiency is ensured, and the system performance is improved.

There is provided a timestamp value controlling apparatus that can improve storage efficiency of data as maintaining quality of data. In the apparatus, a timestamp value difference calculating section 103 obtains a timestamp value difference indicating a difference between an input timestamp value and a previous timestamp value timestamp value. A judging section 104 judges whether the timestamp value difference is within a reference timestamp value range in which a predetermined permissible range is added to the reference frame interval value. The outputting and selecting section 105 outputs a value, which is obtained by adding the reference frame interval value to the previous timestamp value, as an output timestamp value when the timestamp value difference is within a reference timestamp value range, and outputs the input timestamp value as an output timestamp value when the timestamp value difference is out of the reference timestamp value range.

The invention is applicable to the technical field of artificial intelligence, and provides a data storage method based on a distributed storage system, a storage node and a medium, and the method comprises the steps: if a data storage instruction sent by a server is received, detecting whether the storage node meets a preset storage condition or not at present; if the current storage node does not meet the preset storage condition at present, obtaining the value of a preset influence factor in a preset statistical period corresponding to the current moment of each of other storage nodes in the same distributed storage system as the current storage node; determining the current total storage score values of the other storage nodes based on the values of the preset influence factors of theother storage nodes in the preset statistical period corresponding to the current moment; based on the current total storage score value of each other storage node, determining the target storage nodefrom all other storage nodes, and returning the identifier of the target storage node to the server, so that the computing resources of the server are greatly saved, and the data storage efficiency is improved.

The invention discloses system and method for reading load spectrum actual measuring experimental data. The system comprises a data acquisition device and a computer, wherein the data acquisition device is used for acquiring load spectrum actual measuring data and storing the load spectrum actual measuring data in a data storage card; and the computer is connected with the data acquisition device and is used for reading the data from the data storage card according to the storage strategy and storing the read data into a data file with the designated format to be used by the load spectrum actual measuring experimental data processing system. The invention has high actual value for reading the load spectrum actual measuring data in the actual engineering test and achieves the aim and the requirement of improving the data storage efficiency and flexibly reading.

The invention discloses a data storage method, equipment and system and aims to overcome the defects of long consumed time and low efficiency of copy-on-write operation executed on a file in a Base storage by a container in the prior art. In some feasible embodiments of the invention, the data storage method includes starting to create a copy of the file in a first container storage unit when the circumstance that the file stored in a Base storage unit is opened by application in a first container by a writable mode is detected; when the circumstance that write operation is performed on the file by the application in the first container is detected, acquiring update data of the file, and establishing and storing a data item according to the update data; when the circumstance that the copy of the file is created is detected, acquiring the update data of the file from the data item, and synchronizing the update data of the file into the copy of the file.

The method for managing flash memory data includes the following steps. When data are first transmitted from a host and the address for the data indicates a temporary address, then temporary data are retrieved from the temporary address to an external buffer. A writing command is then executed and the temporary data having a destination address are written to a flash buffer. When the buffer of the flash memory is not full, the buffer data are written into a temporary block. The method of writing the buffer data into the temporary block includes using a address changing command, or executing a writing command to rewrite the external buffer data to the flash buffer so that the data are written into the temporary block.

The invention discloses a business processing method based on Flash. A Flash storage space is divided into a plurality of logic partition zones which store at least one type of data record; a storagespace occupied by each data record is used as a virtual sector and each virtual sector is provided with a virtual sector distribution table; each sector distribution table comprises a business ID usdfor marking the business type and a business mark used for marking whether the marking data record belongs to data in the business or not. the method comprises the following steps: when the data record is written to physical zone blocks of the logic partition zones, firstly judging whether the data record is independent data or data in the business; and setting the business ID and the value for marking the business according to the judgment result. By adding information related with business processing in the virtual sector distribution table, the efficiency of the data in the same business can be kept consistent, thereby solving the problem of data inconsistency.

The present invention discloses a data processing method based on a cloud computing non-database architecture. The method is applied to an intelligent wearable device, discards the database as an intermediate layer, and directly uses the cloud computing service standing cache and object storage services for data exchange with the intelligent terminal. At the same time, a data mining system runningautomatically with a certain period is designed for data analysis. The data processing method does not affect the performance of the overall scheme since the method does not directly exchange data with the intelligent terminal; and the data processing method has higher scalability, can adapt to the rapid increase of the number of terminal devices, and greatly reduces the maintenance cost.

The invention relates to the field of artificial intelligence, time division is carried out on a to-be-processed data table, and to-be-processed data in a time division range is sequentially stored ina target database, so that the data query performance and the data storage efficiency of a system are improved. The invention relates to the field of data processing, in particular to a data processing method and device, computer equipment and a storage medium, and the data processing method comprises the steps: obtaining to-be-processed data, and distributing the to-be-processed data to a to-be-processed data table according to a preset distribution strategy; determining time segmentation information corresponding to the to-be-processed data table according to the acquisition time corresponding to the to-be-processed data and the data volume corresponding to the to-be-processed data table; and according to the time division information corresponding to the to-be-processed data table, determining a plurality of to-be-executed tasks corresponding to the to-be-processed data table, and executing the plurality of to-be-executed tasks so as to store the to-be-processed data in the to-be-processed data table into the target database. In addition, the invention also relates to a blockchain technology, and the to-be-processed data table can be stored in the blockchain.

The invention provides a self-adaptive geospatial grid indexing method, and relates to the technical field of indexing methods. The self-adaptive geospatial grid indexing method comprises a self-adaptive geospatial grid index establishing method and a method for carrying out spatial data retrieval by using a self-adaptive grid index. The self-adaptive geospatial grid index establishing method comprises the following steps: S1, dividing primary grids, namely uniformly dividing the whole geospatial grid into primary grids with the length and the width of S0 according to longitude and latitude, and correspondingly storing storage objects into the corresponding primary grids. According to the self-adaptive geospatial grid indexing method designed by the invention, the balance between the queryefficiency and the storage efficiency can be ensured, the advantages of a quadtree index and a grid index are integrated, the grid searching efficiency is improved, the method is particularly suitable for storing and retrieving offline data on vehicle-mounted equipment with limited computing performance and storage space, and the data storage and query efficiency of vehicle-mounted navigation isimproved.

The invention discloses a data storage method of a network cloud storage tool. The method comprises: a client logs in a network cloud storage tool, obtains a data file needing to be stored locally, and uploads a hash value of the file; a cloud storage server determines whether the data file is stored based on the hash value; if so, the client is notified not to carry out uploading and the operation is ended; and if not, the client is notified to upload the data file to the cloud storage server; and the cloud storage server carries out data block division on the data file based on a predetermined algorithm and stores the processed data.

The embodiment of the invention discloses a data sharing method, a device, an apparatus and a storage medium of a moving window. The method comprises the following steps of: determining a target shared object according to the object to be shared, wherein the target shared object is a key value pair structure, and the data type of the target value of the target shared object is an ancestor class Object type; taking the target context object corresponding to the target active window object as the function input parameter, calling the object to obtain the function through the data cache class, and obtaining the target data cache object corresponding to the target active window object one by one from the target mapping relation object; calling the data storage function in the target data cacheobject to store the target key and target value of the target shared object correspondingly to the target data object in the target data cache object. By adopting the technical proposal, the data sharing in the scope of the active window page in the Android system is more accurately and quickly realized, and the mutual influence of the shared data among the active window pages can be effectivelyavoided.

The invention discloses a data exchange method, which comprises the following steps of: preprocessing extracted data according to a storage format of a target database, and mapping the preprocessed data to a temporary database in a memory by adopting a memory mapping mode; cleaning and converting the data in the temporary database by adopting a multi-core and multi-thread mode, and storing the cleaned and converted data into a temporary target database in a memory; mapping the temporary database in the memory to the target database for storage in a memory mapping mode, and the problem that thesystem memory cannot be effectively used in the prior art is solved.

The invention relates to a seismic data storage technology, in particular to a method for improving storage efficiency of multi-azimuthal stratigraphic dip information. According to characteristics of the stratigraphic dip information, with byte as a unit, the multi-azimuthal stratigraphic dip information at one measuring point is compressed and stored in a combined way, so that the data storage space is significantly reduced on the premise of ensuring the dip data accuracy, the efficiencies of data transmission, data storage and data acquisition are improved, the storage and acquisition processes of the stratigraphic dip information are simplified, and a requirement on consistency of a two-dimensional seismic dip and a three-dimensional seismic dip is met.