765results about How to "Improve query speed" patented technology

The invention discloses a time series data storage method and apparatus, a time series data query method, apparatus and system, and an electronic device. The time series data storage method comprises the steps of acquiring to-be-stored time series data as original time series data, wherein attributes of the original time series data include a data identifier attribute, a time attribute and a data value attribute; performing statistics processing on the original time series data with the same data identifiers and the time in a preset time interval according to at least one preset time interval, forming a time series data statistics value of at least one time granularity based on the same data identifiers, and storing the original time series data and the time series data statistics values of all the time granularities in a distributed database. By adopting the method, the data storage amount can be effectively reduced, so that the effects of saving storage space and increasing data query speed are achieved; and the time series data is stored in the distributed database, so that the extensibility of the storage space can be effectively improved.

The invention provides a multi-dimensional interval query method based on cloud computing. The method includes the steps of index construction and multi-dimensional interval data query. The index construction step includes: automatically constructing and storing a distributed grid file index and metadata according to an externally entered index construction command. The multi-dimensional interval data query step includes: positioning a data block to be read, according to an externally entered query command and on the basis of the distributed grid file index and metadata, and automatically and evenly distributing reading requests to nods of a server cluster, parallelly processing query requests in the system, parallelly acquiring all query results, and collecting the results before returning to users. The invention further provides a multi-dimensional interval query system based on the distributed grid file index.

The invention provides a method and a device for searching and processing a log file and relates to the field of log management, aiming at solving the technical problem that the speed of record searching in the log file in the prior art is lower. The method for searching the log file comprises the following steps: the device for searching the log file obtains at least one type of index value to be searched; the device for searching the log file searches the serial number of at least one record corresponding to the index value to be searched according to an index file, wherein the index file comprises at least one type of index value and the serial number of at least one record corresponding to the index value; the device for searching the log file obtains the record corresponding to the index value to be searched from the log file according to the serial number of the searched record; and the log file comprises at least one record and the serial number of the record. The invention can enhance the speed of record searching in the log file.

The invention relates to the communication network technology field and discloses a method and a device for data storage and data query, enhancing the speed of storing and querying the data. According to the technical scheme provided by embodiments of the invention, to-be-stored data is obtained by a cloud storage device, is uniformly distributed to cloud-storage data nodes and is stored in parallel to a cloud-storage distributed database. An index column inputted by a user is obtained by the cloud storage device, and a query instruction is generated according to the index column. The query instruction is transmitted to the cloud-storage data nodes, and data is queried in parallel in the cloud-storage distributed database. The collection of query results of all the cloud-storage nodes is transmitted to the user. The technical scheme provided by the embodiments of the invention is suitable to be used during data storage and data query.

The invention belongs to the field of data processing for large graphs and relates to a generation and search method for reachability chain list of a directed graph in the parallel environment. The method includes distributing the directed graph to every processor which stores nodes in the graph and sub-nodes corresponding to the nodes; compressing graph data split to the processors; calculating a backbone node reachability code of a backbone graph; building a chain index; building a skip list on the chain index; allowing data communication among the processors; allowing each processor to send skip list information to other processors; allowing each processor to upgrade own skip list information; and building a reachability index of a total graph. Through use of graph reachability compression technology in the parallel environment, the size of graph data is greatly reduced, system computing load is reduced, and a system can process the graph data on a larger scale. The method has the advantages that the speed of reading data from a disk is higher, search speed is indirectly increased, accuracy of search results is guaranteed, and network communication cost and search time are reduced greatly for a parallel computing system during searching.

The invention discloses an image retrieval system integrating classification with hash partitioning, which comprises a downloading module, a classification module training module, an image classification module, a characteristic extraction module, a recording table building module, a partitioning module, a request processing module, a retrieval module, a similarity acquiring module and a result returning module. The downloading module is used for downloading images so as to build an image library, the classification model training module classifies the images in the image library according tothe shapes and selects representative sample images from the image library to form a sample library firstly, then extracts characteristic descriptors of the classification bottom layer of all images in the sample library and performs trainings on the characteristic descriptors of the classification bottom layer by a support vector machine so as to obtain discriminant of each classification. Classification models are formed according to the discriminants of all the classifications. Precision ratio of the image retrieval system is increased, the problem of low recall ratio during classificationmistakes is overcome, and the retrieval speed of the image retrieval system is increased integrally.

The invention discloses a data storage method and device and a data query method and device. The method comprises the following steps of: combining the dimensions of index data to obtain a plurality of dimension combinations, wherein the index data corresponds to a plurality of dimensions; independently calculating the index data corresponding to each dimension combination of the plurality of dimension combinations; and storing the index data corresponding to each dimension combination of the plurality of dimension combinations to enable to inquire the index data corresponding to the dimension combination to be queried from stored data when data query is carried out by the dimension combination. By use of the method, the technical problem of long query time in a dimension combination query process of a plurality of dimensions is solved.

The invention discloses a device and a method for compression storing data and searching rapidly. At present, processing prefix search to dictionary uses Trie tree (character tree) generally, a character is stored in each node of the character tree which causes great waste of space. The character Trie tree is improved to character series Trie tree that reduces space waste efficiently. The node content in the character series Trie tree is compression processed in a system that has strict memory requirement, and a compression arithmetic is given. The invention can be used in a mobile store device with strict memory space requirement and can embodiment excellent of the method in condition of mass dictionary data. In addition, the device can be used for Suggest function of a search interface of the present internet, existing examination and (KEY, VALUE) type inquire function.

The embodiment of the application discloses a data storage method, a querying method and a device, the data storage method includes the following steps: obtaining a source data table, and splitting the source data table according to a column structure; grouping data of each column to obtain a plurality of data packets, and marking knowledge information for each one of the data packets; storing a plurality of data packets and the knowledge information of each data packet. In the embodiment of the application, the column data is stored with granularity of the data packet, and a local bitmap associated index is built with granularity of the data packet, the data packet is considered as a minimum I/O unit, so disk space can be saved while storing data, and data querying speed is correspondingly improved.

The invention relates to an index-based computer continuous data protection method and belongs to the technical field of computer data storage and protection. Metadata of a data block comprises a data block identification, a timestamp and a storage pool address; an internal memory at a server side is internally provided with two buffer queues and an identification index table; a journal file is set up on a hard disk; after the data block is received by a storage pool, duplicate removal treatment is carried out; the metadata is stored and written into the storage area of one buffer queue by the server side according to the identification index table and the data block identification; if the storage area is full after the metadata is written up, the metadata in the storage area can be written into the journal file, and the identification index table is updated; and the following metadata can be written into the storage area of the other buffer queue. The method provided by the inventioncan be used for caching the metadata by the virtue of two buffer queues, thus preventing a system from being blocked; the identification index table and the journal file are set up, so that the queryspeed of the metadata is accelerated; and furthermore, the storage pool of the server side can be used for carrying out duplicate removal treatment on the data block, so that the storage space can besaved.

The invention, which belongs to the technical field of construction of an urban three-dimensional model, especially relates to a dense-point-cloud-based rapid construction method of an urban three-dimensional model. With the method, technical problems of low efficiency and the like in the prior art can be solved. The dense-point-cloud-based rapid construction method comprises: A, carrying out adaptive blocking on point cloud data; B, carrying out three-dimensional TIN model construction on the divided blocks; C, selecting an image with the best quality from a multi-view slanted image for each surface of the three-dimensional TIN model and using the image as a texture data source; D, after selection of the texture data sources with the best qualities, carrying out texture extraction; E, carrying out substitution of textures of shielded parts to complete vulnerability repairing of the textures; and F, pasting the preferably selected textures to the surface of the three-dimensional TIN model to generate a three-dimensional model with a lifelike effect. The method has advantages: firstly, the construction efficiency is high; and secondly, the texture quality is improved and the lifelike effect is realized.

The invention relates to a database data fragmentation storage method, comprising the following steps of: generating a plurality of sub-tables corresponding to each data table stored in a database host, wherein data of all the sub-tables corresponding to each data table covers the corresponding data table, and the data in the sub-tables is not overlapped; storing the sub-tables corresponding to each data table stored in the database host to a plurality of database standby machines, so that the data table with the corresponding sub-tables distributed to the database standby machines exists in the data tables stored in the database host; and maintaining distribution information, in the database standby machines, of the sub-tables of each data table in the database host. According to the method, the response speed of a data reading request is increased. In addition, a database data fragmentation storage apparatus is further provided and a data fragmentation storage based database data query method and apparatus are provided.

The invention brings forward a data query method and system based on Key-Value data blocks. The method comprises following steps: selecting dimensions of data aggregation based on attributes of perception data, clustering perception data of the same attribute dimension in common, saving perception data to a same data block and utilizing selected data dimensions as attribute information corresponding to data blocks; adopting Key-Value data format to save and manage data in the data blocks; and saving and managing storage positions and corresponding attribute information by adopting a relational database. The data query method and system based on Key-Value data blocks has following beneficial effects: a deluge of perception data on the Internet of Things can be read and written in an efficient manner without using a great number of computers; and the data block is easy to expand according to business scale.

The invention provides a method and a device for storing data, and belongs to the technical field of databases. The method includes that enabling a storage device to acquire data records to be stored; determining attribute fields which meet preset conditions in the data records; using the attribute fields which meet the preset conditions as prefixes Head of the row keys Rowkey in a database HBase; storing the row keys Rowkey in the database HBase. The method and the device have the advantages that the row keys Rowkey in the database HBase can be set and stored according to the preset conditions, so that the data query speed can be increased, the retrieval efficiency can be improved, and time consumption can be reduced.

The embodiment of the invention provides a geographic information data processing method and device. The geographic information data processing method comprises the following steps: acquiring geographic latitude and longitude coordinates of a spatial entity object to be inquired, and converting the geographic latitude and longitude coordinates into corresponding grid codes; inquiring grid elements in a database by use of the converted grid codes, and determining at least one object identifier corresponding to the grid codes, wherein corresponding relationships between the grid codes and the corresponding object identifiers are stored in the grid elements; inquiring an object table according to the determined object identifiers to obtain attribute information of objects identified by the corresponding object identifiers, wherein the object identifiers and the attribute information of the corresponding objects are stored in the object table; and determining attribute information of the spatial entity object to be inquired from the obtained attribute information of the objects. According to the embodiment of the invention, spatial inquiry conditions are converted into numerical matching of the grid codes, so that the effect of efficiently and accurately acquiring result data of geographic information data operation is achieved.

This invention discloses a kind of server load balancing method. It can realize load balancing based on server weight value and probability statistics theory. The technical project is: making sure the corresponding relation of the servers in server group and the distribution range that complied with the first presetting rule. When there is a new service request enters, it generats a random number and determines one located distribution range of this random number. Then it determines the dispatched server according to the determined one located distribution range and its corresponding relation and forwards the access request to this server. This invention can make sure the rapid load balancing dispatching speed and make the high weight value server providing more access service statistically, so to realize high-powered network transmission.

The invention discloses a method and a device for quickly inquiring and calculating a MangoDB cluster, which is applied to computers, communication and associated fields. The method comprises the following steps of S1, determining a query condition, wherein the query condition is used for inquiring subgroup summary data of a designated subgroup corresponding to the query condition in a designated data list of all fragments of MongoDB; S2, inquiring the designated data list according to the query condition, and acquiring data in the designated subgroup corresponding to the query condition; S3, storing the data into a first temporary data cache table on a server; and S4, carrying out subgroup query on the data in the first temporary data cache table and calculating a query result. According to the method, an original fragment query way is improved to a query way on one server, so that the query speed is greatly improved on the premise of guaranteeing the accuracy of the query result.

The invention relates to a method for acquiring position information in real time based on GPS (Global Positioning System) data, relating to a method for intelligently navigating and positioning by a computer. In the method, a navigation center processing method comprises the following steps of: performing grid division to an electronic map; establishing POI (Point of Interest) point records for all grids; establishing sub-area records for various grid regions; establishing administering relation trees for sub-areas of various grid regions; receiving the position information of inquiring points; acquiring POI point records of the grid and peripheral grids where the inquiring points are, and the sub-area records of the minimal grid region corresponding to the grid where the inquiring points are; judging whether POI points are existed besides the inquiring points, if so, calculating the distance between the inquiring points and the POI point and re-transmitting the result and description of the POI point; if not, acquiring the minimal grid region corresponding to the grid of the inquiring points and the names of all dormant regions depending on the administering relation, thereby obtaining place name describing statement for re-transmission. The method in the invention is rapid in inquiring speed, and clear and direct in position information.

The invention discloses a file synchronous storage and access system based on a cloud server and a method therefor. The file synchronous storage and access system comprises a barcode sweeping gun, a scanner, a barcode printer and a plurality of file cabinets, the barcode sweeping gun is used for scanning a two-dimension barcode on one side surface of a file box storing paper files and sending collected two-dimension barcode information into a collection management terminal; the two-dimension barcode is an ID number; the scanner is used for scanning the paper files in the file box page by page and sending scanned images into the collection management terminal; the barcode printer is used for printing the two-dimension barcode on the file box according to a command from the collection management terminal; the file cabinets are used for storing the paper files and capable of serving the function of locating files to a book according to a command from the collection management terminal, and indicator lights are arranged on the file cabinets. The file synchronous storage and access system is capable of managing paper files and electronic files synchronously; in normal cases, desired information is obtained from the electronic files, instead of repeatedly accessing the paper files, so that the work efficiency is improved, and the work process is standardized.

The invention discloses a mass event processing method and device. The method comprises that an event processing engine stores received event data in different time ranges according to preset time range segmenting rules into the time segment data table corresponding to every segment time period in a multi-threading mode; according to a time range input by a user, an event query engine queries corresponding event data in the corresponding time segment data table in the segment time period contained in the time range. The mass event processing method can improve the query speed without reducing the storage speed of events and meanwhile basically does not increase disc space occupation.