766results about How to "Improve query speed" patented technology

The invention discloses a time series data storage method and apparatus, a time series data query method, apparatus and system, and an electronic device. The time series data storage method comprises the steps of acquiring to-be-stored time series data as original time series data, wherein attributes of the original time series data include a data identifier attribute, a time attribute and a data value attribute; performing statistics processing on the original time series data with the same data identifiers and the time in a preset time interval according to at least one preset time interval, forming a time series data statistics value of at least one time granularity based on the same data identifiers, and storing the original time series data and the time series data statistics values of all the time granularities in a distributed database. By adopting the method, the data storage amount can be effectively reduced, so that the effects of saving storage space and increasing data query speed are achieved; and the time series data is stored in the distributed database, so that the extensibility of the storage space can be effectively improved.

The invention provides a multi-dimensional interval query method based on cloud computing. The method includes the steps of index construction and multi-dimensional interval data query. The index construction step includes: automatically constructing and storing a distributed grid file index and metadata according to an externally entered index construction command. The multi-dimensional interval data query step includes: positioning a data block to be read, according to an externally entered query command and on the basis of the distributed grid file index and metadata, and automatically and evenly distributing reading requests to nods of a server cluster, parallelly processing query requests in the system, parallelly acquiring all query results, and collecting the results before returning to users. The invention further provides a multi-dimensional interval query system based on the distributed grid file index.

The invention discloses a processing method and device of a search request on the basis of a search engine. The processing method of the search request on the basis of the search engine comprises the following steps: receiving a current search term input by a user; selecting the search terms used by the user from a historical search log, and obtaining at least one candidate search term corresponding to the current search term; taking a historical search term set and search behavior information in the historical search log as training samples to carry out off-line training, and establishing a prediction model of user behaviors; using the prediction model to carry out correlation checkout of the candidate search terms and the user behaviors on the candidate search terms corresponding to the current search term; and according to the correlation checkout, taking the candidate search terms which meet a set condition as recommended search terms corresponding to the current search term, and generating a recommended search term set corresponding to the current search term. The technical problem of inaccurate search results can be solved.

The invention discloses a method and a device for matching a longest prefix. The method comprises the following steps: A, reading a search node; B, determining whether the offset domain of the read search node indicates that an upper node has the matched prefix or not, adding the offset domain of the search node to a pointer pointing to a leaf node array in the upper node if the upper node has the matched prefix, updating the current best matching pointer and executing the step C, and executing the step C if the upper node has no matched prefix; C, determining whether the search node has the leaf node or not while determining corresponding bit matching of branch indication domain and search key words of the search node; D, reading the internal bitmap of the search node while determining that the search node does not have the leaf node, computing the longest matching prefix existing in the search node according to the internal bitmap and the pointer pointing to the leaf node array in the search node, updating the current best matching pointer, and computing the address of the leaf node corresponding to the current best matching pointer. The method can improve the search speed.

The invention provides a method and a device for searching and processing a log file and relates to the field of log management, aiming at solving the technical problem that the speed of record searching in the log file in the prior art is lower. The method for searching the log file comprises the following steps: the device for searching the log file obtains at least one type of index value to be searched; the device for searching the log file searches the serial number of at least one record corresponding to the index value to be searched according to an index file, wherein the index file comprises at least one type of index value and the serial number of at least one record corresponding to the index value; the device for searching the log file obtains the record corresponding to the index value to be searched from the log file according to the serial number of the searched record; and the log file comprises at least one record and the serial number of the record. The invention can enhance the speed of record searching in the log file.

The invention relates to the communication network technology field and discloses a method and a device for data storage and data query, enhancing the speed of storing and querying the data. According to the technical scheme provided by embodiments of the invention, to-be-stored data is obtained by a cloud storage device, is uniformly distributed to cloud-storage data nodes and is stored in parallel to a cloud-storage distributed database. An index column inputted by a user is obtained by the cloud storage device, and a query instruction is generated according to the index column. The query instruction is transmitted to the cloud-storage data nodes, and data is queried in parallel in the cloud-storage distributed database. The collection of query results of all the cloud-storage nodes is transmitted to the user. The technical scheme provided by the embodiments of the invention is suitable to be used during data storage and data query.

The invention belongs to the field of data processing for large graphs and relates to a generation and search method for reachability chain list of a directed graph in the parallel environment. The method includes distributing the directed graph to every processor which stores nodes in the graph and sub-nodes corresponding to the nodes; compressing graph data split to the processors; calculating a backbone node reachability code of a backbone graph; building a chain index; building a skip list on the chain index; allowing data communication among the processors; allowing each processor to send skip list information to other processors; allowing each processor to upgrade own skip list information; and building a reachability index of a total graph. Through use of graph reachability compression technology in the parallel environment, the size of graph data is greatly reduced, system computing load is reduced, and a system can process the graph data on a larger scale. The method has the advantages that the speed of reading data from a disk is higher, search speed is indirectly increased, accuracy of search results is guaranteed, and network communication cost and search time are reduced greatly for a parallel computing system during searching.

The invention discloses an image retrieval system integrating classification with hash partitioning, which comprises a downloading module, a classification module training module, an image classification module, a characteristic extraction module, a recording table building module, a partitioning module, a request processing module, a retrieval module, a similarity acquiring module and a result returning module. The downloading module is used for downloading images so as to build an image library, the classification model training module classifies the images in the image library according tothe shapes and selects representative sample images from the image library to form a sample library firstly, then extracts characteristic descriptors of the classification bottom layer of all images in the sample library and performs trainings on the characteristic descriptors of the classification bottom layer by a support vector machine so as to obtain discriminant of each classification. Classification models are formed according to the discriminants of all the classifications. Precision ratio of the image retrieval system is increased, the problem of low recall ratio during classificationmistakes is overcome, and the retrieval speed of the image retrieval system is increased integrally.

The invention discloses a method and a system for carrying out multi-dimensional regional inquiry on a distribution type sequence table. The method comprises the following steps of: respectively establishing a sheet of corresponding secondary index table for each index list of the distribution type sequence table, and the principal linkage of the corresponding secondary index table of each index list is a combination value of an index list value, the principal linkage of the distribution type sequence table, and the length of the index list value; and when a regional inquiry request is received, according to the field name of the inquiry request, searching a corresponding secondary index table of the field name from each secondary index table, according to the field value of the inquiry request, searching a record position corresponding to the field value of the inquiry request from a corresponding secondary index table, and directly reading corresponding data from the record position of the distribution type sequence table. According to the method and the system, a multi-dimensional regional inquiry speed can be greatly accelerated, and the requirements on high performance, low storage cost and high reliability can be met at the same time.

The invention discloses a data storage method and device and a data query method and device. The method comprises the following steps of: combining the dimensions of index data to obtain a plurality of dimension combinations, wherein the index data corresponds to a plurality of dimensions; independently calculating the index data corresponding to each dimension combination of the plurality of dimension combinations; and storing the index data corresponding to each dimension combination of the plurality of dimension combinations to enable to inquire the index data corresponding to the dimension combination to be queried from stored data when data query is carried out by the dimension combination. By use of the method, the technical problem of long query time in a dimension combination query process of a plurality of dimensions is solved.

The invention discloses a device and a method for compression storing data and searching rapidly. At present, processing prefix search to dictionary uses Trie tree (character tree) generally, a character is stored in each node of the character tree which causes great waste of space. The character Trie tree is improved to character series Trie tree that reduces space waste efficiently. The node content in the character series Trie tree is compression processed in a system that has strict memory requirement, and a compression arithmetic is given. The invention can be used in a mobile store device with strict memory space requirement and can embodiment excellent of the method in condition of mass dictionary data. In addition, the device can be used for Suggest function of a search interface of the present internet, existing examination and (KEY, VALUE) type inquire function.

The embodiment of the application discloses a data storage method, a querying method and a device, the data storage method includes the following steps: obtaining a source data table, and splitting the source data table according to a column structure; grouping data of each column to obtain a plurality of data packets, and marking knowledge information for each one of the data packets; storing a plurality of data packets and the knowledge information of each data packet. In the embodiment of the application, the column data is stored with granularity of the data packet, and a local bitmap associated index is built with granularity of the data packet, the data packet is considered as a minimum I / O unit, so disk space can be saved while storing data, and data querying speed is correspondingly improved.

The invention provides a natural expression information processing method. The natural expression information processing method includes identifying natural expression information from users to acquire natural expression in the form of characters, and transforming the identified natural expression into standard expression in the form of codes. According to the natural expression information processing method, ruleless natural expression information can be transformed into encoded standard expression; transformation of the standard expression refers to transformation from semanteme of the natural expression to the codes, and no accurate language translation is needed, so that accuracy requirements of machine translation can be reduced, complexity of databases used for expression transformation (machine translation) is lowered, data inquiry and update speeds are increased, and performance of intelligent processing is improved; in addition, by simple encoded expression, workload for human-assisted intervention can be reduced.

The invention relates to an index-based computer continuous data protection method and belongs to the technical field of computer data storage and protection. Metadata of a data block comprises a data block identification, a timestamp and a storage pool address; an internal memory at a server side is internally provided with two buffer queues and an identification index table; a journal file is set up on a hard disk; after the data block is received by a storage pool, duplicate removal treatment is carried out; the metadata is stored and written into the storage area of one buffer queue by the server side according to the identification index table and the data block identification; if the storage area is full after the metadata is written up, the metadata in the storage area can be written into the journal file, and the identification index table is updated; and the following metadata can be written into the storage area of the other buffer queue. The method provided by the inventioncan be used for caching the metadata by the virtue of two buffer queues, thus preventing a system from being blocked; the identification index table and the journal file are set up, so that the queryspeed of the metadata is accelerated; and furthermore, the storage pool of the server side can be used for carrying out duplicate removal treatment on the data block, so that the storage space can besaved.

The invention belongs to the computer field, in particular relating to a method for processing mass data loading and inquiry. The invention uses a temporary list with proper granularity to buffer data of various time slices; no index is established on the temporary list or a master key index is established on the temporary list; after the data of various time slices is processed, indexes are established unitarily for the data of the time slices and then the data is transferred to a partition table. The method for processing mass data loading and inquiry improves the inquiry speed by combination of the data of the partition list according to business requirements, is only related to the data quantity in the buffer time slices and can meet the high-speed mass data loading environment and the business requirements provided with related inquiries.

The invention is suitable for the technical field of file processing and provides a dynamically adaptive LSM (Log-structured merge) tree combination method. The method comprises: dividing a key value interval into a plurality of nodes and organizing the nodes into a treelike structure, wherein each node corresponds to a key value interval and each key value interval contains a file corresponding to a key value interval range; dynamically adjusting the shape of a tree according to distribution of current data; when a newly written file exists, traversing the tree to look for an optimal node and putting the file into the node; and when the file is processed, performing Minor Compact processing on the interior of the node and executing Major Compact through a leaf node. The invention further correspondingly provides a dynamically adaptive LSM tree combination system realizing the method. Therefore, the dynamically adaptive LSM tree combination method and system can realize dynamic adaption to data distribution and improve data combination efficiency.

The invention relates to an ultra-large capacity time division and wavelength division fiber grating sensing system and a query method of the fiber grating sensing system. The ultra-large capacity time division wavelength division fiber grating sensing system consists of a broadband light source, a modulation module, a circulator, a fiber Bragg grating sensing array, a sampling module, a wavelength demodulation instrument and a data processing computer, wherein the modulation module and the sampling module comprise a SOA high-speed photoelectric switch respectively and are driven by different channels of the same signal generator, and a phase difference exists between two drive pulses; and the fiber Bragg grating sensing array can be composed of identical fiber gratings or multi-wavelength fiber gratings. With the adoption of a technology combining a time division multiplexing with a wavelength division multiplexing, tens of thousands of gratings can be engraved on an optical fiber. The ultra-large capacity time division and wavelength division fiber grating sensing system has characteristics of large system capacity, high response speed, good expandability, high flexibility, good stability, low cost and the like, can perform dynamic measurement and static measurement at the same time, and can satisfactorily meet requirements of internet of things on information capacity.

The invention discloses a method and a system for data increment backup of a sensing layer of the Internet of Things. The method comprises the following steps of: distributing a unique node clustered index Node_ID to every sensor, and automatically distributing a unique data clustered index Index_ID during detection data generation of every sensor; searching an incremental log index tree with the node clustered index Node_ID as a key to obtain a node of the corresponding sensor on the incremental log index tree, and updating according to the comparison results of two groups of recent detection data of every node, wherein an AVL (approve vendor list) structure is adopted by the incremental log index tree; searching a data log index tree with the data clustered index Index_ID as a key to obtain a node of the corresponding sensor on the data log index tree, and writing detection data into a data log file, wherein a B plus structure is adopted by the data log index tree. Online backup can be performed during operation, continuous operation of the Internet of Things can be ensured, and the speed of inquiry of data increments can be improved greatly.

The invention, which belongs to the technical field of construction of an urban three-dimensional model, especially relates to a dense-point-cloud-based rapid construction method of an urban three-dimensional model. With the method, technical problems of low efficiency and the like in the prior art can be solved. The dense-point-cloud-based rapid construction method comprises: A, carrying out adaptive blocking on point cloud data; B, carrying out three-dimensional TIN model construction on the divided blocks; C, selecting an image with the best quality from a multi-view slanted image for each surface of the three-dimensional TIN model and using the image as a texture data source; D, after selection of the texture data sources with the best qualities, carrying out texture extraction; E, carrying out substitution of textures of shielded parts to complete vulnerability repairing of the textures; and F, pasting the preferably selected textures to the surface of the three-dimensional TIN model to generate a three-dimensional model with a lifelike effect. The method has advantages: firstly, the construction efficiency is high; and secondly, the texture quality is improved and the lifelike effect is realized.

The invention relates to a database data fragmentation storage method, comprising the following steps of: generating a plurality of sub-tables corresponding to each data table stored in a database host, wherein data of all the sub-tables corresponding to each data table covers the corresponding data table, and the data in the sub-tables is not overlapped; storing the sub-tables corresponding to each data table stored in the database host to a plurality of database standby machines, so that the data table with the corresponding sub-tables distributed to the database standby machines exists in the data tables stored in the database host; and maintaining distribution information, in the database standby machines, of the sub-tables of each data table in the database host. According to the method, the response speed of a data reading request is increased. In addition, a database data fragmentation storage apparatus is further provided and a data fragmentation storage based database data query method and apparatus are provided.

The invention brings forward a data query method and system based on Key-Value data blocks. The method comprises following steps: selecting dimensions of data aggregation based on attributes of perception data, clustering perception data of the same attribute dimension in common, saving perception data to a same data block and utilizing selected data dimensions as attribute information corresponding to data blocks; adopting Key-Value data format to save and manage data in the data blocks; and saving and managing storage positions and corresponding attribute information by adopting a relational database. The data query method and system based on Key-Value data blocks has following beneficial effects: a deluge of perception data on the Internet of Things can be read and written in an efficient manner without using a great number of computers; and the data block is easy to expand according to business scale.

The invention provides a method and a device for storing data, and belongs to the technical field of databases. The method includes that enabling a storage device to acquire data records to be stored; determining attribute fields which meet preset conditions in the data records; using the attribute fields which meet the preset conditions as prefixes Head of the row keys Rowkey in a database HBase; storing the row keys Rowkey in the database HBase. The method and the device have the advantages that the row keys Rowkey in the database HBase can be set and stored according to the preset conditions, so that the data query speed can be increased, the retrieval efficiency can be improved, and time consumption can be reduced.

The invention discloses a data processing method and a data processing device, which are used for avoiding the bottleneck problem of disk input I / O (input / output) and improving the data storage and query speed. The data processing method provided by the invention comprises the following steps of: writing acquired data into a plurality of storage tables which are divided according to time granularity in advance, wherein each storage table is used for storing data acquired in a specific time segment; and when the operation of writing the data into the storage tables is completed, merging the data in the storage tables into subareas of subarea tables, which correspond to the storage tables, wherein the subsareas are used for providing data which need to be queried for a user.

The invention discloses a recommending system and method used for search input, and relates to the field of search engines. The system includes a keyword acquiring unit suitable for acquiring search keywords as per user input, a search tree storage unit suitable for storing Chinese characters in form of a tree data structure, a recommended word bank suitable for storing recommended words, an address acquiring unit suitable for inquiring the search tree storage unit and obtaining address information of the recommended words according to the search keywords, and a recommending unit suitable for obtaining the recommended words by inquiring the recommended word bank as per the address information and recommending the recommended words to the user, wherein each data node in the search tree storage unit stores one Chinese character and contains address information of recommended words of the character. The system and the method enable each data node in the search tree storage unit to contain the address information of all recommended words of the node character, thereby improving the speed for inquiring the recommended words and overcoming the problem about lowered inquiring speed due to enlarged capacity of the recommended word bank.

The embodiment of the invention provides a geographic information data processing method and device. The geographic information data processing method comprises the following steps: acquiring geographic latitude and longitude coordinates of a spatial entity object to be inquired, and converting the geographic latitude and longitude coordinates into corresponding grid codes; inquiring grid elements in a database by use of the converted grid codes, and determining at least one object identifier corresponding to the grid codes, wherein corresponding relationships between the grid codes and the corresponding object identifiers are stored in the grid elements; inquiring an object table according to the determined object identifiers to obtain attribute information of objects identified by the corresponding object identifiers, wherein the object identifiers and the attribute information of the corresponding objects are stored in the object table; and determining attribute information of the spatial entity object to be inquired from the obtained attribute information of the objects. According to the embodiment of the invention, spatial inquiry conditions are converted into numerical matching of the grid codes, so that the effect of efficiently and accurately acquiring result data of geographic information data operation is achieved.

This invention discloses a kind of server load balancing method. It can realize load balancing based on server weight value and probability statistics theory. The technical project is: making sure the corresponding relation of the servers in server group and the distribution range that complied with the first presetting rule. When there is a new service request enters, it generats a random number and determines one located distribution range of this random number. Then it determines the dispatched server according to the determined one located distribution range and its corresponding relation and forwards the access request to this server. This invention can make sure the rapid load balancing dispatching speed and make the high weight value server providing more access service statistically, so to realize high-powered network transmission.

The invention relates to a system and a method for achieving browser data synchronization. The system comprises a cloud storage server side, a push server and a plurality of browser client sides, wherein the cloud storage server side is used for issuing condition information and command information to the push server when data are updated; the push server is used for determining the target client side from the plurality of browser client sides according to the condition information and transmitting the command information to the target client side; and the target client side is used for achieving data synchronization between the target client side and the cloud storage server side according to the command information. By the aid of the system and the method, on the condition that the content of the data stored in the cloud storage server side are updated, the command information is timely transmitted to the target client side through the push server, so that the real-time synchronization of the data between the cloud storage server side and browser client sides are achieved simply and efficiently.

The invention discloses a method and a device for quickly inquiring and calculating a MangoDB cluster, which is applied to computers, communication and associated fields. The method comprises the following steps of S1, determining a query condition, wherein the query condition is used for inquiring subgroup summary data of a designated subgroup corresponding to the query condition in a designated data list of all fragments of MongoDB; S2, inquiring the designated data list according to the query condition, and acquiring data in the designated subgroup corresponding to the query condition; S3, storing the data into a first temporary data cache table on a server; and S4, carrying out subgroup query on the data in the first temporary data cache table and calculating a query result. According to the method, an original fragment query way is improved to a query way on one server, so that the query speed is greatly improved on the premise of guaranteeing the accuracy of the query result.

The invention relates to a method for acquiring position information in real time based on GPS (Global Positioning System) data, relating to a method for intelligently navigating and positioning by a computer. In the method, a navigation center processing method comprises the following steps of: performing grid division to an electronic map; establishing POI (Point of Interest) point records for all grids; establishing sub-area records for various grid regions; establishing administering relation trees for sub-areas of various grid regions; receiving the position information of inquiring points; acquiring POI point records of the grid and peripheral grids where the inquiring points are, and the sub-area records of the minimal grid region corresponding to the grid where the inquiring points are; judging whether POI points are existed besides the inquiring points, if so, calculating the distance between the inquiring points and the POI point and re-transmitting the result and description of the POI point; if not, acquiring the minimal grid region corresponding to the grid of the inquiring points and the names of all dormant regions depending on the administering relation, thereby obtaining place name describing statement for re-transmission. The method in the invention is rapid in inquiring speed, and clear and direct in position information.

The invention discloses a file synchronous storage and access system based on a cloud server and a method therefor. The file synchronous storage and access system comprises a barcode sweeping gun, a scanner, a barcode printer and a plurality of file cabinets, the barcode sweeping gun is used for scanning a two-dimension barcode on one side surface of a file box storing paper files and sending collected two-dimension barcode information into a collection management terminal; the two-dimension barcode is an ID number; the scanner is used for scanning the paper files in the file box page by page and sending scanned images into the collection management terminal; the barcode printer is used for printing the two-dimension barcode on the file box according to a command from the collection management terminal; the file cabinets are used for storing the paper files and capable of serving the function of locating files to a book according to a command from the collection management terminal, and indicator lights are arranged on the file cabinets. The file synchronous storage and access system is capable of managing paper files and electronic files synchronously; in normal cases, desired information is obtained from the electronic files, instead of repeatedly accessing the paper files, so that the work efficiency is improved, and the work process is standardized.