30results about How to "Improve query speed" patented technology

The invention discloses a memory space indexing system and method for power grid data, and the system comprises a variable-length prefix compression coding unit and a multi-level indexing unit. The variable-length prefix compression coding unit is used for storing index information to adapt to the real-time change of power grid data; the multi-level index unit is used for retaining data which are most frequently accessed in a rapid memory, storing data which are less accessed in an auxiliary memory which is slower but larger in capacity, monitoring the change of power grid data in real time, dynamically encoding new data, updating an index structure, dynamically adjusting the size and the structure of an index according to the data access frequency and the updating frequency, and storing the data which are most frequently accessed in the rapid memory and the auxiliary memory which is slower but larger in capacity. Index nodes are split or merged by using the flexibility of compression coding of prefixes with variable lengths so as to adapt to the change of data volume. According to the method, the size and the structure of the index can be dynamically adjusted, so that the memory occupation is reduced, and the indexing efficiency is improved.

The invention relates to the technical field of construction of genome databases, in particular to a construction method of a pathogenic microorganism genome database. The method comprises the following steps: carrying out pathogen characteristic point location analysis on a pathogen microorganism genome sequence to obtain pathogen characteristic point location data; carrying out physiological and biochemical characteristic analysis on a pathogenic microorganism genome sequence according to the pathogenic characteristic point data, carrying out genome evolution relation simulation, and then carrying out prepositive relation linkage identification to obtain prepositive relation linkage data; performing relation nested structure analysis on the prepositive relation linkage data, and performing relation coding index construction to obtain a linkage relation coding index; and carrying out dynamic retrieval condition matching on the linkage relationship coding index, and carrying out genome database construction to obtain the pathogenic microorganism genome database. The construction technology of the genome database is improved, so that the construction technology of the genome database is more perfect.

The invention discloses an SA-CNN-BiLSTM-based intelligent substation virtual loop automatic generation method, which comprises the following steps: in an SCD file, extracting IED equipment information of historical IED equipment and virtual terminal information contained in the historical IED equipment, and storing the IED equipment information and the virtual terminal information in a historical SCD database; forming a semantic similarity model; and based on the semantic similarity model, finding a final historical IED equipment association pair corresponding to the to-be-designed IED equipment association pair, and instantiating the to-be-designed IED equipment association pair based on the final historical IED equipment association pair. According to the method, the virtual terminator information contained in the historical SCD file is rapidly extracted in a DOM mode and stored in the database in a classified mode, and the query and matching speed is remarkably increased. The semantic similarity model can effectively extract semantic features and endow the semantic features with higher weights, the semantic recognition success rate is high, and the method has a good effect in intelligent substation virtual connection automatic design.

The present invention discloses a log aggregation query method for massive data, including: log collection: collecting different types of log data from a server; processing the data fields in the log using a dynamic and static combination field to obtain processed data; analyzing the processed data using a cold-hot separation model to obtain cold and hot data, and shunting the cold and hot data into a database; first performing log query through a hot database, and then performing log query through a cold database. The present invention shuns log data by using dynamic and static combination field processing and a cold-hot separation model. When querying, the user directly queries from the hot data, which greatly reduces the query scope, reduces the magnitude, and improves the overall query speed.

The invention discloses a social network rumor suppression method and system based on a sphere domain index, and relates to the technical field of social network information processing. For the NP-hard characteristic of a rumor suppression problem under a competitive independent cascade model and the defect of high calculation cost of a traditional algorithm, efficient response under a multi-query scene is achieved through three-step progressive algorithm design. The method comprises the following steps: firstly, proposing an HMP-TC algorithm, replacing a forward sampling process in mixed sampling with typical cascade, and depicting a stable structure of rumor propagation; secondly, proposing an HMP-LB algorithm, constructing a landmark index structure based on point coverage, only maintaining influence ball domain information for index nodes, and correcting deviation through a probability weight; and finally, proposing a PTC-LB algorithm, introducing a protection sphere domain index formed by protection typical cascade and protection relation samples, and realizing non-sampling rapid optimization in a query stage. According to the method, on the premise of maintaining 90%-95% of rumor blocking effect, the single query speed is increased by 10-30 times, part of scenes can reach two orders of magnitude, and the quick response problem of rumor suppression in a large-scale social network is effectively solved.

The present application discloses an underwater noise processing method, device, equipment and medium. The method comprises: in response to an underwater noise processing request received in real time, converting the latitude and longitude coordinates of the noise source entity and the detection entity in the target sea area contained in the underwater noise processing request into simulated geographic grid coordinates respectively; calculating the grid standard distance corresponding to the noise source entity and the detection entity according to the simulated geographic grid coordinates; and determining the underwater noise value corresponding to the grid standard distance according to the grid standard distance. The embodiment provided by the present application maps the target entity to the simulated geographic grid, simplifies the calculation of the grid standard distance between the target entities, and then uses the grid standard distance to determine the underwater noise value corresponding thereto, avoiding multiple repeated calculations, saving a lot of calculation time, and thus improving the response speed of the system.

The invention discloses a block chain transaction data acquisition method, which comprises the following steps that: a server initiates a data acquisition initial request to a block chain, when the server receives a response returned by the block chain, the server generates a transaction data item and a new data acquisition request and synchronizes the transaction data item and the new data acquisition request to synchronous middleware, and the synchronous middleware constructs a request tracking tree; the synchronization semaphore is calculated in the request tracking tree according to the completion condition of each data acquisition sub-request, so that the downstream processing unit can know the acquisition progress of the transaction data through the synchronization semaphore, the transaction data can be processed or stored after all the data in the block are acquired, and the response efficiency of the downstream processing unit is improved; according to the further embodiment, the invention further provides a scheme for performing path compression on the request tracking tree, the query speed is increased, and the storage memory of the request tracking tree is reduced.

The invention relates to the field of knowledge graphs, and discloses a bitmap-based graph data storage and query method, system, device and medium, the method adopts a unified bitmap model to store graph data, converts graph structure data into a bitmap suitable for parallel computing, maps a graph query request into a bitmap operation expression tree, and stores the graph data in the bitmap operation expression tree; therefore, graph query is converted into bitmap operation, and the query performance of high-concurrency and complex graph query is remarkably improved; moreover, a reasonable computing resource scheduling decision is dynamically set according to an input graph query request, and for high-concurrency and complex graph query, thousands of cores of a large-scale parallel computing engine are used for parallel processing, so that the random access bottleneck and the CPU computing power bottleneck of traditional graph traversal are thoroughly avoided, the query speed of order of magnitude can be increased, and the query efficiency is improved. A plurality of complex atlas analysis queries can be processed at the same time, and the real-time requirement of complex atlas query can be met.

The invention discloses a historical data archiving implementation method and device and a medium. The method comprises the following steps: creating a system architecture and a table; under the condition that table creation is completed, archiving conditions are configured; under the condition that the archiving condition configuration is completed, the archiving task is executed regularly; and aiming at the execution process of the archiving task, the query function is optimized. The method has the beneficial effects that the comprehensive functions of reducing the data volume of the table, improving the query performance, supporting flexible condition configuration, reducing the storage space occupied by the table, avoiding associated data migration, querying archived historical data, querying archived and unarchived total data and periodically deleting useless data through configuration are realized.

The embodiment of the invention discloses a data query method, computer equipment and a program product, and the method comprises the steps: obtaining a first query request of first data, the first query request comprises a target business query identifier, the target business query identifier comprises any one or more of a plurality of identifiers, and the plurality of identifiers comprise a user identifier and a business identifier; determining a target storage position of the first data based on the target business query identifier; and querying the first data in the target storage position. Data query in a high-concurrency scene can be realized, and rapidity and stability of data query are ensured.

The present invention relates to a query system based on data analysis, and in particular to the technical field of database management. The query system comprises a user information management module for implementing dynamic authority management for users, a data source management module for managing user requests, caches, data sources and data security, and a database management module for managing a number of databases. The present invention analyzes the query request of the user to determine whether the user request exists in the cache, so as to determine the selection of the query mode for the query request, thereby making flexible selections in the query process, and setting different supervision strengths in the corresponding query mode to supervise the query process, thereby improving the accuracy of control over the data query process.

A credit evaluation method for construction industry enterprises relates to the field of informatization, characterized in that the method comprises the following steps: standard modeling: data analysis in index extraction, forming a standard model library; data aggregation: real-time detection of the qualification of the evaluation object and the evaluation user through unified authentication, forming the final evaluation data; data aggregation of the current evaluation period; special evaluation: executing the final evaluation data, index model and other data sources as parameters into the calculation engine for process log recording, obtaining the operation result and persistent storage. Advantage: by accessing different construction industry enterprise qualification credit evaluation standards, a unified standard index analysis is provided, mainly from the aspects of type, traceability length, data source, aggregation mode and the like. Through index data analysis, a data model of index extraction data is formed, and a standard index information is formed taking one type of information as an example.

The application relates to the technical field of data query, in particular to a query result acquisition method and device based on a large model and a medium, the method comprises the following steps: based on a preset large model, acquiring a result keyword sequence corresponding to a target result text output according to a target query statement, converting the result keyword sequence into target bitmap data of a bitmap data structure, and storing the target bitmap data in association with the target query statement in a preset database; when it is judged that the target query statement is received again, obtaining the corresponding result keyword sequence; based on the result keyword sequence, outputting a new result text through the preset large model, and taking the new result text as a current query result corresponding to the target query statement; by storing the logical relationship of the keywords in the query result, the application greatly reduces the occupation of the storage space, improves the query speed when repeatedly querying, and provides great convenience for repeated query of the user.

The invention provides a directed acyclic graph reachability query method and system based on a structured jump index, and the method comprises the steps: S1, carrying out the topological sorting of a directed acyclic graph G, and carrying out the calculation to obtain a depth-first search starting point; s2, starting depth-first search from all starting points in sequence, and constructing a depth-first search serial number and an index in the depth-first search process; and S3, based on the index and the depth-first search serial number, judging the accessibility between the queried source node and the queried target node. According to the directed acyclic graph reachability query method based on the structured jump index, reachability information of the directed acyclic graph can be stored through a small index, a reachability query result can be returned in a short time, and the size of an index space and query time can be conveniently adjusted and balanced.

The invention relates to the technical field of data processing, and discloses an object-relation SQL mapping method applied to object query, comprising: obtaining all databases, respectively obtaining query data of each database, forming corresponding mapping data, obtaining target query information, forming extraction data, forming query analysis data, forming determination data, and extracting query content. The object-relation SQL mapping method applied to object query has multiple databases, judges whether it is necessary to call data in the database according to historical query information, converts the data to be queried to other databases for query, selects the database with the fastest data processing speed when the system converts the database, has sufficient data sources, reduces the situation where no results can be found, avoids extracting information from a large amount of data in the database for each query, improves the query speed, and thus improves the processing speed of the overall system during operation.

This specification discloses a method for querying graph data. The method identifies a common query across various query loads, performs a query using this common query in a graph database instance, and stores the results as a materialized view of the graph database instance. When a query statement to be executed is received, if the query statement contains the common query, the query result obtained by executing the query using the query statement in the graph database instance is determined based on the stored materialized view. Through this method, when querying using a query statement to be executed, at least a portion of the query results can be determined based on the pre-stored materialized view, without needing to fully execute the query process corresponding to the query statement on the graph database instance, thus effectively improving query speed.

The invention relates to the technical field of biological information processing, in particular to a bar code correction method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a to-be-corrected target bar code; generating a mode character string at each base position included in the target bar code, and replacing the base at the current position with the mode character string to obtain a preset number of new target bar codes; matching the new target bar code with each mode candidate set constructed by the bar code white list, and after the target mode candidate set is matched, matching the new target bar code with each new reference bar code in the target mode candidate set to obtain a first matching result; and correcting the target bar code based on the first matching result, and determining an inclusion relation between the target bar code and the bar code white list. According to the embodiment of the invention, index mapping is realized through the position mode, redundant calculation for generating a certain number of mutants is avoided, the query complexity is reduced, and the query speed is increased.

This application discloses a data processing method, system, electronic device, and storage medium. The data processing method includes: acquiring a data task, wherein the data task represents a task of synchronizing target data from a source database to a target database; and executing the data task to synchronize the target data from the source database to the target database; wherein the data volume of the target data table in the target database is smaller than the data volume of the source data table in the source database. This solution achieves the acquisition of a small range of data by single task, eliminating the need to read the entire dataset, enabling rapid adaptation, improving data query speed, and reducing storage space. Simultaneously, by executing the data task to synchronize the target data from the source database to the target database, flexible database switching is achieved, improving database adaptability.

This application provides a log detection method, apparatus, storage medium, and computer device. Addressing the challenges of existing security log analysis systems—namely, their inability to detect covert attacks with identical cross-entity semantics due to their "user / IP + timeline" perspective, their lack of behavioral semantic abstraction capabilities due to graph analysis granularity remaining at the log instance level, their high false positive rate due to ignoring differences in log source environments, and their inability to continuously adapt to new variant attacks due to the lack of a closed-loop feedback mechanism—this application proposes semantic behavior clustering, environment-weighted correction, large language model intent inference, cross-domain propagation prediction, and feedback evolution to achieve accurate and adaptive malicious behavior identification from logs.

The invention discloses a capacitor electrical performance intelligent detection method and system based on visual detection, after a capacitor enters a detection area, image acquisition is carried out, a visual system completes preliminary appearance screening, and position and attitude positioning is synchronously carried out; a test pin mechanism of the test machine dynamically adjusts the pressing position and angle according to the positioning information, and photographs the contact point of the test pin and the capacitor before and after the test pin is pressed; the water flows through a secondary visual inspection station, and whether newly added appearance defects are generated due to testing or not is rechecked through visual inspection; meanwhile, the system generates a unique ID for each capacitor; according to the electrical performance parameter grading and the appearance condition, warehouse division is realized; meanwhile, the equipment state and the product abnormal index are monitored, and an early warning or maintenance program is triggered. According to the invention, artificial fatigue and subjectivity can be eliminated, the detection consistency is higher, the manual maintenance cost is reduced, the stability of the production process is improved, material blocking is reduced, the data query and processing speed is improved, and the batch quality risk is avoided in advance.

The invention relates to the field of data processing and financial science and technology, and discloses a data query method and device and a related product. The method comprises the following steps: processing a query instruction to obtain range information of to-be-queried data; based on a pre-constructed metadatabase, determining a target storage space and a corresponding storage address according to the range information; if the target storage space comprises a hot storage space or a warm storage space, querying in the hot storage space or the warm storage space by calling a corresponding interface; if the target storage space comprises the cold storage space, migrating the to-be-migrated data into the hot storage space based on the storage address of the to-be-migrated data; and querying the to-be-migrated data in the hot storage space. The problems that in the prior art, the query speed is low, the accuracy is poor, and the storage cost is high are effectively solved, and the data query speed and accuracy are improved, and the storage cost is optimized.

The embodiment of the present application provides a kind of storage method of space-time data, query method and storage device, query device, wherein storage method includes: obtaining the space-time data of one or more entities current time period;According to the entity feature information in space-time data, find each entity corresponding historical space-time data set;For each first entity of historical space-time data set, extract current time period space-time data from the space-time data obtained;The extracted space-time data is saved to the historical space-time data set of first entity;For each second entity that corresponding historical space-time data set is not found, new historical space-time data set is built;Extract the space-time data of second entity current time period from the space-time data obtained;The extracted space-time data is saved to the new historical space-time data set.The storage method of space-time data of the embodiment of the present application has the advantage that storage logic is clear;The query method of space-time data has higher query speed.

The present application discloses a knowledge graph query method, device, equipment and storage medium, which relates to the field of intelligent search technology, including: constructing a vector database based on the corresponding knowledge graph and word embedding algorithm to obtain a target vector database; obtaining an initial large model and a preset data set that have been pre-trained; wherein the preset data set includes a corresponding natural language query statement and a corresponding knowledge graph query statement; fine-tuning the initial large model based on the preset data set and model fine-tuning parameters to obtain a target large model; performing corresponding thought chain construction and context design on the knowledge graph query statement generation task of the target large model to activate the context learning ability of the target large model when performing reasoning; performing query statement reconstruction processing on the target large model based on the target vector database, so as to use the processed target large model to perform knowledge graph query and obtain query results. Effectively improve the accuracy.

This invention provides a method, device, medium, and product for displaying layout data. The method for displaying layout data includes: acquiring layout data to be displayed; pre-creating multiple layers within the layout data; each layer storing polygons of a corresponding size within the layout data; generating index keys for the polygons; establishing a storage structure based on the numerical ranges of the index keys; determining the display width of the pixel blocks of the display window in the coordinate system of the layout data; determining the corresponding layout data layer based on the display width, serving as a baseline layer; and querying layer by layer from high to low until the target data is found. The target data is used to determine the image information to be displayed for the pixel blocks. Specifically, for queried layers higher than or equal to the baseline layer, the target data is a polygon; for queried layers lower than the baseline layer, the target data is a numerical range. This method can effectively improve the display speed of layout data.

The embodiment of the application provides a kind of energy storage system log storage and analysis method and system, its method includes: BMS will real-time acquisition time series data in running process is stored in time series data table in embedded database, while the event log collected is stored in event log table in embedded database;Log file export unit exports time series data table and event log table in the embedded database of the BMS to host computer;The host computer obtains the configurable data analysis model selected by user, and according to the data source defined in the configurable data analysis model and the query parameter input by user, automatically generates optimized SQL query statement, and according to the SQL query statement, extract the required data from the embedded database;The host computer uses the configurable data analysis model to analyze the required data, obtains analysis result.

The application relates to a permission control-based graph function implementation method, system, electronic device and storage medium, wherein the permission control-based graph function implementation method comprises the following steps: configuring Traverse permissions for a user in advance, including implicit permissions and explicit permissions; in the case that the user is assigned with the implicit permissions, the user is not exposed to query content in a query process; in the case that the user is assigned with the explicit permissions, all information except attributes of specified points and / or specified edges is read for the user when performing path query. According to the application, the Traverse permissions correspond to the access ability of a graph structure instead of the access ability of graph attributes, so that the graph function is implemented, the influence on graph features such as in-degree and out-degree is avoided, and the connectivity of an original graph and the correctness of GraphView information are preserved.

The application provides a server, a display device and a live source import method. First, a mapping table based on geographical position and network operators is used for accurate query to filter available live sources in line with the local network environment of a user, avoiding misjudgment across regions. For unknown or unplayable live sources, the server generates a distributed detection task and distributes it to a second display device in an idle state in the same region to detect availability through a lightweight HTTP request, which not only avoids the IP blocking risk of centralized scanning, but also improves detection accuracy by using the local network environment. The available live sources detected are mapped to unique identification codes after semantic normalization processing and are dynamically updated to the mapping table to form a continuously optimized data closed loop. Through resource optimization strategies, the entire process minimizes interference with user devices, and finally provides the user with an accurate and de-duplicated list of available sources, improving determination efficiency and user experience.

The invention discloses a flight test data management system based on a time sequence database, aims to meet management and maintenance requirements of multi-source and multi-type massive high-radix data in a flight test process, and belongs to the field of data management and application of control systems. The flight test data management system comprises a data preprocessing module, a data display and report generation module, a data display module and a database module; the data preprocessing module is used for performing analysis conversion, data interpretation and pre-calculation on the received data; the data display and report generation module is used for performing real-time processing, query, playback, report generation, data frame export, data interpretation and fault diagnosis on the received physical quantity; the data display module is used for displaying various test data physical quantities in different forms; and the database module adopts a time sequence database to realize classified storage management of flight test data, and provides data query and display functions.

The present invention discloses a method, system, electronic device and storage medium for landing and analyzing large quantities of time-sensitive data based on a time series database, adopts data acquisition technology to collect data from network equipment, and adjusts the parameters of the acquisition time interval and data type in the data acquisition through a configuration file in the process; distributes data messages to different message queues according to different data types and device addresses; stores the data in each message queue in batches through partitions and tables according to the acquisition time, data type and device address to achieve data landing; the acquisition time includes year, month, day, hour, minute and second; sets query parameters, including: data type, belonging device and acquisition time, and obtains the query results required by the business through retrieval and analysis of the query parameters. The present invention makes the acquisition and use of data more flexible and fast, and greatly improves the efficiency and utilization of data acquisition.

This invention provides an industrial internet identifier resolution caching method, a public recursive node, a device, and a medium, relating to the field of network technology. The method includes: responding to the arrival of first identifier data, determining whether the in-memory database has free space; if so, storing it in both the in-memory database and the disk database; otherwise, storing it directly in the disk database; recording the arrival time of the first identifier data in the disk database and setting the hit count to a preset initial value; responding to an identifier data query request and finding the requested second identifier data in the disk database, updating the arrival time of the second identifier data to the current time and incrementing the hit count by one; sorting all identifier data based on a set sorting factor; and selecting a corresponding number of identifier data from the disk database and writing them to the in-memory database according to the sorting result and the current free space size of the in-memory database. This invention can solve the current technical problems of excessive load on recursive nodes and low caching efficiency.