40 results about "Database optimization" patented technology

In some embodiments, there is provided generating a logical query plan for a query that includes a single fact table and multiple reducer tables; optimizing the logical query plan for query execution; and executing the optimized logical query plan.

The invention relates to the technical field of database optimization, in particular to a database preloading method and device based on a hybrid architecture and hotspot prediction.The method comprises the steps that on the basis of a preset sliding window mechanism, time sequence characteristics of historical access logs are extracted to recognize high-frequency hotspot data; based on a preset cache preheating mechanism, dynamically generating a loading priority queue according to the data access frequency of the high-frequency hotspot data so as to preferentially load the key data to a memory hotspot; and based on the monitoring data of the LRU list, the flush list and the check point state, a preset self-adaptive mechanism is linked to dynamically adjust a preloading strategy, and the preloading strategy is deeply integrated with a database check point mechanism to form closed-loop control, so that the preloading of the database is realized. Therefore, the problems that frequent changes of an access mode are difficult to cope with due to the fact that a database preloading method mostly depends on a static strategy or simple statistics, and particularly when the concurrency is high and the load fluctuation is large, hot area identification lagging, resource waste, cache hit rate reduction, response delay increase and the like are easily caused are solved.

The invention discloses a quantum method and device for processing database multi-query optimization and a storage medium. The quantum method comprises the steps that database multi-query optimization problem expression is converted into a secondary unconstrained binary optimization problem; running a quantum circuit on a quantum computer, and calculating an energy value corresponding to Hamiltonian according to a test state prepared in a quantum processor; summing the energy values on a classical computer, and optimizing parameters of the quantum circuit through a classical optimizer according to a summing result; and iteratively executing the steps of quantum circuit operation, energy calculation and parameter optimization until an energy value converges to a stable value, obtaining an optimal solution of a multi-query optimization problem, and solving the quadratic unconstrained binary optimization model in a quantum-classical hybrid framework by the variable component sub-feature solver algorithm. According to the method, the quantum computer is introduced into the database optimizer, the multi-query optimization problem is solved by using a variable component subscript solicitation solver algorithm, and a problem modeling strategy is improved.

The invention discloses a method and device for improving the read-write performance of a database, and relates to the technical field of database optimizing.The method comprises the following steps that firstly, a database read-write request initiated by a service system is intercepted, and query conditions in the request are analyzed; 2, performing shunt query according to the type of the query condition: if the query is single primary key or primary key list query, routing the request to a key value pair database and reading data; and if the query is composite condition query. According to the method, the database request is intercepted, and the original query of a relational database is converted into the query of a key value pair database or a full-text retrieval database, so that the respective advantages of the key value pair database in a single key value query scene and the full-text retrieval database in a complex query scene are fully exerted; the problem that an existing relational database is large in data volume and slow in query is solved, and the problem that all data cannot be queried at a time due to data separation caused by an existing data fragmentation scheme is solved.

The invention provides a database index table generation method, a query method and electronic equipment, and relates to the technical field of databases. According to the specific scheme, the method comprises the steps that in response to a received database optimization instruction, a to-be-optimized database and a target query statement are determined based on the database optimization instruction; determining a target query field from the target query statement based on the execution plan information of the target query statement; identifying the complexity of a target data column which is stored in the to-be-optimized database and is related to the target query field, and determining an identification result; and generating an index table for querying data in the target data column by using an index generation strategy matched with the condition type of the target query condition corresponding to the target query field under the condition that the recognition result represents that the complexity of the target data column meets the index generation condition.

The invention discloses a carbonate rock distribution area soil heavy metal traceability method, and belongs to the technical field of soil heavy metal traceability, and the method comprises the following steps: (1) geological background analysis: constructing a regional association type geological background reference; (2) soil sample collection and chemical analysis: providing basic data for traceability work; (3) chemical fingerprint feature extraction: constructing a form-isotope two-dimensional fingerprint, and improving the source distinguishing precision; and (4) spatial distribution modeling and traceability: multi-dimensional data collaborative analysis is carried out, and accurate traceability is realized in combination with spatial visualization. On the basis of the geological background, the natural source reference is defined; establishing a characteristic system database by taking chemical fingerprint data as a core; the receptor model parameters are optimized, and the distinguishing ability of a natural source and an artificial source is enhanced; and the spatial distribution data is used as a carrier to verify the source spatial relevance, so that the traceability precision is effectively improved finally.

The invention provides a mechanical design chart hybrid intelligent analysis method and system based on interactive learning, and provides an efficient and systematized solution for intelligent processing of mechanical design chart knowledge by adopting a multi-modal data fusion technology and combining deep learning, an OCR (Optical Character Recognition) technology and natural language processing. Through an accurate chart and text recognition method, the analysis precision and the practical efficiency of design knowledge are remarkably improved, and the precision requirement in standardized mechanical design is met; the system adopts a convolutional neural network and an attention mechanism, solves the problems of insufficient precision and inaccurate structured data output when a complex chart is processed in a traditional technology, and optimizes data integration and processing flows by seamlessly connecting an analysis result with an agent knowledge base and a database.

The invention relates to the technical field of database optimization, in particular to a distributed cache preloading-based SQL query result quick return method, which comprises the following steps of: performing parameter abstraction on an SQL to generate a key prefix; judging SQL fingerprint hotspots, marking preloaded objects, and writing the preloaded objects into a hotspot list; generating a preloading task by utilizing the hotspot list; designing cache and storage; loading the result set in a fragmentation manner, splitting the result set into a plurality of fragmentation tasks, and concurrently executing pre-computation by using threads; adding data consistency metadata when the cache is written; splicing cache keys, and querying cache and storage hit conditions; providing a cache failure and avalanche prevention mechanism of the step random TTL; and the gateway layer exposes cache system design and performance monitoring indexes, and triggers an alarm by using the cache system design or performance monitoring. According to the method, the problems of high passive back-to-source delay, inaccurate hotspot identification, poor data consistency, large result set loading bottleneck, cache avalanche and the like in the existing distributed cache technology are solved.

The invention relates to the technical field of micro-nano machining, in particular to a multi-layer thin film deposition and vacuum packaging integrated process optimization method and system, which comprises the steps of performing functional region division on an initial sensor to obtain a plurality of functional region sets, and obtaining deposition precision based on a deposition unit; obtaining a deposition thickness interval and a deposition layer number interval by utilizing a deposition function corresponding to the functional area set, obtaining a historical data set and a deposition raw material node set which are used as references, and constructing an updated deposition database by utilizing the deposition precision, the historical data set, the deposition layer number interval, the deposition raw material node set and the deposition thickness interval, optimizing the updated deposition database to obtain a deposition-sealing database, obtaining a deposition sensor by using the deposition-sealing database and an initial sensor, and performing vacuum sealing on the deposition sensor to obtain a sealed sensor. According to the invention, the accuracy of depositing and bonding the initial sensor can be improved.

Techniques for managing data stored within a database, such as a decentralized database are provided. Some techniques involve managing some data within a lower-trust database and some other data within a higher-trust database. A higher-trust database may be a decentralize database including a blockchain. A lower-trust database may store references to data within the blockchain, and optionally other data in association with those references. Disclosed techniques include WHERE clause query handling in databases with reference values, replacement of distinct data in a relational database with a distinct reference to that data, number line storing for secure indexing, APIs for databases, and consensus operations for private blockchain networks.

The invention provides a database optimization method and device, electronic equipment, a storage medium and a computer program product. The method comprises the following steps: collecting a plurality of first configurations corresponding to a first database and first performance data corresponding to the plurality of first configurations; constructing a first probability model based on the plurality of first configurations and the first performance data corresponding to the plurality of first configurations, and determining one or more first parameter values corresponding to the first parameter set based on the first probability model; the one or more first parameter values are used for maximizing the first conditional probability; taking the one or more first parameter values as an initial solution of a first optimization problem, and solving the first optimization problem based on a set optimization algorithm to obtain one or more second parameter values; the first database is configured based on the one or more second parameter values.

The meta generation and database optimization device using questioner information disclosed herein includes a processor and a memory storing at least one instruction executed by the processor, the at least one instruction being configured to cause the processor to perform a natural language query transmission stage in which a user inputs a question and the result is transmitted to a transformation matrix via a result platform; a question processing stage in which the transformation matrix analyzes the natural language question via a large-scale language model and generates a meta natural language question by referring to related data from an embedded vector store; and a meta information generation stage in which a database query is generated based on the meta information generated by the optimal database generation unit to derive optimized results.

The invention discloses a spatial decomposition enhanced database tuning method based on large model guided exploration, comprising the following steps: S1, constructing a multi-source knowledge system and completing verification, and providing domain knowledge support for subsequent knob screening; s2, screening performance key knobs through a hybrid expert mechanism to realize static compression of a configuration space; s3, initializing an adjustment and optimization sample set, and defining a relative performance optimization target taking throughput and delay as cores; s4, performing dynamic adjustment and optimization based on a spatial decomposition algorithm, and realizing efficient configuration exploration in combination with a UCB criterion and Bayesian optimization; and S5, repeating the dynamic tuning step in the step S4 to a preset number of iterations, and outputting the configuration with the optimal relative performance in the sample set as the final parameter configuration of the database. According to the method, the knobs are accurately screened through multi-source knowledge and the MoE mechanism, the configuration space is efficiently explored in combination with space decomposition and BO, the tuning efficiency and the database performance can be improved, and the method can quickly adapt to dynamic working load drift.

This invention provides a system and method for providing cross-microservice query processing. [Solution] A system providing an object service framework 202 that supports the use of microservices A210 that interact with each other or request access to each other's data to process queries, wherein each microservice can be independently developed, deployed and evolved, and interacts with other microservices through contracts and interfaces defined as public APIs and exposed through the framework. The framework is used to provide a cross-microservice layer that automatically translates queries that combine objects from different microservices into a single database query optimized for use in that database.

The embodiment of the application discloses a kind of multi-cluster database data skew detection optimization method, equipment and medium, belong to database technical field, solve the problem that the mode of artificial detection database data skew condition is inefficient and high error rate under the condition of large-scale cluster. Including, response scheduling task instruction, determine target cluster based on scheduling task instruction;Obtain table object in target cluster, execute corresponding data distribution detection strategy to table object based on the type of table object, to determine the row number distribution of table object on each Segment node;Basic skew rate is obtained based on row number distribution, the data skew rate corresponding to table object is obtained by adjusting basic skew rate multidimensionally;Based on row number distribution, standard deviation of row number distribution is calculated, to obtain the data skew degree corresponding to table object based on the calculation result;Based on data skew rate and data skew degree, match corresponding database optimization strategy.

The application discloses a kind of database logic plan cache usage and management method and system, belong to database optimization technical field, according to resource occupation and execution overhead, TOP-SQL and non-TOP-SQL are divided, for non-TOP-SQL, using the logical plan of existing PlanCache in template cache mode;For TOP-SQL, establish and maintain a plan manager for it, cache multiple logical plans, select optimal logical cache plan execution according to actual parameters;The implementation of the method includes: Top-SQL determination, logical plan capture, logical plan selection and reuse, logical plan evolution and management.The application realizes the cache of database logical plan, and implements different cache logical plan reuse and management strategies for different weight SQL statements, optimizes the reuse mechanism of cache logical plan, and reduces system resource loss.

The invention provides a database optimization method and device, equipment and a storage medium, and can be applied to the technical field of databases. The method comprises the following steps: acquiring a first running index of a target database query statement running in a target database; under the condition that the first operation index meets a first preset condition, obtaining a data table pointed by the target database query statement and candidate database query statements pointed to the data table; on the basis of an optimization strategy corresponding to the business scene category of the target database query statement, executing candidate optimization operation on the data table to obtain a candidate optimization data table; and obtaining a second operation index of the candidate database query statement operated in the candidate optimization data table, and determining a matched target optimization operation in the candidate optimization operations based on the second operation index so as to optimize the database based on the target optimization operation.

The invention discloses a shale gas reservoir mixed gas injection parameter optimization method considering a microscopic adsorption mechanism, and relates to the technical field of oil and gas field development. According to the method, an initial sample point set is generated in a four-dimensional parameter space by adopting a Latin hypercube sampling method, molecular dynamics simulation is performed by utilizing the initial sample point set to establish a sample database and a displacement efficiency prediction model, a Bayesian optimization acquisition function is constructed based on a target aperture value, and a prediction result of the displacement efficiency prediction model is combined. And maximizing the Bayesian optimization acquisition function to determine the most potential mixed gas injection parameter, generating a new four-dimensional sample point, performing molecular dynamics simulation to obtain the displacement efficiency, obtaining a new parameter point to update the sample database, and optimizing the displacement efficiency prediction model through the sample database after multiple times of updating to obtain the optimal mixed gas injection parameter. And the relation between the aperture and the optimal mixed gas injection parameter is established, the dominant displacement mechanism of the shale reservoir under different apertures is disclosed, and efficient optimization of the mixed gas injection parameter is realized.

The invention provides an air conditioner prediction control system based on heat capacity identification and data fusion, and the system comprises a data collection module which is configured to obtain the environment data of a to-be-detected room and the operation data of an air conditioner equipped in the to-be-detected room in real time; the database construction module is configured to generate historical working condition data according to the environment data and the operation data acquired by the data acquisition module each time, and construct a historical working condition database; the optimization strategy module is configured to perform strategy generation according to the real-time environment data, the real-time operation data and the historical working condition database when new air conditioner temperature setting is received, and a target strategy is obtained; and the strategy execution module is configured to adjust the operation condition of the air conditioner in the to-be-detected room according to the target strategy. By means of the system, the problem that an existing air conditioner control system lacks personalized regulation and dynamic adjustment is solved.

The invention provides a database connection selection rate calculation method and a related product, and relates to the field of database optimization. The method comprises the following steps: grouping connection operations in connection query according to data tables participating in connection; traversing each group, and respectively matching a plurality of columns of de-duplication values of the connection columns in the connection tables at the two ends in each group; using a recursive algorithm to calculate the selection rate of connection conditions of each layer in the connection operation layer by layer according to the multi-column deduplication value and the single-column deduplication value of each connection column; multiplying the calculated selection rates of the connection conditions of each layer to obtain a grouping selection rate; and calculating the ratio of the grouping selection rate to the Cartesian product row number of the connection operation to obtain a final result of the connection selection rate. According to the scheme, the multi-column deduplication values of the connection columns of the data tables at the two ends are matched, and the multi-column correlation distribution characteristics are included into computational logic, so that the one-sidedness of single-column statistics is made up, and the accuracy of selection rate estimation in the multi-column connection scene is improved.

According to the multi-factor database access behavior risk analysis method and system provided by the invention, before the SQL is executed, the potential data risk and performance risk of the SQL are subjected to accurate, quantitative and multi-dimensional comprehensive pre-judgment, so that the intelligence and accuracy of active defense of the database are fundamentally improved; and the problems of data security and system stability caused by malicious or accidental operation are effectively prevented. According to the method, static structure risk analysis of the SQL statement and deep analysis of an execution plan generated by a database optimizer are combined; a data asset sensitivity factor is introduced, and the business importance of each data table involved in SQL operation is included in a final risk score; through two core dynamic factors, accurate quantification of the risk is realized.

The invention relates to the technical field of steam turbine generator unit fault diagnosis, and discloses a unit fault diagnosis model construction method and system, and the method comprises the steps: obtaining and structuring fault diagnosis data, and forming a basic database; the configuration is optimized to adapt to the requirements of different operation stages of the unit; constructing a multi-source feature input system, and obtaining multi-dimensional feature data; constructing a deep learning network model based on the data, and introducing constraint optimization training; designing double-path diagnosis trigger logic, and triggering model diagnosis according to feature matching; adjusting the weight by adopting a dynamic weight fusion mechanism in combination with historical data; and constructing an interpretation module to output a diagnosis result and a basis. The technical problems that in the prior art, knowledge boundaries are limited due to the fact that expert experience is relied on, non-structuralization is difficult to inherit, pure machine learning lacks guidance, data are insufficient or misjudgment is prone to occurring when distribution is uneven, and results do not have physical significance support are solved.

The invention relates to the technical field of database automatic optimization, in particular to a database optimization method and device, equipment and a medium. According to the method, a current product mold testing task and information are obtained and analyzed to obtain analysis data, current feature description is generated in combination with a standard template and marked as a feature tag, a first forming parameter is matched in a process database according to the tag, and mold testing data are generated for product mold testing by using the first forming parameter; and analyzing whether the mold testing data is in a standard data error range, if not, adjusting the parameters according to a forming rule, then testing the mold again, obtaining updated parameters until the mold testing data reaches the standard, and finally updating the process database by using the updated parameters.

The application discloses a CFD database optimization method for a virtual laser radar wind measurement system, and belongs to the technical field of wind power generation. ICEM CFD is used to perform geometric modeling and grid division on a target wind farm, so as to obtain a model grid of an unstructured grid, and six boundary layer grids are arranged in the near-ground area of the model grid; an improved actuator disc model is used to build an improved actuator disc of multiple wind turbines on the model grid, so as to obtain a target model grid; a first boundary condition of CFD simulation and a second boundary condition of the improved actuator disc model are set, and are used for CFD simulation on the target model grid until a stable state of a flow field is reached, so as to form a wind farm simulation CFD database of full wind direction and full wind speed containing multiple groups of working condition data. Compared with a traditional CFD database in an existing wind measurement system, the application can make up for the lack of a physical mechanism of an analytical model, correct the time delay effect of a flow field, and reduce the calculation cost and improve the database precision.

The application discloses a kind of based on multi-mode database and realizes the write method of copy table, it is related to the field of multi-mode database optimization;Including: step 1: the compilation optimization of multi-mode copy table is carried out, and multi-mode copy table expression is generated;Step 2: generate multi-mode copy table write operator and multi-mode copy table write operator executor, and execute the write of copy table;The application can further improve the copy table write efficiency of multi-mode scene, improve the read-write speed of multi-mode database, optimize multi-mode database system, can realize the elastic extension and cost control of multi-mode database.

The application provides a database optimization method and device, a server and a storage medium. The method comprises the following steps: acquiring access data, and segmenting the access data to obtain segmented query fields. If the number of the query fields is multiple, all query field combinations are obtained according to all the query fields. Each query field combination is searched, and if a unique response value is obtained, the search time of each query field combination is recorded. The search times of each query field combination are sorted from small to large, and a joint index is respectively created for the query field combinations corresponding to the search times in the front preset number, thereby obtaining multiple joint indexes. The reference times of the multiple joint indexes are recorded, and the multiple joint indexes are sorted from large to small according to the reference times. Each joint index after sorting is stored, so as to complete the optimization of the database. The method of the application accelerates the feedback speed of the database without increasing the number of the database server cluster.

The invention discloses an intelligent parking management system and method based on data analysis, relates to the technical field of intelligent parking management, and aims to solve the problems that a parking lot matched with a vehicle model is difficult to obtain and parking spaces are pre-judged by depending on static data in an existing system. A three-dimensional association database is constructed by collecting physical data of a parking lot and vehicle type data of vehicle owners; screening surrounding parking lots according to destinations input by vehicle owners to generate candidate lists; preliminarily judging a scratching risk by combining an entrance and exit slope correction size comparison result; calling the real-time channel occupancy rate and the entrance and exit congestion data to secondarily verify the passing suitability and update the risk level; calculating a parking space release rate and an availability index of an adaptive parking lot, and generating a recommendation list by combining a distance and a risk level calculation comprehensive score; when the number of adaptive parking lots is insufficient, the range is expanded for supplementary selection, and alternative schemes are generated; and collecting the feedback of the vehicle owner to update the database, and optimizing the adaptation judgment logic.

This invention provides a method for processing database query statements and related products, relating to the field of database optimization. The method includes: obtaining the query statement to be processed; searching for the execution state corresponding to the query statement from a pre-established execution state cache record; if found, the database executor directly loads the execution state to process the query statement; if not found, obtaining the execution plan of the query statement, executing the execution plan by the executor, and saving the execution state of the executor to the execution state cache record. The solution of this invention allows the database executor to directly load the execution state to process the query statement, directly reusing the already initialized execution state, avoiding the time-consuming process of repeated initialization by the executor; it shortens the overall processing flow of the query statement, and is particularly suitable for scenarios where the same query is executed repeatedly.

The invention provides a consistency verification method, device, medium and system for partition table statistical information, and the method comprises the steps: determining a partition table corresponding to a partition as a target partition table under the condition that a preset operation executed on the partition is received, or under the condition that the statistical information of the partition table corresponding to the partition is detected to be updated; obtaining partition-level statistical information and whole-table-level statistical information of the target partition table, and determining whether the target partition table has statistical deviation or not according to the partition-level statistical information and the whole-table-level statistical information; and under the condition of determining that the statistical deviation exists in the target partition table, determining a to-be-updated partition with the statistical deviation in the target partition table, and updating the partition-level statistical information and the whole table-level statistical information according to the current partition-level statistical information of the to-be-updated partition. According to the method and the device, the problem of low SQL statement execution efficiency caused by misjudgment of a database optimizer due to lack of unified coordination of statistical information of the partition table in an updating process in an existing database is solved.

The application is a database configuration optimization method based on a parameter taking effect mechanism. The application relates to the technical field of database optimization. According to the parameter taking effect mechanism, the parameter space is divided into instant taking effect parameter space and restart taking effect parameter space. An optimization cycle is executed, a candidate configuration is output by executing Bayesian optimization, and the optimization stagnation state is updated according to the performance improvement. When the optimization stagnation counter exceeds the upper limit value of the optimization stagnation, the to-be-searched parameter space is expanded into the union of the instant taking effect parameter space and the restart taking effect parameter space, and the optimization stagnation counter and the upper limit value of the optimization stagnation are reset. When the optimization times reach the upper limit, the optimization cycle is terminated, and the parameter configuration corresponding to the optimal performance index recorded in the historical performance data table is taken as the final output result. The application reduces the restart times and time cost of the database in the optimization process, and improves the overall efficiency of configuration optimization.