65 results about "Database engine" patented technology

The invention discloses an intelligent access API generation method, system and device and a medium, and the method specifically comprises the steps: generating a dynamic dragging interface based on user role information, and obtaining function access parameters customized by a user through the dynamic dragging interface; according to semantic features and operation sequences in historical user interaction data, user intentions are analyzed, and target data topic logic is generated in combination with function access parameters; converting the subject logic of the target data into an executable query statement by utilizing an SQL splicing tool, and recommending an index optimization scheme to a database engine based on a high-frequency condition and field combination in a historical query mode; and distributing the optimized executable query statements to Serverless workflow nodes adapted to different query engines for execution, and packaging returned data into a standardized API (Application Program Interface) for output. According to the method and the device, full-process automation from parameter customization by a user to standardized API output is realized, and the efficiency and the flexibility of data acquisition are remarkably improved.

A method for managing a data stream (DS) includes: receiving a first request from an administrator; obtaining the DS from a streaming storage system (SSS); performing a first analysis of the DS to extract relevant data; making a first determination that the relevant data is worth indexing; generating a set of indexes corresponding at least a portion of the DS; receiving a query about a data item in the DS from a user; sending a second request to a database engine comprising the query; performing a second analysis of the query; making a second determination that a re-indexing of the portion of the DS is not required; identifying an index from the set of indexes that is associated with the query; sending position information of the data item to an API service; retrieving the data item from the SSS; and initiating displaying of the data item to the user.

According to the efficient matching method for the GIS multi-scale basic geographic space data, a multi-scale matching scheme based on geographic space database optimization is improved, firstly, a spatial database model based on a relational database and a spatial database engine is used as a method for storing the multi-scale basic geographic space data, and the method is high in storage speed and flexible in application; 2, establishing a new object selection method for multi-scale geographic space data matching, organizing a basic geographic entity in a data structure form of a multi-way tree based on a multi-scale semantic change rule of geographic space data, and establishing a category matching method for semantic change of the same element category of different proportional scales; a category matching relationship under a multi-scale condition is effectively constructed; and thirdly, an optimization scheme for multi-scale basic geographic space data matching is established, the matching effect is good, and the operation efficiency is high. Spatial data fusion can be efficiently realized, the spatial data quality is improved, and the map database updating efficiency is improved.

The invention relates to the technical field of database analysis, in particular to a database upgrading method, which comprises the following steps of: establishing a double-engine parallel environment, starting new and old version database engines and constructing a cross-version communication channel; in response to the established communication channel, the client request is routed to the new and old engines in parallel for execution through the transaction dispatcher; based on a transaction operation log generated by an old engine, data change features are analyzed in real time, and an increment synchronization instruction set is generated; implementing version-coordinated transaction lock management when the new engine performs data playback according to the generated incremental synchronization instruction set; after the data consistency verification of the preset period is completed, switching a transaction route to a new engine and closing an old engine write-in channel; through double-engine parallel processing, incremental data synchronization and a cross-version lock coordination mechanism, the purposes of no service interruption and high data consistency in the database version upgrading process are achieved.

The embodiment of the invention provides a database processing method and device, a storage medium and a program product, and the method comprises the steps: obtaining target data through an interaction interface of a preset model deployed in a database engine; according to the target data, generating decision suggestion information through a preset model; and generating an operation and maintenance instruction according to the decision suggestion information, transmitting the operation and maintenance instruction to a target execution unit in the database engine through the interactive interface, and executing the operation and maintenance instruction through the target execution unit. According to the embodiment of the invention, the preset model is tightly coupled with the database engine, so that analysis and decision can be efficiently performed in real time in the database system, the operation and maintenance efficiency of the database system is effectively improved, and the intelligent automatic monitoring, learning and intelligent operation and maintenance capabilities of the database system can be realized; and the database system can respond and process business requirements more efficiently and stably.

Methods for replicating transactional tables of a transactional database to a recipient system, such as an analytical database, and maintaining updates to those transactional table representations are disclosed. More particularly, change-data-capture items are generated by a transport engine, that is separate from a database engine for the transactional database. Also, schema data is maintained out-of-band from the database engine and is stitched with committed change payload contents by the transport engine.

A system for delegation of authorization management of a shared database of a database service is described. The database service includes a control plane and a producer database engine. The producer database engine receives a creation request to create a datashare for a database. The creation request delegates, to a data exchange service, authorization management to access the datashare. The control plane is configured to update permission data for the datashare to indicate that authorization to the datashare is managed by the data exchange service. The producer database engine is further configured to receive a request, from a consumer database engine, to obtain metadata used to perform a query to the database of the datashare, determine that the data exchange service authorized the consumer database engine to access the datashare based on the permission data for the datashare, and return the metadata to the consumer database engine.

The invention discloses a definition-based data copying and migrating method, which comprises the following steps of: reading user configuration data, and analyzing and recombining the configuration data; performing mode algorithm processing on the mode structure to obtain a statement trunk; performing configuration algorithm processing on the configuration structure to obtain statement conditions; performing data structure and grammar analysis algorithm processing on the data structure to obtain a table name, a field and an affiliated rule; processing the statement trunk and the statement condition by adopting an assembly algorithm, and generating a dynamic statement with the table name, the field and the affiliated rule; performing batch execution and performing log recording; judging whether inverse operation is needed or not, if the inverse operation is needed, returning to the first step, and if the inverse operation is not needed, backing up the data. According to the scheme, a database data migration tool is provided, compatibility and adaptation of any database and any type are achieved, and meanwhile the most compatible type is automatically adapted to use according to the database engine.

The present invention relates to the technical field of computer data management, and specifically discloses a data governance method, device, equipment and storage medium. By deploying a monitoring agent at the database engine layer in the data management system, data phantom read information within a specific time period is collected in real time; the probability coefficient of data phantom read in the database within a specific time period is calculated, and based on a set judgment rule, combined with the data phantom read probability coefficient, a hierarchical early warning operation is performed on the data; finally, a comprehensive adjustment is made to the cache volume and connection pool adjustment volume of the database. The implementation of these steps not only enhances the stability and reliability of the database, but also significantly improves the resource utilization rate and response speed of the system. In modern data-intensive applications, the complexity and dynamics of data operations require the system to have a higher level of intelligence and automation. It not only meets the current requirements of data management systems for high performance and high reliability, but also provides a sustainable development path for future data governance.

The invention relates to an interactive monitoring method and device for a database running state and electronic equipment. The method comprises the steps that when an interaction instruction in a digital or keyword form input by a user is received, a database running state index is obtained from the interior of a database engine; according to a preset diagnosis rule, key indexes are extracted from the database operation state indexes, the key indexes are integrated, and a refined index set is generated; the refining index set is used as an analysis object, index analysis of the corresponding analysis dimension is triggered according to the interaction instruction, and an analysis result is obtained; and performing layered display on the refining index set based on an analysis result. The technical problem that existing database monitoring lacks real-time performance, flexibility and operation efficiency is solved.

This application provides a data sorting method, a database engine, and a storage medium. In this application, for scenarios involving multi-column sorting, the data rows to be sorted are first grouped according to the clustering column. Then, the sorting is performed between and within each data group according to the sorting column, using the same sorting order. The sorting result obtained in this way retains the clustering characteristics of the clustered columns while essentially ensuring the global order of the data, which is beneficial for improving the computational performance related to the clustered columns. Especially when querying based on the sorting result, it ensures that the performance of queries by data range is largely unaffected, while significantly improving the performance of queries by data grouping.

The invention provides a resource scheduling method and device, electronic equipment, a computer readable storage medium and a computer program product, and is at least applied to the technical field of cloud platform, the method comprises the following steps: using a resource acquisition module to regularly send a resource information acquisition request to each database engine; obtaining first resource information collected by a query resource collection module in each database management module; determining second resource information consumed by the database engine based on the first resource information; a resource acquisition module is utilized to construct a resource consumption request according to the second resource information consumed by each database engine, and the resource consumption request is sent to a flow control module; and determining residual resource information by using a flow control module according to the second resource information consumed by each database engine and a preset resource threshold. Through the method, the residual resource information can be periodically updated, so that the cloud platform schedules the resource to execute the query request, and the resource utilization rate is improved.

The invention relates to the technical field of data processing, can be applied to the field of medical health, and discloses a database double-cache optimization method, device, equipment and medium, and the method comprises the following steps: receiving configuration parameters which are input by a user and are used for triggering a direct I / O mode, and configuring a database according to the configuration parameters, the configuration parameters comprise a plurality of different file types; in response to the fact that the configuration of the database takes effect, performing integral multiple alignment of the size of a predefined block on a heap memory, a stack memory and a shared memory of a memory buffer area of the database; if it is detected that the file type of the received to-be-processed data belongs to one file type in the configuration parameters, a direct I / O mode is triggered, and the to-be-processed data is directly processed based on the aligned memory buffer area and a storage device of an operating system, so that a database engine can directly perform data interaction with the storage device; and the operation system cache is bypassed, so that the data processing efficiency of the medical system is remarkably improved.

The automatic detection of inconsistencies in a database system is described. A first signature and a second signature are received. The first signature is a signature of a result of a first execution of the query against a database by a first version of database engine program code. The second signature is a signature of a result of a second execution of the query by a second version of the database engine program code. A determination is made of whether the first signature and the second signature match. In response to the first signature and the second signature failing to match, an inconsistency report regarding at least one of the first or second versions of the database engine program code is generated and remediation regarding at least one of the first or second versions of the database engine program code is performed.

The present invention discloses a financial investment and financing management platform based on artificial intelligence big data. The present invention relates to the technical field of financial data management, and solves the problem that the method of using a full database engine search not only overly relies on the computing power resources of the search engine, but also causes slow data output. The present invention improves the input efficiency through the multi-threaded input control terminal that inputs according to the data type using preset threads; by real-time monitoring the input rate and the standard input rate, dynamically allocating computing power resources to ensure thread load balancing, avoiding thread memory contention and packet loss, and ensuring the input effect and data integrity; the index vector construction terminal generates a feature vector circle and a node index vector according to the storage node path, and generates an index table in combination with the classification data header to achieve fast data indexing, converting complex hierarchical paths into intuitive index vectors, and improving the index accuracy and speed.

The invention discloses a data query method, device and equipment and a storage medium, and relates to the technical field of data processing.The method comprises the steps that a data query instruction and a target query database corresponding to a current data query task are determined according to a data query request; detecting whether the data query instruction accords with a database grammar specification corresponding to the target query database; if not, performing grammar conversion on the data query instruction based on a preset grammar tree analysis mode to obtain a target data query instruction; and performing data query based on the target data query instruction. According to the method, when the data query instruction does not conform to the grammar specification of the target database, grammar conversion can be performed on the data query instruction, and data query is performed based on the target data query instruction obtained after conversion; therefore, the technical problems that in the prior art, during cross-database query, query scripts need to be frequently modified to adapt to grammar differences of different database engines, time is consumed, and errors are prone to occurring are solved.

A system and method include receiving, by a database engine of a database system associated with a virtual computing system, a user request via a dashboard for provisioning a source database with the database system, receiving, by the database engine via the dashboard, selection of a database engine type, and receiving, by the database engine via the dashboard, selection of a Service Level Agreement (“SLA”) and a protection schedule. The system and method also include provisioning, by the database engine, the source database based upon the database engine type, creating, by the database engine, an instance of a database protection system based upon the SLA and the protection schedule, including associating the instance of the database protection system with the source database, and displaying, by the database engine, the source database within the dashboard.

The application discloses a financial-grade database multidimensional security management and control system and method, relates to the technical field of financial data security management and control, and deploys a quantum encryption network and a backup key pool; initializes a data hierarchical management mechanism and a key management hub; transforms a database engine and builds a trusted audit hub, and deploys a security agent on a database node. Through the cooperation of the quantum encryption network and the post-quantum backup key pool, the high security of quantum encryption is utilized to resist traditional and quantum computing threats, and the encryption service is ensured not to be interrupted when the quantum network is abnormal, thereby meeting the continuity requirement of financial transactions; fine-grained data grading is combined with a differentiated security strategy, encryption algorithms, access permissions and retention periods are configured for high-sensitive, medium-sensitive and low-sensitive data respectively, precise protection is realized, and operation efficiency is taken into account; and a multi-role key cooperation mechanism avoids single-point key leakage, and the original key is destroyed after the key is generated, so that the key security is further improved.

The application discloses a processing method of cross-engine transactions, which can be applied to a database system, the database system can at least include a first database engine and a second database engine, and the method comprises the following steps: acquiring timing information, the timing information can indicate that a first sub-transaction of a first cross-engine transaction is not later than a first sub-transaction of a second cross-engine transaction in performing a target operation, the target operation can be accessing data in the first database engine, and according to the acquired timing information, it can be determined that data first accessed by a second sub-transaction of the first cross-engine transaction in the second database engine is not later than data first accessed by a second sub-transaction of the second cross-engine transaction in the second database engine in timing, so that the data accessed by the two cross-engine transactions is consistent in timing. In addition, the application also discloses a processing device, equipment and medium of cross-engine transactions.

Embodiments utilize pattern recognition to generate notifications in connection with analytical applications. A dashboard of the analytical dashboard is scanned to intake charts of data therefrom. Images of the charts are created, and then matched with repository patterns of a trained deep transfer model (such as a Convolutional Neural Network model). Upon matching of a pattern by the model, an alert is generated and communicated to a user to indicate a trend in the analytical data. In this manner, embodiments automatically detect data trends based upon their visual appearance when plotted in a chart, rather than through resource-intensive analysis of individual data point values. In specific embodiments, the pattern recognition may be implemented by an in-memory database engine of an in-memory database responsible for storing charts and / or chart images and / or the repository. In some embodiments, recognition of patterns in chart images may be implemented by a service.

Database data of a database service may be privately shared across provider network regions. A database producer can authorize an account of to access a database in another region of the provider network. The consumer of the database can associate the database in order to accept the permission to access the database. The database can then be created as an external table at a consumer database engine and metadata for the database privately shared between producer and consumer database engines that can be used to query the external table.

The present application discloses an operation method, system, storage medium, and computer terminal for a database. Among them, the method includes: transmitting a ciphertext operation request sent by a database engine to the on-chip storage of a processor, where the ciphertext operation request is used to represent an operation request obtained by encrypting an original operation request; processing the original operation request through an atomic operation module in the on-chip storage to obtain an original operation result, where the atomic operation module runs in the trusted area of the processor; returning the ciphertext operation result from the on-chip storage to the database engine, where the ciphertext operation result is used to represent an operation result obtained by encrypting the original operation result, and the database engine is used to operate on the data stored in the database based on the ciphertext operation result. The present application solves the technical problem in the related art that when the database runs in the trusted area of the processor, the security of operating on the database is not high.

The invention relates to the technical field of computer data management, and particularly discloses a data management method, device and equipment and a storage medium, and the method comprises the steps: deploying a monitoring agent in a database engine layer in a data management system, and collecting data magical reading information in a specific time period in real time; calculating a data magical reading possibility coefficient in the database in a specific time period, and performing hierarchical early warning operation on the data by combining the data magical reading possibility coefficient based on a set judgment rule; and finally, comprehensive adjustment of the cache amount of the database and the adjustment amount of the connection pool is realized. Through implementation of the steps, the stability and reliability of the database are enhanced, and the resource utilization rate and the response speed of the system are remarkably improved. In the modern data intensive application, the complexity and dynamics of data operation require that the system has higher intelligence and automation level. Not only are the requirements of a current data management system for high performance and high reliability met, but also a sustainable development path is provided for future data management.

The application relates to the technical field of data calculation, and provides an index calculation method and device, which comprises the following steps: storing a plurality of target index groups generated by an electronic spreadsheet software and corresponding configurable files; wherein the configurable files represent the calculation rules of the values of the plurality of original indexes for determining the values of the business indexes in the corresponding target index groups; determining an index calculation request; wherein the index calculation request carries a target index group or the identification of the target index group; determining the values of the plurality of original indexes matched by the target index group; calling a database engine to calculate the values of the plurality of original indexes matched by the target index group based on the calculation rules indicated by the configurable file matched by the target index group, so as to determine the values of the business indexes in the target index group. The configurable file of the target index group is maintained by using the electronic spreadsheet software, the dimension difficulty is reduced, the calculation process of the business indexes is converted into the execution process of the database engine, and the extension is facilitated.

An embodiment of the present application discloses a data writing method and electronic device, which are applied to the first node of an etcd cluster, the first node being the master node of the etcd cluster, the method comprising: receiving a data write request including a first key-value pair; when conditions are met, writing the first key-value pair into memory by calling the data write interface of a database adaptation layer to call the data write interface of a database engine, the database adaptation layer being used to encapsulate the interface provided by the database engine into an interface identical to that of boltdb, the database engine being based on an LSM-Tree structure, and the database engine being the database engine used by the etcd storage layer. In an embodiment of the present application, a database engine based on an LSM-Tree structure can be encapsulated by the database adaptation layer, so that the first node can write data by calling the data write interface of the database adaptation layer, thereby improving the write performance of etcd.

The automatic detection of inconsistencies in a database system is described. A first signature and a second signature are received. The first signature is a signature of a result of a first execution of the query against a database by a first version of database engine program code. The second signature is a signature of a result of a second execution of the query by a second version of the database engine program code. A determination is made of whether the first signature and the second signature match. In response to the first signature and the second signature failing to match, an inconsistency report regarding at least one of the first or second versions of the database engine program code is generated and remediation regarding at least one of the first or second versions of the database engine program code is performed.

The embodiment of the invention provides a method, device and equipment for generating a database, a storage medium and a computer program product. The method includes receiving a user input for generating a database. The method further comprises the step of obtaining a code of a target database, wherein the code of the target database is generated by the target model according to user input. And displaying a data table of a target database on the interface, wherein the target database is generated by executing the code by the database engine. The method further includes displaying the updated data table on the interface according to the adjustment in response to receiving the adjustment for the data table. According to the method disclosed by the embodiment of the invention, the machine learning model is combined with the database engine, so that not only can the database code meeting the user input be generated, but also the database can be generated by executing the code, namely, the customized database is generated and previewed in a one-key manner, and the generation efficiency of the database and the user experience are greatly improved.

The invention discloses a financial-level database multi-dimensional security management and control system and method, and relates to the technical field of financial data security management and control. A quantum encryption network and a standby key pool are deployed; initializing a data level-to-level management mechanism and a key management center; a database engine is transformed, a credible auditing center is built, and a security agent is deployed at a database node. According to the invention, through cooperation of the quantum encryption network and the post-quantum standby key pool, high security of quantum encryption is utilized to resist traditional and quantum computing threats, encryption service is ensured not to be interrupted when the quantum network is abnormal, and the requirement of financial transaction continuity is met; fine-grained data grading is combined with a differentiated security policy, an encryption algorithm, an access permission and a retention period are configured for high-sensitivity, medium-sensitivity and low-sensitivity data respectively, and the operation efficiency is considered while precise protection is achieved; a multi-role key cooperation mechanism avoids leakage of a single-point key, and the key security is further improved by combining the design that the original key is destroyed after the key is generated.

The present application provides systems and methods that can generate an efficient architecture and method for multiple database engines to write to a shared data store to eliminate global locks during the write process. The systems and methods can use a common log layer between the shared data store and the compute database nodes, where write conflict detection is implemented using write-ahead logging and log sequence numbers. The write-write conflict check for the write-ahead log records received from the database engines of multiple database engines can be performed by comparing the log sequence numbers received from the database engines together with the write-ahead log records with the global log sequence numbers in the hash table in the common log. After the write-ahead log record passes the write-write conflict check, the write-ahead log record can be sent to the shared data store.

The invention discloses a multi-stage verification method and system for a business object data migration process and a server. The method comprises the following steps: verifying a to-be-migrated object generated according to a migration demand; after a data migration packet generated based on the to-be-migrated object enters a mapping engine for migration data conversion, field-level verification is carried out; and after the mapping is completed, analyzing a return code of the database engine for returning a write-in result in real time. According to the method, the problems of incomplete coverage, lack of pertinence and low automation degree of data migration verification are solved, accurate identification and intelligent disposal of abnormal behaviors in each migration link are realized, and the integrity, accuracy and smoothness of data migration are improved.