79 results about "Database engine" patented technology

The invention discloses an intelligent access API generation method, system and device and a medium, and the method specifically comprises the steps: generating a dynamic dragging interface based on user role information, and obtaining function access parameters customized by a user through the dynamic dragging interface; according to semantic features and operation sequences in historical user interaction data, user intentions are analyzed, and target data topic logic is generated in combination with function access parameters; converting the subject logic of the target data into an executable query statement by utilizing an SQL splicing tool, and recommending an index optimization scheme to a database engine based on a high-frequency condition and field combination in a historical query mode; and distributing the optimized executable query statements to Serverless workflow nodes adapted to different query engines for execution, and packaging returned data into a standardized API (Application Program Interface) for output. According to the method and the device, full-process automation from parameter customization by a user to standardized API output is realized, and the efficiency and the flexibility of data acquisition are remarkably improved.

A method for managing a data stream (DS) includes: receiving a first request from an administrator; obtaining the DS from a streaming storage system (SSS); performing a first analysis of the DS to extract relevant data; making a first determination that the relevant data is worth indexing; generating a set of indexes corresponding at least a portion of the DS; receiving a query about a data item in the DS from a user; sending a second request to a database engine comprising the query; performing a second analysis of the query; making a second determination that a re-indexing of the portion of the DS is not required; identifying an index from the set of indexes that is associated with the query; sending position information of the data item to an API service; retrieving the data item from the SSS; and initiating displaying of the data item to the user.

According to the efficient matching method for the GIS multi-scale basic geographic space data, a multi-scale matching scheme based on geographic space database optimization is improved, firstly, a spatial database model based on a relational database and a spatial database engine is used as a method for storing the multi-scale basic geographic space data, and the method is high in storage speed and flexible in application; 2, establishing a new object selection method for multi-scale geographic space data matching, organizing a basic geographic entity in a data structure form of a multi-way tree based on a multi-scale semantic change rule of geographic space data, and establishing a category matching method for semantic change of the same element category of different proportional scales; a category matching relationship under a multi-scale condition is effectively constructed; and thirdly, an optimization scheme for multi-scale basic geographic space data matching is established, the matching effect is good, and the operation efficiency is high. Spatial data fusion can be efficiently realized, the spatial data quality is improved, and the map database updating efficiency is improved.

A data storage method includes deploying a data storage service system including two nodes on a wheeled mobile device, where the wheeled mobile device is an intelligent vehicle, an autonomous vehicle, or a connected vehicle; running a first process on a first node; running a second process on a second node, where the first node is a primary node and the second node is a secondary node; invoking, by the first node, a first database engine using the first process to write data to a first storage module on the first node when the first node receives a data write request; and enabling by the first node, in a blocking mode, the second node to invoke a second database engine using the second process to perform a same data write operation on a second storage module on the second node.

The invention relates to the technical field of database analysis, in particular to a database upgrading method, which comprises the following steps of: establishing a double-engine parallel environment, starting new and old version database engines and constructing a cross-version communication channel; in response to the established communication channel, the client request is routed to the new and old engines in parallel for execution through the transaction dispatcher; based on a transaction operation log generated by an old engine, data change features are analyzed in real time, and an increment synchronization instruction set is generated; implementing version-coordinated transaction lock management when the new engine performs data playback according to the generated incremental synchronization instruction set; after the data consistency verification of the preset period is completed, switching a transaction route to a new engine and closing an old engine write-in channel; through double-engine parallel processing, incremental data synchronization and a cross-version lock coordination mechanism, the purposes of no service interruption and high data consistency in the database version upgrading process are achieved.

The embodiment of the invention provides a buffer management method, device and equipment based on object storage and a medium, and relates to the technical field of database systems.The method comprises the steps that metadata of a database is divided into root metadata and secondary metadata according to a hierarchical structure; for each data modification operation in the buffer area, generating a log corresponding to each data modification operation; mapping the buffer area into a virtual directory for object storage, storing the log in the virtual directory according to a second version number, and storing a data modification record of the buffer area in a HashMap of a shared memory; when the metadata is updated, the reference relationship between the root metadata and the secondary metadata is maintained; when data in the buffer area is read, effective log versions are read in sequence, playback is carried out step by step according to version numbers, and data corresponding to the latest version number is generated and returned to a user. According to the method, the consistency and the storage efficiency of the data are improved, and efficient operation of the database engine on object storage is realized.

The invention belongs to the technical field of databases, and particularly discloses a storage method and device based on cold and hot data separation and a multi-mode database engine, and the method comprises the steps: monitoring a row storage table and a column storage table; under the condition that the cold data exists in the row storage table, transferring and storing the cold data on the row storage table into the column storage table; under the condition that the hot data exists in the column storage table, transferring and storing the hot data on the column storage table into the row storage table; the row storage table is used for storing hot data, the column storage table is used for storing cold data, one piece of storage data is stored in the row storage table or the column storage table in a single copy mode, the access frequency of the hot data is higher than that of the cold data, the row storage table is borne by a row storage engine, and the column storage table is borne by a column storage engine. According to the method and the device, the row storage table for storing the hot data is borne by the row storage engine, and the column storage table for storing the cold data is borne by the column storage engine, so that the storage system can support mass data query and analysis and also can efficiently perform DML operation.

The embodiment of the invention provides a database processing method and device, a storage medium and a program product, and the method comprises the steps: obtaining target data through an interaction interface of a preset model deployed in a database engine; according to the target data, generating decision suggestion information through a preset model; and generating an operation and maintenance instruction according to the decision suggestion information, transmitting the operation and maintenance instruction to a target execution unit in the database engine through the interactive interface, and executing the operation and maintenance instruction through the target execution unit. According to the embodiment of the invention, the preset model is tightly coupled with the database engine, so that analysis and decision can be efficiently performed in real time in the database system, the operation and maintenance efficiency of the database system is effectively improved, and the intelligent automatic monitoring, learning and intelligent operation and maintenance capabilities of the database system can be realized; and the database system can respond and process business requirements more efficiently and stably.

Methods for replicating transactional tables of a transactional database to a recipient system, such as an analytical database, and maintaining updates to those transactional table representations are disclosed. More particularly, change-data-capture items are generated by a transport engine, that is separate from a database engine for the transactional database. Also, schema data is maintained out-of-band from the database engine and is stitched with committed change payload contents by the transport engine.

The invention discloses a financial investment and financing management platform based on artificial intelligence big data, relates to the technical field of financial data management, and solves the problems that a full-database engine search mode is adopted, not only is computing power resources of a search engine excessively relied on, but also data output is slow due to synchronization. According to the invention, the multi-thread entry regulation and control end uses the preset thread to carry out entry according to the data type, so that the entry efficiency is improved; by monitoring the entry rate and the standard entry rate in real time and dynamically deploying computing power resources, thread load balance is ensured, threads are prevented from scrambling for a memory and losing packets, and the entry effect and data integrity are ensured; an index vector construction end generates a feature vector circle and a node index vector according to a storage node path, and generates an index table in combination with a classification data header, so that rapid data indexing is realized, a complex hierarchy path is converted into a visual index vector, and the indexing accuracy and speed are improved.

A system for delegation of authorization management of a shared database of a database service is described. The database service includes a control plane and a producer database engine. The producer database engine receives a creation request to create a datashare for a database. The creation request delegates, to a data exchange service, authorization management to access the datashare. The control plane is configured to update permission data for the datashare to indicate that authorization to the datashare is managed by the data exchange service. The producer database engine is further configured to receive a request, from a consumer database engine, to obtain metadata used to perform a query to the database of the datashare, determine that the data exchange service authorized the consumer database engine to access the datashare based on the permission data for the datashare, and return the metadata to the consumer database engine.

The invention discloses a definition-based data copying and migrating method, which comprises the following steps of: reading user configuration data, and analyzing and recombining the configuration data; performing mode algorithm processing on the mode structure to obtain a statement trunk; performing configuration algorithm processing on the configuration structure to obtain statement conditions; performing data structure and grammar analysis algorithm processing on the data structure to obtain a table name, a field and an affiliated rule; processing the statement trunk and the statement condition by adopting an assembly algorithm, and generating a dynamic statement with the table name, the field and the affiliated rule; performing batch execution and performing log recording; judging whether inverse operation is needed or not, if the inverse operation is needed, returning to the first step, and if the inverse operation is not needed, backing up the data. According to the scheme, a database data migration tool is provided, compatibility and adaptation of any database and any type are achieved, and meanwhile the most compatible type is automatically adapted to use according to the database engine.

The present invention relates to the technical field of computer data management, and specifically discloses a data governance method, device, equipment and storage medium. By deploying a monitoring agent at the database engine layer in the data management system, data phantom read information within a specific time period is collected in real time; the probability coefficient of data phantom read in the database within a specific time period is calculated, and based on a set judgment rule, combined with the data phantom read probability coefficient, a hierarchical early warning operation is performed on the data; finally, a comprehensive adjustment is made to the cache volume and connection pool adjustment volume of the database. The implementation of these steps not only enhances the stability and reliability of the database, but also significantly improves the resource utilization rate and response speed of the system. In modern data-intensive applications, the complexity and dynamics of data operations require the system to have a higher level of intelligence and automation. It not only meets the current requirements of data management systems for high performance and high reliability, but also provides a sustainable development path for future data governance.

The invention relates to an interactive monitoring method and device for a database running state and electronic equipment. The method comprises the steps that when an interaction instruction in a digital or keyword form input by a user is received, a database running state index is obtained from the interior of a database engine; according to a preset diagnosis rule, key indexes are extracted from the database operation state indexes, the key indexes are integrated, and a refined index set is generated; the refining index set is used as an analysis object, index analysis of the corresponding analysis dimension is triggered according to the interaction instruction, and an analysis result is obtained; and performing layered display on the refining index set based on an analysis result. The technical problem that existing database monitoring lacks real-time performance, flexibility and operation efficiency is solved.

This application provides a data sorting method, a database engine, and a storage medium. In this application, for scenarios involving multi-column sorting, the data rows to be sorted are first grouped according to the clustering column. Then, the sorting is performed between and within each data group according to the sorting column, using the same sorting order. The sorting result obtained in this way retains the clustering characteristics of the clustered columns while essentially ensuring the global order of the data, which is beneficial for improving the computational performance related to the clustered columns. Especially when querying based on the sorting result, it ensures that the performance of queries by data range is largely unaffected, while significantly improving the performance of queries by data grouping.

The invention provides a resource scheduling method and device, electronic equipment, a computer readable storage medium and a computer program product, and is at least applied to the technical field of cloud platform, the method comprises the following steps: using a resource acquisition module to regularly send a resource information acquisition request to each database engine; obtaining first resource information collected by a query resource collection module in each database management module; determining second resource information consumed by the database engine based on the first resource information; a resource acquisition module is utilized to construct a resource consumption request according to the second resource information consumed by each database engine, and the resource consumption request is sent to a flow control module; and determining residual resource information by using a flow control module according to the second resource information consumed by each database engine and a preset resource threshold. Through the method, the residual resource information can be periodically updated, so that the cloud platform schedules the resource to execute the query request, and the resource utilization rate is improved.

The invention relates to the technical field of data processing, can be applied to the field of medical health, and discloses a database double-cache optimization method, device, equipment and medium, and the method comprises the following steps: receiving configuration parameters which are input by a user and are used for triggering a direct I / O mode, and configuring a database according to the configuration parameters, the configuration parameters comprise a plurality of different file types; in response to the fact that the configuration of the database takes effect, performing integral multiple alignment of the size of a predefined block on a heap memory, a stack memory and a shared memory of a memory buffer area of the database; if it is detected that the file type of the received to-be-processed data belongs to one file type in the configuration parameters, a direct I / O mode is triggered, and the to-be-processed data is directly processed based on the aligned memory buffer area and a storage device of an operating system, so that a database engine can directly perform data interaction with the storage device; and the operation system cache is bypassed, so that the data processing efficiency of the medical system is remarkably improved.

The automatic detection of inconsistencies in a database system is described. A first signature and a second signature are received. The first signature is a signature of a result of a first execution of the query against a database by a first version of database engine program code. The second signature is a signature of a result of a second execution of the query by a second version of the database engine program code. A determination is made of whether the first signature and the second signature match. In response to the first signature and the second signature failing to match, an inconsistency report regarding at least one of the first or second versions of the database engine program code is generated and remediation regarding at least one of the first or second versions of the database engine program code is performed.

The present invention discloses a financial investment and financing management platform based on artificial intelligence big data. The present invention relates to the technical field of financial data management, and solves the problem that the method of using a full database engine search not only overly relies on the computing power resources of the search engine, but also causes slow data output. The present invention improves the input efficiency through the multi-threaded input control terminal that inputs according to the data type using preset threads; by real-time monitoring the input rate and the standard input rate, dynamically allocating computing power resources to ensure thread load balancing, avoiding thread memory contention and packet loss, and ensuring the input effect and data integrity; the index vector construction terminal generates a feature vector circle and a node index vector according to the storage node path, and generates an index table in combination with the classification data header to achieve fast data indexing, converting complex hierarchical paths into intuitive index vectors, and improving the index accuracy and speed.

The invention discloses a data query method, device and equipment and a storage medium, and relates to the technical field of data processing.The method comprises the steps that a data query instruction and a target query database corresponding to a current data query task are determined according to a data query request; detecting whether the data query instruction accords with a database grammar specification corresponding to the target query database; if not, performing grammar conversion on the data query instruction based on a preset grammar tree analysis mode to obtain a target data query instruction; and performing data query based on the target data query instruction. According to the method, when the data query instruction does not conform to the grammar specification of the target database, grammar conversion can be performed on the data query instruction, and data query is performed based on the target data query instruction obtained after conversion; therefore, the technical problems that in the prior art, during cross-database query, query scripts need to be frequently modified to adapt to grammar differences of different database engines, time is consumed, and errors are prone to occurring are solved.

The present invention provides a method and device for calling game configuration data, a storage medium, and an electronic device, the method comprising: reading configuration information of a plurality of source table files, wherein the configuration information is used to indicate data usage rules of the source table files; for each source table file, exporting the game configuration data in the source table file to a database file of a database engine based on the configuration information, wherein the database file is stored on a disk; and using an embedded script to call the game configuration data from the database file to a memory. The present invention solves the technical problem of high memory usage of calling game configuration data from the outside in the related technology, and effectively reduces the memory usage at runtime.

A system and method include receiving, by a database engine of a database system associated with a virtual computing system, a user request via a dashboard for provisioning a source database with the database system, receiving, by the database engine via the dashboard, selection of a database engine type, and receiving, by the database engine via the dashboard, selection of a Service Level Agreement (“SLA”) and a protection schedule. The system and method also include provisioning, by the database engine, the source database based upon the database engine type, creating, by the database engine, an instance of a database protection system based upon the SLA and the protection schedule, including associating the instance of the database protection system with the source database, and displaying, by the database engine, the source database within the dashboard.

The application discloses a financial-grade database multidimensional security management and control system and method, relates to the technical field of financial data security management and control, and deploys a quantum encryption network and a backup key pool; initializes a data hierarchical management mechanism and a key management hub; transforms a database engine and builds a trusted audit hub, and deploys a security agent on a database node. Through the cooperation of the quantum encryption network and the post-quantum backup key pool, the high security of quantum encryption is utilized to resist traditional and quantum computing threats, and the encryption service is ensured not to be interrupted when the quantum network is abnormal, thereby meeting the continuity requirement of financial transactions; fine-grained data grading is combined with a differentiated security strategy, encryption algorithms, access permissions and retention periods are configured for high-sensitive, medium-sensitive and low-sensitive data respectively, precise protection is realized, and operation efficiency is taken into account; and a multi-role key cooperation mechanism avoids single-point key leakage, and the original key is destroyed after the key is generated, so that the key security is further improved.

Systems, methods, and devices are described for performing scalable data processing operations. A queue that includes a translatable portion comprising indications of data processing operations translatable to data queries and a non-translatable portion comprising indications of non-translatable data processing operations is maintained. A determination that a first data processing operation of a first code block statement is translatable to a database query is made. An indication of the first data processing operation is included in the translatable portion of the queue. Responsive to a determination that a second data processing operation of a second code block statement is undeferrable, the translatable portion of the queue is compiled into a database query. An execution of the database query to be executed by a database engine to generate a query result is caused. A result dataset corresponding to the query result is transmitted to an application configured to analyze the result dataset.

The application discloses a processing method of cross-engine transactions, which can be applied to a database system, the database system can at least include a first database engine and a second database engine, and the method comprises the following steps: acquiring timing information, the timing information can indicate that a first sub-transaction of a first cross-engine transaction is not later than a first sub-transaction of a second cross-engine transaction in performing a target operation, the target operation can be accessing data in the first database engine, and according to the acquired timing information, it can be determined that data first accessed by a second sub-transaction of the first cross-engine transaction in the second database engine is not later than data first accessed by a second sub-transaction of the second cross-engine transaction in the second database engine in timing, so that the data accessed by the two cross-engine transactions is consistent in timing. In addition, the application also discloses a processing device, equipment and medium of cross-engine transactions.

Embodiments utilize pattern recognition to generate notifications in connection with analytical applications. A dashboard of the analytical dashboard is scanned to intake charts of data therefrom. Images of the charts are created, and then matched with repository patterns of a trained deep transfer model (such as a Convolutional Neural Network model). Upon matching of a pattern by the model, an alert is generated and communicated to a user to indicate a trend in the analytical data. In this manner, embodiments automatically detect data trends based upon their visual appearance when plotted in a chart, rather than through resource-intensive analysis of individual data point values. In specific embodiments, the pattern recognition may be implemented by an in-memory database engine of an in-memory database responsible for storing charts and / or chart images and / or the repository. In some embodiments, recognition of patterns in chart images may be implemented by a service.

Database data of a database service may be privately shared across provider network regions. A database producer can authorize an account of to access a database in another region of the provider network. The consumer of the database can associate the database in order to accept the permission to access the database. The database can then be created as an external table at a consumer database engine and metadata for the database privately shared between producer and consumer database engines that can be used to query the external table.

The present application discloses an operation method, system, storage medium, and computer terminal for a database. Among them, the method includes: transmitting a ciphertext operation request sent by a database engine to the on-chip storage of a processor, where the ciphertext operation request is used to represent an operation request obtained by encrypting an original operation request; processing the original operation request through an atomic operation module in the on-chip storage to obtain an original operation result, where the atomic operation module runs in the trusted area of the processor; returning the ciphertext operation result from the on-chip storage to the database engine, where the ciphertext operation result is used to represent an operation result obtained by encrypting the original operation result, and the database engine is used to operate on the data stored in the database based on the ciphertext operation result. The present application solves the technical problem in the related art that when the database runs in the trusted area of the processor, the security of operating on the database is not high.

The invention relates to the technical field of computer data management, and particularly discloses a data management method, device and equipment and a storage medium, and the method comprises the steps: deploying a monitoring agent in a database engine layer in a data management system, and collecting data magical reading information in a specific time period in real time; calculating a data magical reading possibility coefficient in the database in a specific time period, and performing hierarchical early warning operation on the data by combining the data magical reading possibility coefficient based on a set judgment rule; and finally, comprehensive adjustment of the cache amount of the database and the adjustment amount of the connection pool is realized. Through implementation of the steps, the stability and reliability of the database are enhanced, and the resource utilization rate and the response speed of the system are remarkably improved. In the modern data intensive application, the complexity and dynamics of data operation require that the system has higher intelligence and automation level. Not only are the requirements of a current data management system for high performance and high reliability met, but also a sustainable development path is provided for future data management.

The application relates to the technical field of data calculation, and provides an index calculation method and device, which comprises the following steps: storing a plurality of target index groups generated by an electronic spreadsheet software and corresponding configurable files; wherein the configurable files represent the calculation rules of the values of the plurality of original indexes for determining the values of the business indexes in the corresponding target index groups; determining an index calculation request; wherein the index calculation request carries a target index group or the identification of the target index group; determining the values of the plurality of original indexes matched by the target index group; calling a database engine to calculate the values of the plurality of original indexes matched by the target index group based on the calculation rules indicated by the configurable file matched by the target index group, so as to determine the values of the business indexes in the target index group. The configurable file of the target index group is maintained by using the electronic spreadsheet software, the dimension difficulty is reduced, the calculation process of the business indexes is converted into the execution process of the database engine, and the extension is facilitated.