214 results about "Database services" patented technology

Computer implemented methods, systems, and computer program products include program code executing on a processor(s) obtains queries from sources via a query interface. The program code analyzes the queries to obtain attributes of the queries. The program code applies a trained classifier to the attributes to classify the queries into finite categories based on a predicted usage of a given resource type exceeding a pre-determined threshold and an anticipated execution duration for each query. The program code determines, based on the finite categories of the one or more queries and resource configurations of resources comprising the database service, which resource of the resources can efficiently execute each query of the one or more queries. The program code schedules each query of the one or more queries for execution by the determined resources.

Techniques for dynamic database redaction using protected encryption secret material are described. A masking policy is defined that includes a reference to a secret material stored by a secrets manager service. The masking policy further identifies a pseudonymous redaction function that utilizes a cryptographic function requiring such a secret material. The secrets manager service is configured to grant access to the secret material by an entity of the database service that executes queries, such as a leader node of a cluster. For a particular query, the cluster obtains the secret material from the secrets manager service in a secure manner, uses the secret material for applying the cryptographic function to values for redaction purposes, and deletes any copies of secret material thereafter.

The invention discloses a database malicious behavior detection and blocking method and system based on multi-dimensional features, and the method comprises the steps: collecting performance index data in real time, and sequentially carrying out the smoothing and normalization of the performance index data, and constructing a time sequence feature vector; performing analysis and feature extraction on the network flow data to obtain an abnormal connection mode feature vector; inputting the collected multi-dimensional feature vectors into an improved factorization machine, and performing feature crossing and dimension reduction processing by using an MFB pooling technology to obtain dimension-reduced feature vectors; inputting the dimension reduction feature vector into a dual-mode collaborative detection mechanism composed of an XGBoost decision tree model and a DRL model, and outputting a dynamic risk detection result; starting a hierarchical blocking strategy based on the risk level in the dynamic risk detection result; the method realizes closed-loop protection of feature extraction, risk rating and hierarchical blocking, has adaptive threshold adjustment and batch detection acceleration capabilities, and ensures continuity and high efficiency of database services.

The invention belongs to the technical field of computer software, and particularly relates to a heterogeneous database unified deployment management method based on a cluster management platform, which comprises the following steps: predefining metadata of various database services; the method comprises the following steps: pre-constructing a multi-version program package warehouse, and establishing a structured warehouse directory system; obtaining a chip architecture and an operating system type of the target node, and generating environment fingerprint information; dynamically selecting a database installation package matched with the current environment and a dependency item set of the database installation package by mapping a warehouse directory system; through a unified database adaptation layer, a standardized operation interface is called, and installation, configuration and start-stop operation of the database are executed; a visual deployment and arrangement function based on component roles is provided by expanding a Web service interface of the management platform; and according to a deployment arrangement result and the environment fingerprint information, calling a deployment script to complete automatic deployment and configuration of the database cluster. According to the invention, unified adaptation, deployment and full-life-cycle management of various domestic databases are realized.

A system for a multi-tenant API framework in scalable cloud-based database solutions, which includes the following: an API layer module that enables access to database services for multiple tenants; a tenant management module configured to handle tenant authentication, authorization, and role-based access control; a data partitioning module for partitioning tenant-specific data into isolated database structures; a resource allocation module for the dynamic allocation of computing resources to individual tenants based on usage patterns; a security module configured to protect tenant data through encryption and secure data transmission; A monitoring and analysis module for real-time monitoring of tenant activities and system performance.

The invention provides a database node switching method, device and equipment based on hardware faults. Comprising the steps that node fault information of at least one node of a database is acquired, and the fault information of each node is used for indicating the hardware fault condition of the node; for each node, determining a fault type according to the node fault information of the node, and determining a fault processing instruction according to the fault type; and reporting the fault processing instruction to a database management platform. According to the technical scheme, the switching efficiency of the database fault nodes is improved, and the continuity of database services is ensured.

The invention discloses an RDMA Chain-based LSM Tree key value type database access method. The method comprises the following steps: a database client sends a request containing a version number, a key and an operation type to a database server main node; the server main node analyzes the request and processes the request according to the operation type; during write operation, a new serial number is generated, and data is inserted into a skip list of a memory table MemTable; when reading operation is carried out and the version number is smaller than 0, whether a key exists or not is checked through a Bloom filter, if yes, query is carried out at a secondary node through the RDMA technology, and if not, an SSTable file in a disk is directly accessed; and when the reading operation is performed and the version number is greater than or equal to 0, preferentially searching the data of the corresponding version in the MemTable, and if the data of the corresponding version fails, querying the SSTable. Through the RDMA technology, CPU occupation and network round-trip time are reduced, and the response speed and concurrent processing capacity of the system are improved.

The invention provides a garlic planting full-process database service system based on agricultural big data, which relates to the technical field of agricultural planting and comprises a planting planning module, a seeding management module, a growth monitoring module, a topdressing irrigation management module, a pest control module and a harvesting decision module. The planting planning module accurately matches varieties and base fertilizer formulas according to soil and yield data; the seeding management and growth monitoring module dynamically optimizes planting measures in combination with real-time data and historical experience; the topdressing irrigation module, the pest control module and the harvesting decision-making module utilize technologies such as image recognition and spectrum detection to realize a precise and scientific management strategy, effectively improve the resource utilization rate, reduce the influence of environmental fluctuation on garlic growth, reduce the use of chemical agents, realize full-process data driving by integrating multi-source data, and improve the management efficiency. Meanwhile, a complete planting file is formed to support strategy iteration, large-scale and efficient development of garlic planting is facilitated, and then the economic benefits of garlic planting are effectively improved.

The embodiment of the invention relates to a database access system of a compound database. The system comprises a database service gateway, a request message queue, a feedback message queue, a message processing module, a cache message queue, a database management module, a user permission configuration table, an operation approval configuration table and the compound database, the database service gateway is respectively connected with the request message queue and the feedback message queue; the message processing module is respectively connected with the request message queue, the feedback message queue and the cache message queue; and the database management module is respectively connected with the cache message queue, the user permission configuration table, the operation approval configuration table and the compound database. Through the method, the waste rate of storage resources can be reduced, and the overall task processing performance of the database is improved.

The invention relates to an openGauss database mirror image backup recovery method and an openGauss database mirror image backup recovery device. The method comprises the following steps: executing full backup, and backing up a dependency item of database service, a data file and a WAL file; incremental backup is executed, and only the data pages and the WAL files which are changed since the last backup are backed up; and executing recovery operation: executing full-amount recovery and specified time point recovery, and supporting single-node recovery and cluster recovery. According to the openGauss database mirror image backup and recovery method based on the CDM technology flow, the backup and recovery efficiency is remarkably improved through the functions of original format backup, incremental backup, specified time point recovery and the like; the method is high in flexibility, supports full backup, incremental backup and specified time point recovery, and can meet backup requirements in different scenes; according to the method, the backup data is kept in a native format, additional processing is not needed during recovery, and data integrity and availability are ensured.

Computer implemented methods, systems, and computer program products include program code executing on a processor(s) obtains queries from sources via a query interface. The program code analyzes the queries to obtain attributes of the queries. The program code applies a trained classifier to the attributes to classify the queries into finite categories based on a predicted usage of a given resource type exceeding a pre-determined threshold and an anticipated execution duration for each query. The program code determines, based on the finite categories of the one or more queries and resource configurations of resources comprising the database service, which resource of the resources can efficiently execute each query of the one or more queries. The program code schedules each query of the one or more queries for execution by the determined resources.

The invention discloses a method and device for realizing integrity protection of sensitive data of a database, and belongs to the technical field of database security, and the method comprises the following steps: identifying sensitive data of a key column of a data table in a target database through an encryption system, and recording the sensitive data as key data; integrity protection is configured for the key data, and a digital signature is applied; the method comprises the following steps: calculating an abstract value of key data by using an SM3 hash algorithm, and calculating related sensitive information of the current key data and an MAC value of a system key at the same time; the database service system accesses the key data through the proxy connection of the encryption system, data modification or new data insertion is carried out, that is, a service user carries out data entry and storage; the encryption system compares whether the MAC value of the related sensitive information of the current key data is consistent with the MAC value of the related sensitive information of the last key data, and returns a comparison result to the system; and displaying a data state corresponding to a comparison result returned by the system on a system web page.

A Chinese examination system suitable for learners with diverse backgrounds, the system comprising: a server, a client and a data transmission network, wherein the client is a terminal device for a Chinese examination; the server provides a database service for the Chinese examination; the data transmission network is connected to the server and the client and is used for guaranteeing data transmission between the server and the client; when the Chinese examination is started, the server pushes corresponding test question information on the basis of examinee information provided by the client, the client transmits a corresponding question-answering situation to the server, the server automatically determines the difficulty level of the next round of test questions on the basis of the question-answering situation provided by the client and pushes the next round of test questions to the client, and execution is repeatedly triggered until a corresponding number of test questions is completed; and the server compiles statistics on the basis of all question-answering situations provided by the client.

The invention provides a database system access control method and device, a database system, a storage medium and a computer program product, and the method comprises the steps: determining a target protocol service module in a plurality of protocol service modules according to a port number corresponding to access request information sent by a client; using the target protocol service module to generate standardized operation information according to the access request information; a command processing module is used for executing corresponding operation on the database system according to the standardized operation information; using the target protocol service module to generate access response information; and sending the access response information to the client according to the port number. According to the method and the device, access of multiple communication protocols can be synchronously compatible in a database service architecture, multiple communication protocols can be supported in parallel, the processing capacity of a database system for high-concurrency requests is improved, the message analysis efficiency is improved, and the bearing capacity for data streams is improved.

The present disclosure relates to a method and apparatus for realizing cross-instance routing of a structured query statement, and a system. The method comprises: a first database service instance end receiving a structured query statement; the first database service instance end determining whether the structured query statement has the capability to be sent to a second database service instance end; and when it is determined that the structured query statement has the capability to be sent to the second database service instance end, the first database service instance end establishing a connection to the second database service instance end, and forwarding the structured query statement to the second database service instance end for execution. The present disclosure solves the technical problem in the relevant art of the low efficiency in cross-instance data access.

A transaction system receives a transaction request for a database service. The transaction system retrieves, by a first microservice, a set of data from a data access layer of the database service in response to receiving the transaction request. The transaction system performs a set of computations based on the set of data retrieved from the data access layer. The transaction system stores the set of computations in one or more cache nodes of a data access service and accesses, by a second microservice, the set of computations, performed in response to retrieving the set of data by the first microservice, from the one or more cache nodes.

The embodiment of the invention provides a data query method, a database system, equipment, a storage medium and a program product. The method comprises the following steps: when a query request is received, determining a first column table storage mode of a to-be-queried table according to a table name of the to-be-queried table carried in the query request; obtaining a column type storage file of the to-be-queried table; determining a second column storage table mode used when the column storage file is generated according to mode version information correspondingly recorded by the column storage file; obtaining first column data of the to-be-queried column from the column type storage file according to the second column table storage mode and the column name of the to-be-queried column carried in the query request; according to the first column table storage mode and the second column table storage mode, converting the first column data into second column data adaptive to the first column table storage mode; and determining a query result of the query request according to the second column of data. According to the technical scheme provided by the embodiment of the invention, the influence of database mode change on database service can be reduced.

The invention relates to a data processing method and device for a distributed database, equipment and a storage medium. The method comprises the steps of obtaining a database execution instruction sent by a client; in response to the database execution instruction, determining a target fragment function of the distributed database; determining a target data node by using the target fragmentation function; and issuing the database execution instruction to a target data node, so that the target data node executes a corresponding database operation and feeds back an execution result to the client. The calculation nodes do not need to be recompiled in the upgrading process, and database service does not need to be restarted; realizing self-definition of a fragmentation rule by self-defining a fragmentation rule function; according to the method, the distributed database is ensured to continuously serve for the outside without interruption, the simplicity and the flexibility of fragmentation rule replacement of the distributed database are improved, various self-defined requirements of a database user are met, and the distributed database is enabled to meet more business scenes.

Techniques for implementing a scalable key value storage in a distributed storage separate the storage of the collection of data objects from the storage of the index corresponding to the collection. According to an implementation, a database service may receive a request to create a collection of data objects in an object storage. A schema may be specified for the collection. The database service may generate a unique identifier (ID) corresponding to the collection and create the collection in the object storage. The objects in the collection and the associated schema may be further written to an object table and a schema table, respectively. The database service may further validate the schema and extract one or more indexable fields from the schema. The database service may send a request to a database search service to create an index for the collection in an index storage.

Systems and methods are described for allocating computing resources to load data into a database. In some aspects, a database service obtains a request to load a number of data chunks. Responsive to the request, the database service scales a number of worker threads to load the data chunks. The scaling may include selecting a maximum number of worker threads to load (e.g., concurrently) the data chunks based on a number of data chunks, and assigning individual worker threads to load individual data chunks. The scaling may additionally include tracking a number of available worker threads relative to the maximum number of worker threads to reassign a first worker thread to load another data chunk upon the completing loading a prior data chunk, or assign a new worker thread that has become available based on a change in the maximum number of worker threads.

The invention provides a database service platform unification method and device, and the method comprises the steps: deploying a database service platform on a central cloud platform, and installing an Agent program on a virtual machine of a heterogeneous cloud platform for subsequent communication and instruction execution; a user selects required database service through a service directory of a central cloud platform, a service orchestration engine automatically selects a proper heterogeneous cloud platform and a virtual machine according to user requirements and predefined rules, and a deployment scheme is generated; and the central cloud platform sends an instruction to the Agent, and the Agent automatically downloads the database mirror image after receiving the instruction, and creates a database container instance on a selected virtual machine by using a virtualization technology. The method has the beneficial effects that by automatically deploying the script, the rapid deployment of the database is realized, and the error risk of manual operation is reduced; agent communication adopts a secure channel, so that the security of communication is ensured, and sensitive information leakage and illegal access are prevented.

The invention provides an openGauss cluster deployment method based on a cloud platform, belongs to the technical field of cloud computing and databases, and realizes a full-automatic deployment process from virtual machine creation to cluster configuration through the cloud platform, a management back end and a cluster deployment script. The method comprises the following specific steps: virtual machine creation: a cloud platform creates a virtual machine through a virtualization technology, and verifies network connectivity; and environment detection: the management back end performs environment detection on the virtual machine to generate a cluster configuration file. And cluster mutual trust: configuring virtual machine mutual trust by a cluster script to ensure mutual access among nodes. The virtual machine configuration comprises environment variable setting, database tool installation, database software package distribution, cron service configuration and the like. System adjustment and optimization: system parameter optimization is carried out for an operating system and a server architecture. And cluster configuration: configuring database parameters, starting a database service, and ensuring that the cluster state is normal. According to the method, the deployment difficulty can be reduced, the manual operation is reduced, the deployment efficiency and the cluster performance are improved, and meanwhile, the method has relatively good compatibility, expandability and maintainability.

The invention discloses a database access method and device for preventing user data leakage in a container, and the method comprises the steps: a business service sends a connection establishment request to a database service; a database side vehicle service hijack connection establishment request which has the same POD with the business service and is different from the business service in a container contai ner; the database side vehicle service analyzes a database protocol, modifies a user name and a password in the connection establishment request, and forwards the modified connection establishment request to the database service; the database service performs user name and password verification based on the modified connection establishment request, and returns a response after the verification is passed; and the database side vehicle service receives the response of the database service and forwards the response back to the business service, and the business service establishes database connection with the database service. According to the invention, the database side vehicle service is introduced between the business service and the database service, all database connection requests are intercepted, and the business service does not need to know the user name and password of the database when connecting the database, so that the leakage of certificates is avoided.

The invention discloses a graph database query throughput optimization method based on a client multiplexing object, and belongs to the technical field of graph database query optimization. The graph database query throughput optimization method comprises the following steps: receiving serialized response data from a graph database service; analyzing the column number of the result set from the metadata, and creating an object list containing a corresponding number of value objects; parsing the first row of data, including parsing data structure information from the metadata and caching the data structure information, and filling the parsed first row of data into a corresponding value object in an object list; and analyzing the data of the second row and the subsequent rows in the result set, multiplexing the cached data structure information and the created object list, and directly filling the analyzed data of each column of the current row into the corresponding value object in the object list. Through object multiplexing, metadata cache multiplexing and lazy loading optimization, the dynamic memory allocation frequency in the deserialization process is remarkably reduced, and the processing throughput of query response is improved.

The present application belongs to the technical field of cloud computing, and relates to a database management method, a computer device, a nonvolatile readable storage medium and a program product. The method comprises: on the basis of historical timing service data of a database, determining a historical service volume parameter; on the basis of the historical service volume parameter, constructing a service volume prediction model, and on the basis of the service volume prediction model, determining a service volume prediction result within a target time period; on the basis of real-time parameter information of the database, determining a service bearing pressure of the database; on the basis of the service volume prediction result and / or the service bearing pressure of the database, determining a target capacity expansion and reduction number corresponding to a database service instance; and on the basis of the target capacity expansion and reduction number, performing capacity expansion and reduction on the database, so as to respond to a database distribution request. The present application can reduce a cold start delay, reduce the cost of providing a database service, and improve the performance and availability of the database service.

A client of a database service may request a migration of a remote source database to a target database provided by the database service, where the source database and target database are published by a database vendor. Responsive to the request, a migration tool published by the database vendor may be selected from among multiple migration tools. The migration tool may derive a schema from the source database and create the target database according to the derive schema. The migration tool may then extract data of the source database using native application programming interfaces (APIs) provided by the vendor. The extracted data may then be imported into the target database using one or more additional native APIs. The migration tool may then initiate replication of transactions performed at the source database to the target database.

The invention relates to the technical field of power system automation, and provides a global database connection number control method and system based on an end side, and the method comprises the steps: calling a database connection assembly to achieve the access to a multi-type heterogeneous database service; the method comprises the following steps: transforming a heterogeneous database access component, adding a database connection handle state monitoring function module, and traversing heterogeneous database connection handles and releasing idle overtime database connection according to the current read-write state of the connection handles; when the non-idle database connection handle reaches the timeout time, the database connection is not forcibly released; after the database connection handle is automatically disconnected, the database connection is recovered when the current database connection handle generates the read-write request again; judging whether the current global connection number is out of limit or not, if yes, waiting until idle connection occurs, and then establishing new database connection; and setting the connection timeout time of the request database, and returning the timeout time. The method can be compatible with various types of heterogeneous databases.

A system for delegation of authorization management of a shared database of a database service is described. The database service includes a control plane and a producer database engine. The producer database engine receives a creation request to create a datashare for a database. The creation request delegates, to a data exchange service, authorization management to access the datashare. The control plane is configured to update permission data for the datashare to indicate that authorization to the datashare is managed by the data exchange service. The producer database engine is further configured to receive a request, from a consumer database engine, to obtain metadata used to perform a query to the database of the datashare, determine that the data exchange service authorized the consumer database engine to access the datashare based on the permission data for the datashare, and return the metadata to the consumer database engine.

The invention discloses a database hybrid deployment method and device.The method comprises the steps that a first request is obtained and used for requesting to apply for creating a first database service on a database platform, and the database platform comprises at least one server cluster and a software mirror image supporting multiple chip types; each server cluster comprises servers supporting at least one chip type; in a database software deployment process, aiming at each database node, according to a chip architecture selected by a user for the first database service, and screening a server supporting the chip type corresponding to the database node in a database cluster, screening a software mirror image supporting the chip type corresponding to the database node from a database platform, and deploying the database node on the first server according to the first software mirror image. Therefore, under the scene that multiple chip type servers are used at the same time, database services are deployed according to the chip architecture selected by a user by himself / herself, and the service requirements are met quickly.

The invention relates to the technical field of system software communication, and discloses a read-write method based on a dual-network redundant database. The method comprises the following steps: S100, configuring a first database connection pool and a second database connection pool when loading for the first time, and arranging the first database connection pool and the second database connection pool in an accessible first address and a second address respectively; s102, acquiring a database client from a database connection pool corresponding to the first address; s104, judging whether the acquisition is successful or not, if so, turning to S106, otherwise, turning to S110; s106, returning to the database client; s108, performing reading and / or writing operation on the database server side by using the returned database client side; s110, exchanging positions of the first database connection pool and the second database connection pool, and counting exchange times; and S112, judging whether the current count value exceeds the maximum number of times or not, if so, prompting that the database client is failed to obtain, and otherwise, returning to S102. Therefore, high-reliability reading and writing of the database can be realized.