163 results about "Database services" patented technology

Techniques for dynamic database redaction using protected encryption secret material are described. A masking policy is defined that includes a reference to a secret material stored by a secrets manager service. The masking policy further identifies a pseudonymous redaction function that utilizes a cryptographic function requiring such a secret material. The secrets manager service is configured to grant access to the secret material by an entity of the database service that executes queries, such as a leader node of a cluster. For a particular query, the cluster obtains the secret material from the secrets manager service in a secure manner, uses the secret material for applying the cryptographic function to values for redaction purposes, and deletes any copies of secret material thereafter.

The invention discloses a database malicious behavior detection and blocking method and system based on multi-dimensional features, and the method comprises the steps: collecting performance index data in real time, and sequentially carrying out the smoothing and normalization of the performance index data, and constructing a time sequence feature vector; performing analysis and feature extraction on the network flow data to obtain an abnormal connection mode feature vector; inputting the collected multi-dimensional feature vectors into an improved factorization machine, and performing feature crossing and dimension reduction processing by using an MFB pooling technology to obtain dimension-reduced feature vectors; inputting the dimension reduction feature vector into a dual-mode collaborative detection mechanism composed of an XGBoost decision tree model and a DRL model, and outputting a dynamic risk detection result; starting a hierarchical blocking strategy based on the risk level in the dynamic risk detection result; the method realizes closed-loop protection of feature extraction, risk rating and hierarchical blocking, has adaptive threshold adjustment and batch detection acceleration capabilities, and ensures continuity and high efficiency of database services.

The invention belongs to the technical field of computer software, and particularly relates to a heterogeneous database unified deployment management method based on a cluster management platform, which comprises the following steps: predefining metadata of various database services; the method comprises the following steps: pre-constructing a multi-version program package warehouse, and establishing a structured warehouse directory system; obtaining a chip architecture and an operating system type of the target node, and generating environment fingerprint information; dynamically selecting a database installation package matched with the current environment and a dependency item set of the database installation package by mapping a warehouse directory system; through a unified database adaptation layer, a standardized operation interface is called, and installation, configuration and start-stop operation of the database are executed; a visual deployment and arrangement function based on component roles is provided by expanding a Web service interface of the management platform; and according to a deployment arrangement result and the environment fingerprint information, calling a deployment script to complete automatic deployment and configuration of the database cluster. According to the invention, unified adaptation, deployment and full-life-cycle management of various domestic databases are realized.

The invention discloses an RDMA Chain-based LSM Tree key value type database access method. The method comprises the following steps: a database client sends a request containing a version number, a key and an operation type to a database server main node; the server main node analyzes the request and processes the request according to the operation type; during write operation, a new serial number is generated, and data is inserted into a skip list of a memory table MemTable; when reading operation is carried out and the version number is smaller than 0, whether a key exists or not is checked through a Bloom filter, if yes, query is carried out at a secondary node through the RDMA technology, and if not, an SSTable file in a disk is directly accessed; and when the reading operation is performed and the version number is greater than or equal to 0, preferentially searching the data of the corresponding version in the MemTable, and if the data of the corresponding version fails, querying the SSTable. Through the RDMA technology, CPU occupation and network round-trip time are reduced, and the response speed and concurrent processing capacity of the system are improved.

The invention provides a garlic planting full-process database service system based on agricultural big data, which relates to the technical field of agricultural planting and comprises a planting planning module, a seeding management module, a growth monitoring module, a topdressing irrigation management module, a pest control module and a harvesting decision module. The planting planning module accurately matches varieties and base fertilizer formulas according to soil and yield data; the seeding management and growth monitoring module dynamically optimizes planting measures in combination with real-time data and historical experience; the topdressing irrigation module, the pest control module and the harvesting decision-making module utilize technologies such as image recognition and spectrum detection to realize a precise and scientific management strategy, effectively improve the resource utilization rate, reduce the influence of environmental fluctuation on garlic growth, reduce the use of chemical agents, realize full-process data driving by integrating multi-source data, and improve the management efficiency. Meanwhile, a complete planting file is formed to support strategy iteration, large-scale and efficient development of garlic planting is facilitated, and then the economic benefits of garlic planting are effectively improved.

Computer implemented methods, systems, and computer program products include program code executing on a processor(s) obtains queries from sources via a query interface. The program code analyzes the queries to obtain attributes of the queries. The program code applies a trained classifier to the attributes to classify the queries into finite categories based on a predicted usage of a given resource type exceeding a pre-determined threshold and an anticipated execution duration for each query. The program code determines, based on the finite categories of the one or more queries and resource configurations of resources comprising the database service, which resource of the resources can efficiently execute each query of the one or more queries. The program code schedules each query of the one or more queries for execution by the determined resources.

The invention discloses a method and device for realizing integrity protection of sensitive data of a database, and belongs to the technical field of database security, and the method comprises the following steps: identifying sensitive data of a key column of a data table in a target database through an encryption system, and recording the sensitive data as key data; integrity protection is configured for the key data, and a digital signature is applied; the method comprises the following steps: calculating an abstract value of key data by using an SM3 hash algorithm, and calculating related sensitive information of the current key data and an MAC value of a system key at the same time; the database service system accesses the key data through the proxy connection of the encryption system, data modification or new data insertion is carried out, that is, a service user carries out data entry and storage; the encryption system compares whether the MAC value of the related sensitive information of the current key data is consistent with the MAC value of the related sensitive information of the last key data, and returns a comparison result to the system; and displaying a data state corresponding to a comparison result returned by the system on a system web page.

The invention provides a database system access control method and device, a database system, a storage medium and a computer program product, and the method comprises the steps: determining a target protocol service module in a plurality of protocol service modules according to a port number corresponding to access request information sent by a client; using the target protocol service module to generate standardized operation information according to the access request information; a command processing module is used for executing corresponding operation on the database system according to the standardized operation information; using the target protocol service module to generate access response information; and sending the access response information to the client according to the port number. According to the method and the device, access of multiple communication protocols can be synchronously compatible in a database service architecture, multiple communication protocols can be supported in parallel, the processing capacity of a database system for high-concurrency requests is improved, the message analysis efficiency is improved, and the bearing capacity for data streams is improved.

The present disclosure relates to a method and apparatus for realizing cross-instance routing of a structured query statement, and a system. The method comprises: a first database service instance end receiving a structured query statement; the first database service instance end determining whether the structured query statement has the capability to be sent to a second database service instance end; and when it is determined that the structured query statement has the capability to be sent to the second database service instance end, the first database service instance end establishing a connection to the second database service instance end, and forwarding the structured query statement to the second database service instance end for execution. The present disclosure solves the technical problem in the relevant art of the low efficiency in cross-instance data access.

A transaction system receives a transaction request for a database service. The transaction system retrieves, by a first microservice, a set of data from a data access layer of the database service in response to receiving the transaction request. The transaction system performs a set of computations based on the set of data retrieved from the data access layer. The transaction system stores the set of computations in one or more cache nodes of a data access service and accesses, by a second microservice, the set of computations, performed in response to retrieving the set of data by the first microservice, from the one or more cache nodes.

The embodiment of the invention provides a data query method, a database system, equipment, a storage medium and a program product. The method comprises the following steps: when a query request is received, determining a first column table storage mode of a to-be-queried table according to a table name of the to-be-queried table carried in the query request; obtaining a column type storage file of the to-be-queried table; determining a second column storage table mode used when the column storage file is generated according to mode version information correspondingly recorded by the column storage file; obtaining first column data of the to-be-queried column from the column type storage file according to the second column table storage mode and the column name of the to-be-queried column carried in the query request; according to the first column table storage mode and the second column table storage mode, converting the first column data into second column data adaptive to the first column table storage mode; and determining a query result of the query request according to the second column of data. According to the technical scheme provided by the embodiment of the invention, the influence of database mode change on database service can be reduced.

Techniques for implementing a scalable key value storage in a distributed storage separate the storage of the collection of data objects from the storage of the index corresponding to the collection. According to an implementation, a database service may receive a request to create a collection of data objects in an object storage. A schema may be specified for the collection. The database service may generate a unique identifier (ID) corresponding to the collection and create the collection in the object storage. The objects in the collection and the associated schema may be further written to an object table and a schema table, respectively. The database service may further validate the schema and extract one or more indexable fields from the schema. The database service may send a request to a database search service to create an index for the collection in an index storage.

The invention discloses a graph database query throughput optimization method based on a client multiplexing object, and belongs to the technical field of graph database query optimization. The graph database query throughput optimization method comprises the following steps: receiving serialized response data from a graph database service; analyzing the column number of the result set from the metadata, and creating an object list containing a corresponding number of value objects; parsing the first row of data, including parsing data structure information from the metadata and caching the data structure information, and filling the parsed first row of data into a corresponding value object in an object list; and analyzing the data of the second row and the subsequent rows in the result set, multiplexing the cached data structure information and the created object list, and directly filling the analyzed data of each column of the current row into the corresponding value object in the object list. Through object multiplexing, metadata cache multiplexing and lazy loading optimization, the dynamic memory allocation frequency in the deserialization process is remarkably reduced, and the processing throughput of query response is improved.

The present application belongs to the technical field of cloud computing, and relates to a database management method, a computer device, a nonvolatile readable storage medium and a program product. The method comprises: on the basis of historical timing service data of a database, determining a historical service volume parameter; on the basis of the historical service volume parameter, constructing a service volume prediction model, and on the basis of the service volume prediction model, determining a service volume prediction result within a target time period; on the basis of real-time parameter information of the database, determining a service bearing pressure of the database; on the basis of the service volume prediction result and / or the service bearing pressure of the database, determining a target capacity expansion and reduction number corresponding to a database service instance; and on the basis of the target capacity expansion and reduction number, performing capacity expansion and reduction on the database, so as to respond to a database distribution request. The present application can reduce a cold start delay, reduce the cost of providing a database service, and improve the performance and availability of the database service.

A client of a database service may request a migration of a remote source database to a target database provided by the database service, where the source database and target database are published by a database vendor. Responsive to the request, a migration tool published by the database vendor may be selected from among multiple migration tools. The migration tool may derive a schema from the source database and create the target database according to the derive schema. The migration tool may then extract data of the source database using native application programming interfaces (APIs) provided by the vendor. The extracted data may then be imported into the target database using one or more additional native APIs. The migration tool may then initiate replication of transactions performed at the source database to the target database.

The invention relates to the technical field of power system automation, and provides a global database connection number control method and system based on an end side, and the method comprises the steps: calling a database connection assembly to achieve the access to a multi-type heterogeneous database service; the method comprises the following steps: transforming a heterogeneous database access component, adding a database connection handle state monitoring function module, and traversing heterogeneous database connection handles and releasing idle overtime database connection according to the current read-write state of the connection handles; when the non-idle database connection handle reaches the timeout time, the database connection is not forcibly released; after the database connection handle is automatically disconnected, the database connection is recovered when the current database connection handle generates the read-write request again; judging whether the current global connection number is out of limit or not, if yes, waiting until idle connection occurs, and then establishing new database connection; and setting the connection timeout time of the request database, and returning the timeout time. The method can be compatible with various types of heterogeneous databases.

A system for delegation of authorization management of a shared database of a database service is described. The database service includes a control plane and a producer database engine. The producer database engine receives a creation request to create a datashare for a database. The creation request delegates, to a data exchange service, authorization management to access the datashare. The control plane is configured to update permission data for the datashare to indicate that authorization to the datashare is managed by the data exchange service. The producer database engine is further configured to receive a request, from a consumer database engine, to obtain metadata used to perform a query to the database of the datashare, determine that the data exchange service authorized the consumer database engine to access the datashare based on the permission data for the datashare, and return the metadata to the consumer database engine.

The present invention discloses a method and system for automatically supervising software status, which relates to the technical field of software status management. The method solves the technical problem that existing solutions are inaccurate in monitoring abnormalities of database services and cannot provide processing plans to promptly process database services, resulting in the database being unable to operate continuously and stably. The present invention establishes a message queue between a main process and a child process through shared memory, and executes a processing plan based on the number of heartbeat writes of the child process and the updated heartbeat number read by the main process; not only can the abnormalities of the database service be accurately monitored in real time, but the corresponding processing plan can also be executed to promptly process the database abnormalities, thereby ensuring the continuous and stable operation of the database; the processing plans built into the monitoring platform of the present invention can be added and deleted in real time, and when adding or deleting processing plans, only the configuration of the monitoring platform needs to be changed, which is simple and convenient to operate and can ensure the operating efficiency of the database service.

The invention relates to a distributed thermal power generating unit simulation system and a management method thereof. The database service module is used for recording operation state information of each functional module and realizing state synchronization between the modules; the centralized management module is used for performing unified management and control on each functional module; the authorization authentication module is used for providing authority level access control; the operator station module is used for providing a human-computer interaction interface and is connected with the simulation machine core platform; the engineer station module is used for editing control logic of the simulation machine and configuring system parameters; the virtual data processor module is used for simulating logic operation of a field control system by utilizing a simulation algorithm; the model service module is used for constructing a physical equipment mathematical model and carrying out real-time simulation calculation; and the Web service module is used for providing a remote access interface based on a network protocol. Therefore, the problems that functional modules of an existing thermal power generating unit simulation system are highly coupled, and the requirements for flexibility, expandability and intelligent management are difficult to meet are solved.

The invention provides an object storage processing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining configuration information of a target deployment region, the configuration information comprising metadata service configuration information and data storage service configuration information; corresponding metadata clients are initialized according to the metadata service configuration information, the metadata clients comprise at least two types, and each type is matched with different distributed database services; according to the data storage service configuration information, a corresponding storage rear end is initialized, the storage rear end comprises at least two types, and each type is adaptive to different object storage services; performing service registration on the initialized metadata client and the storage rear end to form an executable object storage service instance; and generating a uniform object storage service interface based on the registered object storage service instance.

A system and method for reconciling data from a local database streamed to a Cloud storage service is disclosed. A data transaction is received from a structured query language (SQL) database service operated by a server. The transaction includes log sequence numbers and corresponding data records. The log sequence numbers are stored in a change data capture (CDC) table. The sent data transaction is streamed via a data integration service. A storage object service stores the sent data into an object storage service bucket. A data reconciliation service deploys a cloud trail target to generate a log file of log sequence numbers from the sent data stored in the object storage service bucket. The log file of log sequence numbers is compared with the log sequence numbers in the CDC table. A missing data record is flagged to an exception table based on the comparison. An alert is issued for the missing data record.

The application relates to a database service processing method and device, computer equipment and a storage medium. The method comprises the following steps: when a service request initiated by a client is received, determining request information corresponding to the service request, a target function and a service execution mode; when the service execution mode is a vectorization execution mode, a table data vector corresponding to a query keyword is pulled in a loop according to the query keyword in the request information in the disk, the table data vector comprises a preset number of table data, that is, a plurality of table data is pulled out from the disk, the target function is called to calculate and process each table data vector, that is, one table data vector is calculated and processed each time, compared with the prior art, the data amount of single calculation is improved, the number of repetitive executions is reduced, and the calling overhead of the function is reduced.

The invention relates to the technical field of artificial intelligence, and discloses a retrieval enhancement generation system and a construction method and an application method thereof. The construction method comprises the following steps: installing project dependence to configure a back-end service operation environment, deploying database service by adopting a docker containerization technology, and deploying large language model service by utilizing a special tool; connecting the deployed database service with the large language model service by reading configuration data, and starting a front-end interactive interface service; a basic retrieval knowledge base based on a semantic unit and a graph retrieval knowledge base based on a knowledge graph are constructed, and the basic retrieval knowledge base supports direct semantic retrieval by establishing a mapping relation between text block vectors and text content. And the graph retrieval knowledge base supports associated traceability retrieval by establishing a mapping relationship between the entity vector and the community structured report. According to the method, the service deployment process is simple, multiple retrieval strategies are supported, and meanwhile the technology use threshold is lowered.

The invention discloses a machine learning reasoning call for database query processing. In some embodiments, a method of making a machine learning reasoning call for database query processing may include generating a first batch of machine learning requests based at least on a query to be performed on data stored in a database service, where the query identifies a machine learning service; sending the first batch of machine learning requests to an input buffer of an asynchronous request handler, the asynchronous request handler generating a second batch of machine learning requests based on the first batch of machine learning requests; and obtaining a plurality of machine learning responses from an output buffer of the asynchronous request handler, the machine learning responses being generated by the machine learning service using a machine learning model in response to receiving the second batch of machine learning requests.

The invention relates to the technical field of equipment operation and maintenance management, in particular to a light operation and maintenance method and system for enabling intelligent equipment management, and the method comprises a data collection and perception layer, an infrastructure and platform support layer, an intelligent center and capability layer, an application service layer and a presentation and interaction layer. The data acquisition unit is responsible for acquisition and preliminary access of equipment data, and the infrastructure, namely the service unit, is used for providing basic resources; the platform-as-a-service unit is used for providing an enabling service and comprises a big data processing platform, a stream computing engine, an AI model training and deployment platform and a database service; the intelligent center and capability layer comprises a digital twinning engine unit, an AI analysis engine unit, a knowledge graph engine unit and a rule engine unit, the knowledge graph engine unit is used for carrying out structured and semantic association on knowledge in the operation and maintenance field to form a knowledge graph, and the rule engine unit is used for processing a deterministic task based on predefined logic to form a knowledge graph; the process automation is realized.

The embodiment of the invention provides a data processing method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: analyzing a first database operation statement received from an application program server; if the first database operation statement is a character string statement formed by a plurality of database operation statements of the same type, rewriting the first database operation statement to obtain a second database operation statement; wherein the value of the second database operation statement comprises values of a plurality of database operation statements; and sending the second database operation statement to the database server for execution. The method is used for achieving the effect of improving the execution performance of a character string statement formed by a plurality of database operation statements of the same type at a database server side.

The invention relates to a database technology, and provides a database data importing method and device, electronic equipment and a storage medium. The database data importing method is applied to a preset importing tool, and comprises the following steps: querying meta information of a table of to-be-imported data by using a main control thread, determining control information of the table of the to-be-imported data, creating a reading thread group and a sending thread group, reading row data of the to-be-imported data by using a target reading thread, and sending the row data of the to-be-imported data according to the control information of the table. And determining a distribution key and a partition key corresponding to the row data, inserting the row data into a corresponding partition data unit, and sending the partition data unit to a target database by using a target sending thread according to the obtained node information and partition information in the partition data unit. The import tool does not need to be deployed, can be independently executed at the client, only consumes small server computing resources in the data import process, and can reduce the influence on the database service process while improving the import performance.

Computer nodes associated with a cluster store a distributed database. The computer nodes are polled to retrieve their individual nodal query states. A coordinator node then merges the individual nodal query states to determine an overall query state associated with the distributed database. The coordinator node, though, has a memory capacity that can be overcome by some nodal query states. The coordinator node thus imposes a data size limit on the nodal query states to prevent memory failures. The coordinator node specifies the data size limit during any polling cycle, and the coordinator node receives compliant nodal query states that satisfy the data size limit. The coordinator node may adjust or revise the data size limit for subsequent polling cycles, based on a count of the nodal query states yet to be retrieved. The data size limit thus ensures that the memory capacity is not overcome during any polling cycle.

The invention discloses a charging data acquisition method and system for a charging station, and the method comprises the following steps: an application end determines a subscription theme, and initiates subscription to a message queue; the server controls a monitoring program to monitor all data conforming to the subscription theme in the message queue, and when the client action belongs to the data of the subscription theme, the data of the subscription theme generated by the client action is stored in a cache database; the server side controls the scheduling program to call the cached data from the cache database according to the calling frequency, and index data required by the subscription theme is obtained through calculation; and the server side feeds back the index data and the subscription theme to the application side. According to the method and the device, the supply relationship between the demand of the application end and the calculation of the index data is fully considered, the corresponding index data is pushed to the regular theme by sensing the subscription condition of the application end, the problem that pushing is carried out as long as new index data is generated before is changed, server resources are saved, and the index data is pushed more flexibly.

The invention relates to the technical field of electronics, and discloses a database construction method and device, equipment, a storage medium and a program product.The method comprises the steps that a master node and a preset number of slave nodes are constructed in a data layer, and when target data needing to be stored are obtained, a first copy and a preset number of second copies are generated based on the target data, the first copies and the second copies both comprise total data of the target data, and the preset number of slave nodes and the preset number of second copies are in one-to-one correspondence; the first copies are stored in the master node, the second copies are stored in the corresponding slave nodes, the target database is obtained, the target database stores data redundancy in the master node and the slave nodes, the master node can provide services to the outside, when the master node fails, the slave nodes can provide services, normal operation of the database is not affected, and the reliability of the database is improved. And high reliability of database service is ensured.