30 results about "Heterogeneous database system" patented technology

The invention relates to a method for achieving automatic synchronization of multi-source heterogeneous data resources. A metadata service node, a service node and a production node are related in the method, the metadata service node is responsible for storing a data dictionary in a distributed heterogeneous database system, the service node is responsible for analyzing user requests in the distributed heterogeneous database system and carrying out synchronization with a database on the production node periodically, and the production node is responsible for requests such as inquiring and updating in a corresponding production application system, wherein the service node is formed by a configuration recognizer, a blog parser and a data synchronizer, the configuration recognizer is used for analyzing the configuration of a source database on the production node and selecting a feasible synchronizing mode, the blog parser is used for analyzing blogs of different dataset systems and is a component for first-phase preparing work of an increment synchronization mode, and the data synchronizer carries out data synchronization according to the synchronizing mode of the configuration recognizer. The method for achieving the automatic synchronization of the multi-source heterogeneous data resources enables the automatic synchronization of the multi-source heterogeneous data resources to be achieved, and can be used in data resource processing.

The invention relates to the technical field of cloud databases, in particular to a virtual access management method of a heterogeneous database. According to the virtual access management method of the heterogeneous database, a data control processing framework which comprises a client, a front end and a server side and a functional unit which is oriented to the process and is based on components are provided, component access control management of a heterogeneous database system based on users, roles and the permission is introduced, the process of platforms, the process of resources, the process of channels and the like are accomplished, heterogeneous data source registration, virtual database object registration and virtual resource access are achieved, sharing access management of the heterogeneous database is accomplished, database access details and heterogeneous system multi-source performance are shielded, the uniform data standards and uniform access interfaces are provided, transparent access to data sources is supported, and sharing and uniform management of data resources of a plurality of independent service systems are achieved. The virtual access management method of the heterogeneous database solves the data sharing access problem caused by heterogeneous factors such as the server side, an operating system, a database management system and data structures, and can be used for virtual access management of the heterogeneous database.

A system and method for providing ad hoc query capabilities to complex homogenous and heterogeneous database systems. The method utilizes a universal join table adapted to join with any table within a database system or across multiple database systems. Using the universal join table, a logical flat hierarchy is laid on top of the database system to simplify complex searches across one or more database systems.

A method for automatically synchronizing multi-source heterogeneous data resources utilizes a metadata service node, a service node and a production node, wherein the metadata service node stores a data dictionary of a distributed heterogeneous database system, the service node parses user requests of the distributed heterogeneous database system, for regularly synchronizing data with the production node; and the production node provides requests such as querying and updating of a relevant production application system; wherein the service node includes a configuration analyzer, a log parser and a synchronous update device; the configuration analyzer analyzes source database configurations on the production node, and selects an applicable synchronization method; the log parser parses logs of different database systems, which is a preparatory component of incremental synchronization; the synchronous update device recognizes the synchronization method according to the configuration analyzer for data synchronization.

The embodiment of the invention provides a method for generating a heterogeneous database report, which is used for solving the problem that because the prior art can not support the connection of heterogeneous databases or the single connection type consumes resources, report data can not be acquired from service scenes of multi-dimensional application. The method comprises the following steps: establishing database connection with each heterogeneous database, and saving the database connection in the database connection pool of each heterogeneous database as a database connection object; acquiring data in each heterogeneous database through the database connection pool of each heterogeneous database; and integrating the data in each heterogeneous database into a data model which can be recognized by the report, and then, showing the data. The invention can efficiently acquire the data in each heterogeneous database, save the server resources and reduce the system overhead, and the integration of the data in each heterogeneous database can also enable the data to be synchronously shown in the report through the same model.

The object of the present application is to provide a CPU-GPU based load balancing method and apparatus. A pipelined query execution model is constructed on the GPU-GPU heterogeneous database system,so that CPU-GPU heterogeneous data analysis system can support query analysis in big data scenario; determining the total number of pipelines to be executed; starting the pipeline query execution model to allocate the pipeline corresponding to the total number to the CPU and the GPU, and calculating the system execution time corresponding to all load distribution strategies according to the determined execution time of a single pipeline on the CPU and the GPU respectively; finally, the load distribution strategy corresponding to the minimum value of the execution time of all the systems is determined as the optimal CPU-GPU allocation strategy,the load balancing strategy of the CPU-GPU heterogeneous data analysis system can reasonably distribute pipeline load to different processors, make full use of processor computing resources, not only improve the system performance, but also make the system achieve the best overall performance.

The invention discloses a method for synchronizing data between heterogeneous databases based on CMSP message middleware. The method belongs to the field of data synchronization between databases. Thetechnical problem to be solved is how to carry out safe and reliable synchronous exchange on heterogeneous data. The technical scheme is as follows: the method comprises the following steps: splitting an extraction service of a specific database platform, defining a unified message transmission protocol, transmitting through CMSP message middleware, and finally realizing synchronization and migration work of data among heterogeneous databases through a database type mapping model by a warehousing server; the method comprises the following steps of S1, realizing each heterogeneous database extraction server as an independent micro-service program; S2, serializing specific database events by the extraction server through a unified coded message format; S3, distribution is performed througha CMSP message bus; S4, matching the data mapping model between the warehousing server as a message receiver and a consumer by analyzing the message format; and S5, migrating the database operation from the source database to the target database.

The invention discloses a data synchronization method and device for a distributed heterogeneous database system. The method comprises the steps of obtaining one or more sets of operation instructionsand operation information, and sending the operation instructions and the operation information to a first database cluster, wherein the operation instructions comprise the insertion data, update data or deletion data, and the operation information comprises an operation position and a data value; receiving an operation result returned after the first database cluster modifies the data at the corresponding operation position according to each group of operation instructions and operation information; and according to each operation result, packaging the corresponding operation instruction andoperation information into a message to be sent out, wherein the message is used for carrying out data synchronization on the corresponding operation position in the second database cluster, so thatthe situation that the change of data cannot be perceived in time between different types of database systems is avoided, and the accuracy of data query and analysis is effectively improved.

The invention relates to a method for synchronizing real-time data in a heterogeneous database system. The system designs an integrated data layer, a real-time synchronization function between data sources is provided for data from heterogeneous data sources, the heterogeneous data source realizes real-time synchronization in the integrated system structure of the heterogeneous data source, and anexisting heterogeneous data source integration mode is not affected.

The invention provides a method for realizing data sharing and generating financial certificates in a heterogeneous database system. The method comprises the followings: unifying base data codes and building an original base data code comparison table; building database link service; sorting out data and building a data template; and carrying out data exchange so as to form credential data of a financial system. The method provided by the invention can be widely applied to building trades and large-scale and integrated group enterprises, and solves the condition of isolated information resources in group enterprises. Data in a business system can generate credential data of the financial system through arrangement and modeling. A heterogeneous database system can be connected, date share can be achieved, the information utilization can be improved, all systems are enabled to cooperate with each other effectively, and an upstream business system can send data to a downstream management system directly. Therefore, the production rate and the work efficiency of the enterprises can be improved by reasonably using information, and the availability of all application systems is enhanced.

The invention discloses a method and a device for realizing data interactive query between heterogeneous databases, and relates to the technical field of big data. The method comprises the steps thata heterogeneous database system receives a data query request initiated by a query client through a set scheduling node; a query statement in the data query request is analyzed into a logic executionplan through a scheduling node, and the distributed processing is performed on the logic execution plan to obtain a plurality of sub-logic execution plans oriented to the heterogeneous database; statedetection is carried out on working nodes set by a heterogeneous database system, and sub-logic execution plans are correspondingly allocated to all the working nodes in an idle state, so that the working nodes execute data query of a heterogeneous database according to the allocated sub-logic execution plans; and the summarized result data is returned to the query client through the scheduling node after the working node returns the result data for executing the data query to the scheduling node for summarizing. According to the invention, efficient query of data between heterogeneous databases can be realized.

The invention discloses a database data synchronization method and device and a storage medium, and the method comprises the steps: receiving a transaction submission request message sent by a client under the condition that transaction response results fed back by a plurality of data nodes are successful, and writing a global transaction ID into a transaction processing table; sending the transaction submission request message to the plurality of data nodes; receiving transaction submission results fed back by the plurality of data nodes; and under the condition that transaction submission results fed back by the plurality of data nodes are all successful, applying for releasing the global transaction ID from a global transaction manager. According to the method, data synchronization between the distributed database and the stand-alone database in the heterogeneous database system can be realized, and the problem of inconsistency caused by sending requests to the two databases at the same time is solved by adopting a way of unidirectional synchronization and binding whether the transaction information to be processed is successfully submitted or not with the transaction, and the reliability of data synchronization is greatly improved.

Embodiments of the invention disclose a heterogeneous database synchronization method and apparatus, computer equipment and a storage medium. The method comprises the following steps: obtaining database incremental data; packaging the incremental data of the database into target transmission data according to a preset custom packaging protocol; and transmitting the target transmission data to a heterogeneous database system, so that the target transmission data is synchronously transmitted in a plurality of databases in the heterogeneous database system. According to the embodiment of the invention, database incremental data is acquired, the database incremental data is packaged into target transmission data according to a preset custom packaging protocol, and the target transmission datais transmitted to a heterogeneous database system, so the target transmission data is synchronously transmitted by multiple databases in the heterogeneous database system, data conflicts possibly occurring in the data transmission process can be effectively avoided, final consistency of the data is achieved, version iterability of the bottom-layer database is improved, and replacement and migration of the database are facilitated.

The invention provides a monitoring system of an industrial big data-oriented heterogeneous database and a monitoring method. The system includes the heterogeneous database system, a middleware serverand a Web monitoring platform. The heterogeneous database system and the middleware server are in mutual data communication. The middleware server and the Web monitoring platform are in mutual data communication through a database. According to the system, a visualized interaction mode is used to combine a data parsing format of a lower learning cost, an administrator can be enabled to voluntarily and quickly access a new data source, frequency of secondary development of the system is decreased, and practicability and stability of online information are improved.

Systems and methods described herein provide heterogeneous access to tenant databases. A delegator intermediary to clients and tenant database receives a request from a client to perform a database related action. The request identifies a query type and tenant identifier. The tenant databases include a first tenant database of a first database type and a second tenant database of a second type. The delegator identifies a tenant database using the tenant identifier from the request. The delegator determines a database type corresponding to the identified tenant database. The delegator selects, from a plurality of drivers corresponding to respective database types, a driver based on a database type for the identified tenant database. The delegator establishes a database connection using the selected driver between the delegator and identified tenant database. The delegator uses the database connection for performing the database related action from the request.

The invention discloses a data format conversion method between isomerous database systems. The method comprises the following steps that 1, network communication among an IBA database, an interface machine and a PI real-time database is set up, and a station number written in the PI real-time database after being converted is defined; 2, a collecting period is set for data of PDA files needing to be collected in the IBA database according to a temporal mode, and a data collecting template is built; 3, a file directory of reading the PDA files in the IBA database is set in IBA datcoordinator software, a file directory where text files are stored is guided out, and the data needing to be collected are converted into the text files; 4, an installation directory of an IBA database file conversion function service program is set up; 5, the text files are converted into text files capable of being recognized by a PI-batch file interface of the PI real-time database, and the final files are transmitted to an output directory and written in the PI real-time database. Through data format conversion between an IBA server and the PI real-time database, data sharing between the isomerous database systems is achieved.

The invention discloses a heterogeneous network integration method based on a reconfigurable resolution server. The method comprises the following steps: configuring a plurality of reconfigurable resolution servers (RRS) in an ubiquitous green community control network UGCCNet containing a plurality of heterogeneous networks; storing mapping configuration information and translation rule information of different heterogeneous bus systems in the RRS; distributing corresponding mark mapping configuration information and translation rule information to a corresponding heterogeneous network component by the RRS when each heterogeneous network is subjected to data communication, so as to achieve uniform access integration of the heterogeneous networks and intercommunication of application data. By adopting the method disclosed by the invention, the absorption and integration ability of a UGCCNet system on the heterogeneous bus systems and the interconnectivity performance among the heterogeneous bus systems are improved.

The invention discloses an intelligent medicine box based on a heterogeneous system data mapping module. The intelligent medicine box mainly solves the problem of drug crossing prevention, a cloud platform is established to directly connect a pharmaceutical factory with a drug user in a data mode, the user scans a unique identification code through an intelligent device to distinguish drugs, factory information of the drugs and use information of the drugs are obtained, meanwhile, the unique identification code of the drugs is adopted, and authenticity of the drugs can be directly distinguished. The unique identification code serves as an access link port of the cloud platform, the access information of a user can be collected when the user enters the heterogeneous database system throughthe cloud platform, and the user enters an interface of the cloud platform through the link port and can selectively upload personal data. The pharmaceutical factory knows the use of drugs from the macroscopic view according to the collected information, and can timely research and control certain diseases.

The invention relates to a method for synchronizing real-time data in a heterogeneous database system. The system designs an integrated data layer, a real-time synchronization function between data sources is provided for data from heterogeneous data sources, the heterogeneous data source realizes real-time synchronization in the integrated system structure of the heterogeneous data source, and anexisting heterogeneous data source integration mode is not affected.

The invention relates to an environmental element event data query method and system based on a heterogeneous database. The method is carried out based on a pre-established environment element event library and an environment Internet of Things system meta-database, and specifically comprises the following steps: S1, querying the environment element event library according to a to-be-queried environment element event input by a unified query interface, and obtaining corresponding environment element information; s2, querying an environment Internet of Things system metadata base according to ato-be-queried environment element event input by the unified query interface, and obtaining corresponding metadata information; s3, combining the acquired environmental element information with metadata information to obtain query request information; and S4, converting the query request information into a database query language set related to the database, and performing query on the corresponding database. According to the invention, the heterogeneity of the storage layer of the environment Internet of Things system is overcome, and the cross-database query of the environment element eventin the heterogeneous database is realized.

The invention discloses a method for processing a task through different workflows among heterogeneous systems. The method includes that a uniform task framework is built between a main system and an auxiliary system in advance, and the uniform task frame packages task basic attributes and is provided with a task registration application programming interface (API), a task obtaining API and a task logout API. The method overcomes the defects of complex experience of users to switch and log in back and forth among a plurality of systems, achieves task uniform revealing, inquiring and calculating among a plurality of heterogeneous systems, and greatly reduces integrating difficulty by calling processing of an original system to process business of a task.

The invention discloses a data processing method and device based on a heterogeneous database system and relates to the technical field of computers. A specific embodiment of the method comprises steps of obtaining a to-be-processed data table according to a data query log stored in a heterogeneous database system, and determining a target database corresponding to the to-be-processed data table; generating a data processing task according to the to-be-processed data table, the storage database corresponding to the to-be-processed data table and the target database; and based on a preset read-write scheduling rule, executing a data processing task by utilizing the to-be-processed data table, the storage database and the target database. According to the method, the data query function of the heterogeneous database system can be optimized, a technical problem that in the prior art, a manual intervention method needs to be used for optimizing query is solved, and user experience is good.

The invention discloses a parallel processing method for industrial big data heterogeneous data. The method comprises the following steps: firstly, performing type conversion through a database conversion tool, accessing a source database system, and then performing data recombination; after data conversion is carried out, converting all information needing to be shared in the source database modeinto a target database, wherein the conversion cannot contain redundant associated information; adopting a heterogeneous database system constructed by a database conversion tool to realize combination and sharing of data information, equipment resources and human resources among different databases; adopting a distributed database system to solve the problem of data parallel processing; and finally, adopting a multi-database management system to operate and maintain a database system. The invention relates to the technical field of industrial big data. According to the parallel processing method for the industrial big data heterogeneous data, the problem of heterogeneous big data parallel processing in the existing industrial field is solved, and the reliability and expandability of dataprocessing are ensured.

The invention relates to a data synchronization method between heterogeneous database systems. The method comprises the following steps: planning a synchronization demand; configuring a synchronization parameter table based on the synchronization demand; defining dependency relationships and synchronization frequencies between the synchronization data tables and between the synchronization data tables and other modules; and calling a synchronization operation program, and performing data synchronization operation based on the configuration of the synchronization parameter table. Compared with the prior art, the method provided by the invention is high in data synchronization efficiency and high in flexibility, and can quickly position and solve problems when data synchronization is abnormal.

The invention relates to the technical field of cloud databases, in particular to a virtual access management method of a heterogeneous database. According to the virtual access management method of the heterogeneous database, a data control processing framework which comprises a client, a front end and a server side and a functional unit which is oriented to the process and is based on components are provided, component access control management of a heterogeneous database system based on users, roles and the permission is introduced, the process of platforms, the process of resources, the process of channels and the like are accomplished, heterogeneous data source registration, virtual database object registration and virtual resource access are achieved, sharing access management of the heterogeneous database is accomplished, database access details and heterogeneous system multi-source performance are shielded, the uniform data standards and uniform access interfaces are provided, transparent access to data sources is supported, and sharing and uniform management of data resources of a plurality of independent service systems are achieved. The virtual access management method of the heterogeneous database solves the data sharing access problem caused by heterogeneous factors such as the server side, an operating system, a database management system and data structures, and can be used for virtual access management of the heterogeneous database.

The invention discloses a data format conversion method between isomerous database systems. The method comprises the following steps that 1, network communication among an IBA database, an interface machine and a PI real-time database is set up, and a station number written in the PI real-time database after being converted is defined; 2, a collecting period is set for data of PDA files needing to be collected in the IBA database according to a temporal mode, and a data collecting template is built; 3, a file directory of reading the PDA files in the IBA database is set in IBA datcoordinator software, a file directory where text files are stored is guided out, and the data needing to be collected are converted into the text files; 4, an installation directory of an IBA database file conversion function service program is set up; 5, the text files are converted into text files capable of being recognized by a PI-batch file interface of the PI real-time database, and the final files are transmitted to an output directory and written in the PI real-time database. Through data format conversion between an IBA server and the PI real-time database, data sharing between the isomerous database systems is achieved.

The invention relates to a system used for ensuring completeness of data integration in a heterogeneous database system. In order to ensure the completeness of the data integration in the heterogeneous database system, a data integration layer is designed; a conversion function is provided for data from a heterogeneous data source; and a data integrity requirement is met.

The object of the present application is to provide a CPU-GPU based load balancing method and apparatus. A pipelined query execution model is constructed on the GPU-GPU heterogeneous database system,so that CPU-GPU heterogeneous data analysis system can support query analysis in big data scenario; determining the total number of pipelines to be executed; starting the pipeline query execution model to allocate the pipeline corresponding to the total number to the CPU and the GPU, and calculating the system execution time corresponding to all load distribution strategies according to the determined execution time of a single pipeline on the CPU and the GPU respectively; finally, the load distribution strategy corresponding to the minimum value of the execution time of all the systems is determined as the optimal CPU-GPU allocation strategy,the load balancing strategy of the CPU-GPU heterogeneous data analysis system can reasonably distribute pipeline load to different processors, make full use of processor computing resources, not only improve the system performance, but also make the system achieve the best overall performance.