Heterogeneous replication method for database

A replication method and database technology, applied in the field of database processing, can solve problems such as poor scalability, high IO pressure, affecting database performance, etc., and achieve the effects of fault tracing optimization, performance optimization, and occupation reduction.

Active Publication Date: 2015-03-04
SHANGHAI SNC NET INFORMATION TECH CO LTD
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although Oracle comes with this part of the function, because this type of data is big data, it cannot be stored for a long time. If long-term storage is set, it will impose a certain burden on the database system and affect the performance of the database.
[0005] It can be seen from the above that although the relational database is very powerful, it cannot store monitoring data well for a long time, and its scalability is poor (requires complex technology to realize), the IO pressure is high under big data, and it is difficult to change the table structure

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous replication method for database
  • Heterogeneous replication method for database
  • Heterogeneous replication method for database

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0032] 1) Query the ACTIVE data in v$session from the relational database every 1-5 seconds. You can also query data for other dynamic performance views. After testing a large-scale Oracle system, it is basically possible to query the ACTIVE sessions in the memory in less than one second, and then convert the queried information into related dump files through SPOOL.

[0033] 2) In order not to cause excessive load on the production environment (relational database) and cause performance load, the present invention uploads the file to the NoSQL server. Here you can consider using FTP to transfer a batch of files every once in a while.

[0034] 3) Write the corresponding interface, convert the dump file, and convert it into the corresponding NoSQL format, such as CSV format or JSON format. For different NoSQL databases, different interfaces need to be developed.

[0035]This piece needs to read the corresponding file, and convert the tabular data file of the relational databa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous replication method for a database. The method comprises the following steps: (a) acquiring process data which are generated in an operation process of a relational database; (b) carrying out separation and extraction on session data and customer data in the acquired process data; (c) storing the separated and extracted session data into a non-relational database, wherein the session data stored in the non-relational database are divided according to the session IDs (identity cards), and comprise SQLID (structured query language identity card), transferred application program, time of duration, transferred SQL (structured query language) quantity, wait events and occupied memory size; storing the session data after sorting according to the time order. According to the heterogeneous replication method for the database provided by the invention, through separation of the session data and the customer data, the session data generated in the operation process of the relational database are stored by virtue of an NoSQL format, thus the monitored data can be stored for a long period of time; occupation in a system tablespace is reduced, and subsequent statistic analysis, fault tracking and performance optimization are facilitated.

Description

technical field [0001] The invention relates to a database processing method, in particular to a database heterogeneous replication method. Background technique [0002] The traditional relational database has good performance, high stability, long history, and is easy to use, powerful, and has accumulated a large number of successful cases. [0003] Process data is stored in a table in a relational database, and is associated by a similar sid. For example v$session table and v$process table. In these tables, each record represents a process data. If you want to fully display all the process data of a session, you need to associate these tables for query. [0004] For example, the relational database Oracle, its session information is stored in the dynamic performance view of v$session, and the information in v$session is copied to v$active_session_history every second, and this part of historical data is still stored in memory , and every 10 seconds, the information in ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/273
Inventor 程永新杨志洪袁伟翔
Owner SHANGHAI SNC NET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap