Data processing method based on Oracle

A data processing and data cleaning technology, applied in the field of data processing, can solve the problems of low degree of automation, difficult database maintenance, long migration time, etc., and achieve the effect of reducing workload

Inactive Publication Date: 2015-04-29
SHANGHAI SNC NET INFORMATION TECH CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 2. Impact on system performance: Although data access is generally concentrated on recent data, the database still needs to scan the data or indexes of the entire table. The data volume of a single table is huge, resulting in a significant reduction in the efficiency of overall data query
[0006] 3. Maintenance and security: The large amount of table data makes common database maintenance difficult, including index creation, data migration and data maintenance, etc.
At the same time, due to the characteristics of the IT system of the telecom operator, its core business database continuously generates a large amount of data, and the storage expansion speed is far from meeting its growth demand. It is necessary to perform data life cyc

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method based on Oracle
  • Data processing method based on Oracle

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0028] figure 1 It is a schematic diagram of the data processing flow diagram based on Oracle in the present invention; figure 2 It is a schematic diagram of the data life cycle management architecture used in the present invention.

[0029] See figure 1 and figure 2 , Generally speaking, in the data life cycle management of operators, the time of data generation in the table (recorded in the time field in the table) is often used as the basis for data life cycle management. The overall technical structure is as follows: figure 2 As shown in the figure, in order to realize the automatic data migration and cleaning process, the present invention makes full use of the new features of oracle 12C combined with the idea of ​​data life cycle management, and sorts out the data life cycle management method through Oracle 12C, which roughly includes four ste...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method based on Oracle. The method comprises the following steps that a) the storage mode, the migration mode and the cleaning mode of data in each table are respectively set by aiming at different data table entities in an Oracle database; b) at least one set table data cleaning mode in the Oracle database is combined for forming data cleaning operation; c) a concrete executing time window is allocated by aiming at the data cleaning operation, and in addition, the dispatching operation execution is carried out in the preset time window; d) according to an automatic operation dispatching execution result, monitoring information of data migration and cleaning is summarized. The data processing method has the advantages that the storage mode, the migration mode and the cleaning mode are respectively set for different data table entities, and the dispatching data cleaning operation realizes the periodization and automation of the data migration and cleaning process, so the data operation workload is reduced, in addition, the zero machine halt time and the zero influence on the application in the migration and cleaning process are realized.

Description

technical field [0001] The invention relates to a data processing method, in particular to an Oracle-based data processing method. Background technique [0002] Since most IT systems are production systems that operate 7*24 hours a day, a large amount of data is continuously generated during the production operation. These generated data come from user additions, orders, work orders, user account information, etc. Usually, these data are continuously generated by system applications, but the system applications themselves usually do not effectively process the generated data. If the historical data cannot be effectively cleaned, the data can only enter and cannot enter; at the same time, although sufficient redundant capacity is planned during the system launch planning, due to the continuous increase and launch of new services in the system, the data grows The speed is still far faster than planned. [0003] The rapid growth of data often brings all kinds of problems and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215G06F16/214
Inventor 程永新宋辉梁铭图
Owner SHANGHAI SNC NET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products