Big data intelligent extraction management method

A management method and data extraction technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., to achieve the effects of easy promotion, manpower saving, and strong practicability

Inactive Publication Date: 2013-12-25
INSPUR QILU SOFTWARE IND
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These will cost a lot of manpower and material resources. In order to reduce the workload of data concentration, we have developed extraction management applications based on various data concentration tools.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data intelligent extraction management method
  • Big data intelligent extraction management method
  • Big data intelligent extraction management method

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0032] This management application is designed and implemented based on J2EE technology, and developed by using ORACLE 9I and above databases and BEA WEBLOGIC SERVER 8.1 middleware software. The implementation steps are as follows:

[0033] The first step is to prepare the database environment.

[0034] Create a table space and user in the database, as shown in the following table

[0035] user password table space table space size Set according to the actual situation cqglpt_dat 200M

[0036] The second step is to deploy system applications.

[0037] 1. Import the organized data under the created user.

[0038] 2. Obtain the system program: CQGLPT.

[0039] 3. Create a domain according to the default option: cqglpt_domain.

[0040] 4. Start startWebLogic.cmd and enter the weblogic console:

[0041]Create a connection pool cqglptpool (username / password) and a data source.

[0042] Create a data source, note that the JNDIName should be cqglpt_ds,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data intelligent extraction management method which comprises the concrete steps of completing the management step of extracting application, completing the information synchronization step, completing the extraction rule management step, completing the rule parameter management step and completing the extraction task scheduling step. Compared with the prior art, the big data intelligent extraction management method does not need to develop functions again when a data extraction tool is changed, and can be used only by configuring the relevant information. The operation and maintenance staff can realize centralized management of data without mastering the extraction tool.

Description

technical field [0001] The invention relates to the technical field of computer applications, in particular to a management method for intelligent extraction of big data. Background technique [0002] As the importance of big data becomes more prominent, the demand for centralizing data scattered in different regions and departments is increasing on the basis that my country's basic data has been perfected. In the centralization process, some directly apply database technology for data centralization, and some use third-party data centralization tools for centralization. There are many limitations and high hardware requirements for directly synchronizing data with application databases, and data extraction cannot be performed in wide area networks and complex network environments. The most widespread is data centralization through data centralization tools. When applying data centralization tools for data centralization, it is often necessary to develop platforms based on ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 邹建军吕亚伟赵兵旗
Owner INSPUR QILU SOFTWARE IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products