Automatic storage method of mass data based on Solr index and Oracle storage

A massive data and indexing technology, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problem of high maintenance cost, achieve the effect of stable deployment, convenient deployment, and reduce professional skills requirements

Active Publication Date: 2017-06-13
上海熙菱信息技术有限公司
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0018] In view of the above-mentioned defects of the prior art, the technical problem to be solved by the present invention is to develop a mass data automatic storage method based on Solr index and Oracle storage, and adopt the combination technology of Solr and Oracle to fundamentally solve the query and statistics of mass data Speed ​​problem; use excellent design to fundamentally solve the problem of high project scalability and maintenance costs, reduce the technical difficulty of project implementation, enhance system scalability and extensibility, and make it an efficient, concise and easy-to-maintain system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic storage method of mass data based on Solr index and Oracle storage
  • Automatic storage method of mass data based on Solr index and Oracle storage
  • Automatic storage method of mass data based on Solr index and Oracle storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] A preferred embodiment of the present invention provides a mass data automatic storage method based on Solr index and Oracle storage, including:

[0058] Step 1. Automatically create storage units, pre-set N rules for creating storage units, and automatically create N storage units corresponding to the rules; wherein, the rules for creating storage units include creating according to natural years, creating according to natural quarters, and creating according to natural years Create one or more of any months in , separate creation based on natural months, and creation based on the maximum data retention of each storage unit.

[0059] Step 2. Automatically classify and store massive data, pre-set storage rules, split massive data according to different conditions and dimensions, merge and store them into the corresponding Connection index service in Solr and the corresponding business table of Oracle database; among them, pre-set Setting storage rules includes one or mo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic storage method of mass date based on Solr index and Oracle storage. The automatic storage method comprises the following steps: step 1, automatically creating a memory cell by automatically creating N storage units for the corresponding rules; step 2, automatically classifying and storing of mass data by splitting mass data according to different conditions and dimension, merging and storing mass date to the corresponding connection index service of Solr and corresponding service table of Oracle database ; step 3, recycling storage unit, the storage of data that is not up to standard is merged at the Solr level and the Oracle database level and the other remaining connection and free Oracle service data table is recycled. The automatic storage method of mass date based on Solr index and Oracle storage, by adopting Solr and Oracle combination technology, solves the problems of the query of mass date and statistical rate; by adopting good design, the problem of project expansion and high maintenance cost are solved; thereby reducing the project technical difficulty and enhancing the system scalability and extensibility.

Description

technical field [0001] The invention relates to data storage technology, in particular to an automatic storage method for massive data based on Solr index and Oracle storage. Background technique [0002] With the rapid development of informatization, the types and functions of information system resources are becoming more and more complete, and a huge amount of information system application data is generated. These application data are more and more valued, and deep mining and analysis of data has become a deep business function of the industry. The emergence of a large number of technical means based on massive data analysis, such as user behavior analysis and hotspot applications, has highlighted the important position of these business data. [0003] How to effectively save these precious business data, the current mainstream technical means and implementation methods are mainly distributed in two directions: storage routes based on big data technology and storage base...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/2282
Inventor 赵敏牟秋辰裴华明王夷鲁惊雷马建平张栋姚莉雅张素芳
Owner 上海熙菱信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products