Mass data storage and quick retrieval method based on MongoDB and Solr

A massive data, fast technology, applied in digital data information retrieval, unstructured text data retrieval, text database indexing and other directions, can solve the problems of difficult operation, cumbersome and complicated, and achieve easy operation, transaction log optimization, and realization. search effect

Inactive Publication Date: 2019-09-13
ANHUI SUN CREATE ELECTRONICS
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since JVM memory and Solr's memory configuration, disk usage, transaction logs and other related content are relatively cumbersome and complicated, when dealing with massive data, optimization of these aspects requires trial and error and is not easy to implement.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass data storage and quick retrieval method based on MongoDB and Solr
  • Mass data storage and quick retrieval method based on MongoDB and Solr
  • Mass data storage and quick retrieval method based on MongoDB and Solr

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0037] Solr is an independent enterprise-level search application server. It is based on Lucene's full-text search, and at the same time it extends Lucene, providing a richer query language than Lucene, realizing configurability and scalability, and improving query performance. Optimized. Among them, configurable means that some properties of Solr can be used through configuration; scalable means: when the amount of data is large, too many Solr indexes cannot ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mass data storage and rapid retrieval method based on MongoDB and Solr. The method includes: for storage of unstructured data, calling a MongoDB database to store the unstructured data; creating a MongoDB resource information unique code corresponding to the unstructured data, calling Solr to create index information of the unstructured data, and storing the index information of the unstructured data and the MongoDB resource information unique code into an index library of the Solr; for rapid retrieval of the unstructured data, carrying out searching in an index library of Solr according to the query statement, and finding out index information and MongoDB resource information unique codes of the unstructured data corresponding to the query statement; and searching unstructured data corresponding to the MongoDB resource information unique code in a MongoDB database. According to the method, the requirements of storage and quick retrieval of various unstructured data in daily business are met, and quick retrieval of mass unstructured data is realized so as to quickly obtain required information.

Description

technical field [0001] The invention relates to the technical field of fast retrieval of big data, in particular to a massive data storage and fast retrieval method based on MongoDB and Solr. Background technique [0002] With the development of computer information technology and the application of big data, more and more data are flooding our daily life. For example, for public security agencies, using urban video surveillance resources to detect cases and form various case materials Information has accumulated a large amount of unstructured data such as pictures and videos. Therefore, how to quickly obtain the required information from these massive unstructured data has become a hot and difficult issue in massive data retrieval. [0003] After searching, the Chinese Patent Publication No. CN106682148A discloses a method and device based on Solr data search. In this patent, it is proposed that the underlying storage database of Hbase or MongoDB is selected, and the rowke...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/31G06F16/33G06F16/332
CPCG06F16/316G06F16/332G06F16/3331
Inventor 王利梅唐飞何丹娜张海荣吴涛李凯闻志吴爱清沙健熊飞刘江明尚兵兵王微杨良闯周小将陈迪宇朱志超唐杰王文杰汪志发舒贵阳李慧胡昊
Owner ANHUI SUN CREATE ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap