Apache Solr read-write separation method and apparatus

A technology of reading and writing separation and data writing, which is applied in the computing field, can solve problems such as server crashes, and achieve the effect of improving search efficiency and cache utilization

Active Publication Date: 2018-11-06
HUNAN ANTVISION SOFTWARE
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Based on this, it is necessary to provide a method, a device, a computer device and a storage method for separating read and write of Apache Solr that can realize the isolation of read and write operations to ensure the normal operation of the server for the above-mentioned problem of server crash caused by the competition of read and write operations. medium

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Apache Solr read-write separation method and apparatus
  • Apache Solr read-write separation method and apparatus
  • Apache Solr read-write separation method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0057] In one embodiment, such as figure 1 As shown, a read-write separation method of Apache Solr is provided, and the method includes the following steps:

[0058] S101. Receive a data write request from a persistence program, and write data into a write cluster and a snapshot cluster according to the data write request.

[0059] Among them, the "persistence program" refers to the program used to implement data writing, that is, implement persistent storage after data is written into the Apache Solr cluster.

[0060] Apache Solr is an open source search server. Solr is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an Apache Solr read-write separation method and apparatus, a computer device and a storage medium. The method comprises the steps of receiving a data writing request of a persistence program, and writing data into a writing cluster and a snapshot cluster; receiving a searching request of an Apache Solr client, and search for the data from a reading cluster and the snapshotcluster; receiving a segment merging instruction sent by the persistence program, and executing segment merging operation on the data in the writing cluster; receiving a synchronization instruction sent by the persistence program, and incrementally loading an index file from a data directory of the writing cluster to an out-of-heap memory of the reading cluster; and receiving a data cleaning instruction sent by the persistence program, and cleaning out the synchronized expired data in the snapshot cluster. By the adoption of the method, the read operation and the write operation can be separated, so that the situation that the system resources are competed is avoided, and the normal operation of a server is guaranteed; and the segment merging operation is completed before data synchronization, so that system crash caused by segment merging during synchronization is avoided.

Description

technical field [0001] The present application relates to the field of computing technology, in particular to a method, device, computer equipment and storage medium for realizing read-write separation of Apache Solr. Background technique [0002] With the development of computer technology, Apache Solr technology appeared. Apache Solr is a powerful enterprise-level search engine. It is implemented based on Lucene and supports near real-time full-text search. It has a "segment merge" mechanism. When writing When the number of data segments reaches the set threshold, "segment merging" will be triggered, and multiple segments with smaller data volumes will be merged into one segment. Apache Solr will frequently trigger "segment merging" during high concurrent writing of billions of data volumes, and it will hold a write lock during "segment merging", affecting real-time writing speed, and there are a large number of disk IO operations , and because the search request generate...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/455G06F9/50
CPCG06F9/45558G06F9/5027G06F2009/45595
Inventor 何小成王晓斌黄三伟
Owner HUNAN ANTVISION SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap