Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for solving cache failure of mass data distributed index cluster

A massive data, distributed technology, applied in the direction of digital data information retrieval, electronic digital data processing, special data processing applications, etc., can solve the problems of massive data distributed index cluster cache failure, to improve the cluster query speed, solve the system Cache invalidation, the effect of saving cluster resources

Pending Publication Date: 2022-07-29
EAST CHINA JIAOTONG UNIVERSITY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiment of the present invention is to provide a method for solving the failure of massive data distributed index cluster cache, aiming to solve the problem of how to quickly process the massive data of the distribution network and propose a quick response technology for the dispatching system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for solving cache failure of mass data distributed index cluster
  • Method for solving cache failure of mass data distributed index cluster
  • Method for solving cache failure of mass data distributed index cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0051] The specific implementation of the present invention will be described in detail below with reference to specific embodiments.

[0052] like Figure 1-2 As shown, a method for solving the cache invalidation of massive data distributed index cluster provided by an embodiment of the present invention includes the following steps:

[0053] Step 1: Screen the search manager to filter out the hotspot data;

[0054] Step 2: Perform a correlation analysis of the selected hotspot data, and conduct a comprehensive ranking according to the correlation and the number of searches;

[0055] S...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is applicable to the technical field of distributed index clusters, and provides a method for solving cache failure of a mass data distributed index cluster, which comprises the following steps of: 1, screening a search manager to screen out hot data; 2, carrying out hotspot data correlation analysis on the screened hotspot data, and carrying out comprehensive sorting according to the correlation and search times; 3, analyzing the performance of the searcher, and calculating a difference value between preheating time spent by preheating query and a time gain effect brought by preheating query; 4, a preheating query statement is set, and the optimal number of optimal preheating queries is found through an experiment; and step 5, testing and setting time gains brought by the optimal preheating query number under different conditions. According to the method, the problem of system cache failure caused when the operation is submitted is solved, meanwhile, hot start of the system is achieved, cluster resources are greatly saved, and the cluster query speed is increased.

Description

technical field [0001] The invention belongs to the technical field of distributed index clusters, and in particular relates to a method for solving the cache invalidation of massive data distributed index clusters. Background technique [0002] With the continuous increase of the scale of high-speed railways in my country, the use of four electrical equipment such as traction power supply system, railway power system, railway communication signal power supply and catenary isolation switch, as well as the use of 6C system, make the data collected by the inspection and monitoring system increase sharply. The volume of data has exceeded the terabyte level, which makes the effective storage of valuable data a new problem. It is difficult for traditional terabyte-level databases to meet the storage requirements, and the growth rate of data has far exceeded the growth of computer performance. How to quickly process the massive data of the distribution network and propose a rapid ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/2453
CPCG06F16/24552G06F16/2453
Inventor 屈志坚吴广龙池瑞侯新星帅诚鹏梁家敏
Owner EAST CHINA JIAOTONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products