Distributed cluster simulation system, method and device

Abstract

The invention provides a distributed cluster simulation system, method and device. The system comprises an upstream searching module, a downstream distributed cluster and a network bridge. The downstream distributed cluster comprises a plurality of downstream searching modules. The network bridge receives a pressure request sent by the upstream searching module, sends the pressure request to the downstream searching modules, then forwards data packs returned by the downstream searching modules according to the pressure request to the upstream searching module and stores communication data packs between the upstream searching module and the downstream searching modules at the same time. The network bridge generates a dictionary according to the communication data packs based on a preset format, searches a data pack corresponding to the pressure request in the dictionary according to the pressure request sent by the upstream searching module and returns the data pack to the upstream searching module. According to the system, a cluster can be simulated through the network bridge, resources are saved, testing complexity is lowered, testing efficiency is improved, and test simulation on any flowing data stream can be achieved.

Description

technical field [0001] The invention relates to the technical field of network search, in particular to a distributed cluster simulation system, method and device. Background technique [0002] For a distributed cluster system similar to a network search engine, in testing the reliability and performance of the distributed cluster, it is necessary to connect to the cluster distributed downstream of the test module to retrieve data, but the machine resources are very limited, and it is impossible to build a corresponding offline Therefore, there is a need for a way to simulate an online-scale distributed cluster to solve the testing problem. [0003] Existing technologies usually use a module and a service as a unit to perform separate simulations to complete various tests that rely on the simulation backend. [0004] The problems existing in the existing technology are: (1) It is impossible to simulate data interaction in a distributed cluster based on a single module; (2) ...

AI Technical Summary

Problems solved by technology

[0004] The problems existing in the existing technology are: (1) It is impossible to simulate data interaction in a distributed cluster based on a single module; (2) Relying on the instrumentation of the code under test, the simulated playback data needs to rely on the recording communication package (dump) function of the module , if the module does not have the function of recording communication packets (dump), it is also necessary to modify the module code to add the function of recording communication packets (dump); (3) The performance is low and the test resources (mainly machine resources) are used more. If you want to simulate distributed Clusters, multiple simulation tools need to be started; (4) Data recording / playback cannot be performed for arbitrary flowing data streams

Images