Cloud Service Dispatching Module for Online Evaluation

The system segments service requests into two distinct paths: a first path for production services and a second path for evaluation services. This segmentation allows offline evaluation units to process real user requests separately from production units, enabling accurate performance measurement without affecting service reliability. The dispatching module routes requests to appropriate units based on their function.

The patent introduces an intermediary evaluation management module that coordinates between production services and evaluation services. This intermediary manages the registration, activation, and operation of offline evaluation units, ensuring they receive appropriate traffic while maintaining separation from production workflows. The intermediary enables accurate evaluation by mediating the flow of real user requests to evaluation units.

The system applies partial action by routing only a portion of user requests to evaluation units while the majority continue to production units. The dispatching module implements this by using hash functions to determine request routing, ensuring evaluation units receive sufficient traffic for accurate measurement without compromising overall service availability. This partial routing enables evaluation while maintaining productivity.

Different parts of the system have different functions: production units handle service delivery while evaluation units handle performance measurement. The dispatching module applies local quality by routing requests based on their intended destination, ensuring production units maintain high availability for users while evaluation units accurately measure performance using real traffic patterns.

The evaluation management module provides universal functionality by managing multiple offline evaluation units through a single interface. It handles registration, activation, and traffic routing for all evaluation units, reducing system complexity despite supporting multiple services. The module acts as a universal controller that simplifies the management of diverse evaluation units.

The system segments evaluation functionality into independent offline evaluation units, each capable of evaluating specific services. This segmentation allows comprehensive service assessment while maintaining manageable complexity, as each unit operates independently under the coordination of the evaluation management module. The modular structure enables versatile evaluation without creating monolithic complexity.