The invention discloses a cache
tail delay optimization method based on NVMe
solid state disk characteristics, and aims to solve the problem of cache long
tail delay caused by a high fan-out request in a cache
system. The method comprises a differential request
processing strategy: based on weighted
polling arbitration mechanism characteristics of the NVMe
solid state disk, determining the number of sub-requests contained in different priorities according to fan-out sizes of requests, and reducing
processing time differences among the sub-requests while giving higher priorities to high fan-out requests; according to the sub-request
sorting algorithm, the influence of the sub-requests on the
tail delay is evaluated according to the characteristics of the sub-requests, and sorting is performed according to the sub-requests, so that the priorities of the sub-requests are determined; according to the
priority queue load balancing strategy, loads between NVMe priority queues are balanced, and
queue congestion is avoided; and the feedback adjustment mechanism is used for monitoring and analyzing
queue load and request delay to perform dynamic adjustment. Compared with an existing cache based on a
solid state disk, the method has the
advantage that the tail delay of the cache is optimized by fully utilizing the characteristics of the NVMe
solid state disk.