The invention discloses a storage and calculation separation key value storage
delay optimization method based on prediction driving, and aims to solve the problems of performance
bottleneck and high
tail delay caused by passive management and high
network delay in a key value storage
system in a storage and calculation separation scene. The method comprises the following steps: time load prediction: deploying a
time sequence prediction model at a
client, and predicting a future read-write request based on a historical access sequence; active cache prefetching: according to the predicted read request, actively preloading hotspot data from a
server side to a
client side for caching so as to improve the
cache hit rate and hide
network delay; active write-in optimization: according to the predicted write request, executing maintenance at a
server side through predictive pre-
insertion and active
node splitting, and moving
high index structure adjustment overhead out of a key request path to eliminate a write
delay peak; and structure sensing batch synchronization: pre-fragmenting a local
write buffer by using a
server index top layer model of a
client cache, and combining multiple independent remote
insertion operations into one efficient batch update to reduce
data synchronization overhead. Compared with an existing passive
management system, the characteristics of
model prediction and active cooperation are fully utilized, and the average delay and the
tail delay of the
system are reduced.