Resource allocation method, device, computer equipment and storage medium

Abstract

The invention relates to a resource allocation method, device, computer equipment and storage medium. The method includes: receiving a current query request, obtaining an expected resource consumption value of the current query request; determining a current resource consumption level of the current query request according to the expected resource consumption value; and determining a current resource consumption level of the current query request according to the current resource consumption level, Resource allocation is performed on the current query request. Using this method can improve the stability and overall performance of the system.

Description

technical field [0001] The present invention relates to the technical field of databases, in particular to a resource allocation method, device, computer equipment and storage medium. Background technique [0002] With the development of database technology, online analytical processing (Online Analytical Processing, OLAP) technology appears. On-line analytical processing is mainly a rapid software technology for online data access and analysis for specific problems that uses distributed systems to share multi-dimensional information. [0003] For OLAP queries, current distributed systems generally use scheduling algorithms such as First Input First Output or Fairness (FAIR) to allocate resources. However, among OLAP queries, some queries are extremely resource-intensive and take a long time to execute. If several such query requests are executed concurrently at the same time, it is easy to fill up the resources of the cluster. This will make other queries unable to obtai...

AI Technical Summary

Problems solved by technology

However, among OLAP queries, some queries are particularly resource-intensive and take a very long time to execute

If several such query requests are executed concurrently at the same time, it is easy to fill up the resources of the cluster

This will make other queries unable to obtain enough resources, hinder the execution of these query requests (even if the resource occupied by this query request is very small, the execution is very fast), and affect the user experience; the severe one may cause the application memory to run out (Out Of Memory, OOM) or the entire cluster crashes

It can be seen that the traditional first-in-first-out resource allocation method or fair resource allocation method will affect the stability and overall performance of the system when the query requests that consume a lot of resources appear intensively.

Images