Advanced user resource access operation guarantee method and device, equipment and medium

Abstract

The invention belongs to the field of big data, and relates to an advanced user resource access operation guarantee method, which comprises the following steps: querying current memory use conditions of all users executing current resource access operation in a cluster; acquiring preset user resource configuration information; wherein the user resource configuration information comprises a user name and a corresponding memory quota; identifying all user levels executing the current resource access operation based on the user resource configuration information; generating a judgment result of whether the current memory is sufficient or not based on the current memory use conditions of all the users when the user levels are identified to comprise common users; and based on the judgment result, executing corresponding permission setting on the current resource access operation of the common user so as to ensure the current resource access operation of the advanced user. The invention further provides a related device, equipment and a storage medium. According to the method and the device, sufficient cluster resources can be obtained by resource access operation of advanced users.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a method, device, equipment and medium for ensuring access to resources by high-level users. Background Art

[0002] In the era of big data, the real-time nature of data is crucial to the operation of enterprises. Especially in the financial field, high-priority users have more urgent needs for extremely fast responses and decision-making. Taking the Apache Doris engine as an example, Apache Doris, as a high-performance MPP analytical database, has become an ideal real-time data warehouse choice in big data scenarios with its millisecond-level query response, high concurrency, high availability and easy scalability.

[0003] However, current engines such as Doris lack user classification functions. When multiple users query and calculate in the cluster (within the same resource group) at the same time, resource competition and mutual influence will occur, resulting in the inability of advanced users to guarantee their query performance when cluster resources are tight, slowing down user decision-making and affecting advanced user satisfaction. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a method, apparatus, device and medium for ensuring resource access operations for advanced users, the main purpose of which is to ensure that the operations of advanced users can obtain sufficient cluster resources.

[0005] In order to solve the above technical problems, the embodiment of the present application provides a method for ensuring access to resources by advanced users, which adopts the following technical solutions:

[0006] A method for ensuring access to resources by high-level users, the method comprising the following steps:

[0007] Query the current memory usage of all users who perform the current resource access operation in the cluster;

[0008] Get preset user resource configuration information;

[0009] Based on the user resource configuration information, identifying the user levels of all the users who perform the current resource access operation;

[0010] When it is identified that the user levels include both common users and advanced users, a determination result of whether the current memory is sufficient is generated based on the current memory usage of all the users;

[0011] Based on the judgment result, corresponding permission setting is performed on the current resource access operation of the ordinary user to ensure the current resource access operation of the advanced user.

[0012] Furthermore, based on the judgment result, performing corresponding permission setting on the current resource access operation of the ordinary user includes the following steps:

[0013] If the judgment result is that the current memory is insufficient, the current resource access operation of excess users among the ordinary users is blocked; the excess users are ordinary users whose current memory usage exceeds a preset proportion of the total memory of all resources in the cluster;

[0014] A blocking prompt is sent to the excess user.

[0015] Furthermore, when it is identified that the user level also includes the advanced user, the performing of corresponding permission setting on the current resource access operation of the ordinary user based on the determination result further includes the following steps:

[0016] If the judgment result is that the current memory is sufficient, judging whether the current memory usage of the ordinary user exceeds a preset range;

[0017] If it is determined that the current resource usage does not exceed the preset range, the current resource access operation of the common user is allowed, and it is determined whether the current memory usage of the common user exceeds a preset ratio of the preset range. If the current memory usage exceeds the preset ratio, a warning prompt is sent to the common user.

[0018] If it is determined that the resource access exceeds the preset range, the current resource access operation of the ordinary user is blocked, and a blocking prompt is sent to the ordinary user.

[0019] Furthermore, the generating of a judgment result of whether the current memory is sufficient based on the current memory usage of all the users includes the following steps:

[0020] Determine whether the current memory usage of each of the users who performs the current resource access operation satisfies a preset ratio less than the total memory of all resources in the cluster;

[0021] If it is determined that the preset ratio is less than the total memory of all resources in the cluster, a determination result that the current memory is sufficient is generated;

[0022] If it is determined that the preset proportion less than the total memory of all resources in the cluster is not satisfied, a determination result that the current memory is insufficient is generated.

[0023] Further, the user resource configuration information includes a user name and a corresponding memory quota; and the identifying the user levels of all the users who perform the current resource access operation based on the user resource configuration information includes the following steps:

[0024] Matching a corresponding memory quota in the user resource configuration information based on the user name of the user;

[0025] If the matched memory quota is greater than 0, the user is regarded as a common user;

[0026] If the matched memory quota is equal to 0, the user is regarded as the advanced user;

[0027] If the memory quota is not matched, the user is regarded as the advanced user.

[0028] Further, when it is identified that the user levels include common users, keywords are extracted from the operation log of the current resource access operation of the common users;

[0029] Based on the keyword, determining whether the current memory usage of the current resource access operation of the ordinary user exceeds a warning level;

[0030] If it is determined that the memory usage exceeds the warning level, a feedback indicating that the memory usage exceeds the warning level is sent to the ordinary user.

[0031] In order to solve the above technical problems, the embodiment of the present application also provides a high-level user resource access operation guarantee device, which adopts the following technical solutions:

[0032] An advanced user resource access operation guarantee device, comprising:

[0033] An information acquisition module, used to query the current memory usage of all users who perform the current resource access operation in the cluster;

[0034] Configuration acquisition module, used to obtain preset user resource configuration information;

[0035] A level identification module, used to identify the user levels of all the users who perform the current resource access operation based on the user resource configuration information;

[0036] A memory judgment module, configured to, upon recognizing that the user level includes the common user, generate a judgment result on whether the current memory is sufficient based on the current memory usage of all the users;

[0037] The authority setting module is used to perform corresponding authority setting on the current resource access operation of the ordinary user based on the judgment result to ensure the current resource access operation of the advanced user.

[0038] Further, when it is identified that the user level also includes the senior user, the permission setting module includes:

[0039] An operation blocking submodule, configured to block the current resource access operation of the ordinary user if the judgment result is that the current memory is insufficient;

[0040] The blocking sending submodule is used to send a blocking prompt to the ordinary user.

[0041] In order to solve the above technical problems, the embodiment of the present application further provides a computer device, which adopts the following technical solution:

[0042] A computer device comprises a memory and a processor. The memory stores computer-readable instructions. When the processor executes the computer-readable instructions, the steps of any one of the above-mentioned methods for ensuring access to resources for advanced users are implemented.

[0043] In order to solve the above technical problems, the embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solution:

[0044] A computer-readable storage medium stores computer-readable instructions, which, when executed by a processor, implement the steps of any of the above-mentioned methods for ensuring access to resources for advanced users.

[0045] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0046] The embodiment of the present application queries the current memory usage of all users who perform current resource access operations in the cluster; based on preset user resource configuration information, identifies the user levels of all users who perform current resource access operations; when it is identified that the user levels include ordinary users, generates a judgment result on whether the current memory is sufficient based on the current memory usage of all users; based on the judgment result, performs corresponding permission settings on the current resource access operations of ordinary users to ensure that operations such as query requests of high-priority users can obtain sufficient cluster resources, reduce resource preemption, and ensure good response time even during cluster peak periods, so that advanced users can obtain a better service experience, thereby enhancing user satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the scheme in the present application, a brief introduction is given below to the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0048] Figure 1 is an exemplary system architecture diagram to which the present application may be applied;

[0049] Figure 2 A flowchart of an embodiment of a method for ensuring access to resources by advanced users according to the present application;

[0050] Figure 3 yes Figure 2 A flowchart of a specific implementation of step S205;

[0051] Figure 4 It is a structural diagram of an embodiment of a high-level user resource access operation guarantee device according to the present application;

[0052] Figure 5 It is a structural diagram of an embodiment of a computer device according to the present application. DETAILED DESCRIPTION

[0053] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of the present application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present application; the terms "including" and "having" and any variations thereof in the specification and claims of the present application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0054] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0056] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0057] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0058] Terminal devices 101, 102, 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop computers, desktop computers, etc.

[0059] The server 105 may be a server that provides various services, such as a background server that provides support for web pages displayed on the terminal devices 101 , 102 , and 103 .

[0060] It should be noted that the advanced user resource access operation guarantee method provided in the embodiment of the present application is generally executed by a server, and accordingly, the advanced user resource access operation guarantee device is generally set in the server.

[0061] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0062] Continue to refer Figure 2 , shows a flow chart of an embodiment of a method for guaranteeing access to resources for advanced users according to the present application. The method for guaranteeing access to resources for advanced users in the embodiment of the present application comprises the following steps:

[0063] Step S201, querying the current memory usage of all users who perform current resource access operations in the cluster.

[0064] In this embodiment, the electronic device (eg Figure 1The server shown in the figure can query the current memory usage of all users who perform the current resource access operation in the cluster through a wired connection or a wireless connection. It should be noted that the above wireless connection method may include but is not limited to 3G / 4G / 5G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0065] Taking the financial insurance business scenario as an example, users can log in to the financial insurance system through the client of the terminal device by entering information such as user name and password, and submit operations to query various business resources (such as transaction data, payment data, business data), etc. through the client financial insurance system interface.

[0066] Exemplarily, taking the Doris engine as an example, the Doris engine can set the advanced user resource access operation guarantee function of this application by adding the DorisFE dynamic parameter enable_resource_isolation. This dynamic parameter is a function switch, which can dynamically turn on or off the function implemented by the advanced user resource access operation guarantee method of the embodiment of this application without restarting the server; in addition, the advanced user resource access operation guarantee method of the embodiment of this application can also be implemented by setting the Doris static parameters. Doris can query all query information of a user in the cluster through the API, such as: the user's current memory usage, as well as FE_IP, query_id, connection_id, Database, Statement and other information.

[0067] Specifically, the current memory usage of all users performing the current resource access operation in the query cluster can be refreshed at a preset interval (for example, refreshed every 10 seconds), and the refresh interval can be based on user needs. In one implementation, the Doris engine FE dynamic parameter mem_quota_delay can be used for adjustment.

[0068] Step S202: Obtain preset user resource configuration information.

[0069] In one implementation, the user resource configuration information may include a user name and a corresponding memory quota.

[0070] For example, the configuration file content is as follows:

[0071] "User":[

[0072] {"UserName":"leader",

[0073] "memQuota": "0"},

[0074] {"UserName":"test",

[0075] "memQuota": "300"},

[0076] {"UserName: root",

[0077] "memQuota: 500"} ]

[0079] Where userName is the user name, and memQuota (memory quota) is the corresponding user memory quota (in bytes).

[0080] In one embodiment, continuing to take the Doris engine as an example, a new $DORIS_HOME / fe / conf / customer.json configuration can be added through FE. This configuration is a user level and resource quota configuration file, which is hot-loaded and can be dynamically modified without restarting the service.

[0081] Step S203: identifying all user levels that perform the current resource access operation based on preset user resource configuration information.

[0082] In an optional embodiment, the user resource configuration information includes a user name and a corresponding memory quota; step S203, based on the preset user resource configuration information, identifying all user levels that perform the current resource access operation may include the following method steps:

[0083] Match the corresponding memory quota in the user resource configuration information based on the user's username;

[0084] If the matched memory quota is greater than 0, the user is regarded as a common user;

[0085] If the matched memory quota is equal to 0, the user is regarded as the advanced user;

[0086] If the memory quota is not matched, the user is considered a premium user.

[0087] Continuing with the configuration file described in the above example, for other users, if the quota is > 0, they are ordinary users; otherwise, they are advanced users; when a user is created in Doris but is not configured in the user resource configuration customer.json file, it will also be considered an advanced user. In addition, for root and admin administrator users, this quota will not take effect.

[0088] The embodiment of the present application matches the corresponding memory quota in the user resource configuration information based on the user's username, identifies whether the user is an ordinary user or an advanced user based on the matched memory quota, and directly links ordinary users and advanced users with memory quotas, thereby effectively ensuring the effective use of memory resources by advanced users.

[0089] Step S204: after identifying that the user levels include both common users and advanced users, a determination result of whether the current memory is sufficient is generated based on the current memory usage of all users.

[0090] In one embodiment, in step S204, generating a judgment result of whether the current memory is sufficient based on the current memory usage of all users may include the following method steps:

[0091] Determine whether the current memory usage of each user who performs the current resource access operation satisfies the preset ratio of the total memory of all resources in the cluster;

[0092] If the judgment is satisfied that it is less than the preset ratio of the total memory of all resources in the cluster, a judgment result of sufficient current memory is generated;

[0093] If the judgment does not meet the preset ratio less than the total memory of all resources in the cluster, a judgment result that the current memory is insufficient is generated.

[0094] For example, assuming that a user submits a request to query various business resources through the client financial insurance system interface, it can be set that when the current memory used by all users performing the current resource access operation in the cluster is less than the preset proportion (for example, 30%) of the total memory of all resources in the cluster (for example, transaction data, payment data, and business data), the memory is considered sufficient, otherwise the memory is considered insufficient.

[0095] The embodiment of the present application determines whether the memory usage of the current resource access operations of all users satisfies the requirement of being less than the total memory of all resources in the cluster. When the memory usage of the current resource access operations of all users satisfies the requirement of being less than the total memory of all resources in the cluster, it determines that the current memory is sufficient. In this way, the memory usage of each user in the cluster is fully taken into consideration, thereby obtaining a higher standard judgment result on whether the memory is sufficient, so as to effectively guarantee the current resource access operations of advanced users.

[0096] Step S205: Based on the judgment result, corresponding permission settings are performed on the current resource access operations of the common users to ensure the current resource access operations of the advanced users.

[0097] The embodiment of the present application flexibly performs corresponding different permission settings for the current resource access operations of ordinary users based on the judgment result of whether the memory is sufficient, thereby ensuring the current resource access operation permissions of advanced users.

[0098] The embodiment of the present application queries the current memory usage of all users who perform current resource access operations in the cluster; based on preset user resource configuration information, identifies the user levels of all users who perform current resource access operations; when it is identified that the user levels include ordinary users, generates a judgment result on whether the current memory is sufficient based on the current memory usage of all users; based on the judgment result, performs corresponding permission settings on the current resource access operations of ordinary users to ensure that operations such as query requests of high-priority users can obtain sufficient cluster resources, reduce resource preemption, and ensure good response time even during cluster peak periods, so that advanced users can obtain a better service experience, thereby enhancing user satisfaction.

[0099] like Figure 3 As shown, Figure 3 yes Figure 2 A flowchart of a specific implementation of step S205 in FIG.

[0100] In an optional embodiment, when it is identified that the user level also includes advanced users, step S205, based on the judgment result, performing corresponding permission setting for the current resource access operation of the ordinary user may include the following method steps:

[0101] Step S2051: If the judgment result is that the current memory is insufficient, current resource access operations of excess users among ordinary users are blocked; excess users are ordinary users whose current memory usage exceeds a preset proportion of the total memory of all resources in the cluster.

[0102] Step S2052: Send a blocking prompt to the excess user.

[0103] The embodiment of the present application identifies that the user level includes not only ordinary users but also advanced users, and when it is determined that memory resources are insufficient, the current query request and other operations of ordinary users can be blocked, thereby effectively ensuring the current resource access and other operations of advanced users; in addition, by sending a blocking prompt to the user, ordinary users can effectively understand the reason why the current resource access operation is blocked, which is convenient for ordinary users to adjust the operation strategy in time.

[0104] For example, if a high-level user is currently performing a query operation in the Doris cluster and it is determined that the cluster memory is insufficient, ordinary users are blocked from querying and a prompt is displayed: "There is a high-power user querying the system and the memory usage is high, please wait."

[0105] Continue as Figure 3 As shown, in an optional embodiment, step S205, based on the judgment result, performing corresponding permission setting on the current resource access operation of the common user may also include the following method steps:

[0106] Step S2053: If the judgment result is that the current memory is sufficient, determine whether the current memory usage of ordinary users exceeds a preset range.

[0107] Step S2054, if it is determined that it does not exceed the preset range, allow the current resource access operation of the ordinary user, step S2055, and determine whether the current memory usage of the ordinary user exceeds the preset proportion of the preset range, step S2056, if it exceeds the preset proportion, send a warning prompt to the ordinary user.

[0108] Step S2057: If it is determined that the resource access exceeds the preset range, the current resource access operation of the ordinary user is blocked, and a blocking prompt is sent to the ordinary user.

[0109] For example, if the current memory is sufficient, check the memory used by the user. If it does not reach 80% of the quota (i.e., the preset proportion of the preset range above), the query is allowed but the log alarm is: user XXX mem usage has reached loadwater of quota! If the quota is reached, the user is blocked from querying and the prompt is: user XXX memory usage has reached the quota, quota: XXX, current usage value: XXX.

[0110] The embodiment of the present application determines whether the current memory usage of ordinary users exceeds a preset range when it is determined that memory resources are sufficient. If not, the current query of ordinary users is allowed, and determines whether the current memory usage of ordinary users exceeds a preset proportion of the preset range. If it exceeds the preset proportion, a warning prompt is sent to the ordinary user; if it exceeds the preset range, the current query of ordinary users is blocked, and a blocking prompt is sent to the ordinary user. Therefore, a certain amount of memory can be reserved to ensure that it will not affect the subsequent operations of newly added advanced users to execute queries, etc. In addition, early warning is given to ordinary users of possible blocked operations, so that ordinary users can adjust their operation strategies in time to improve their user experience.

[0111] In an optional embodiment, after identifying all user levels that perform the current resource access operation based on the user resource configuration information in step S202, the high-level user resource access operation guarantee method of the present application further includes the following steps:

[0112] The user levels are identified to include common users, and keywords are extracted from operation logs of current resource access operations of the common users;

[0113] Based on the keywords, determine whether the current memory usage of the current resource access operation of the ordinary user exceeds the warning level;

[0114] If it is judged that the memory usage exceeds the warning limit, a feedback indicating that the memory usage exceeds the warning limit is sent to ordinary users.

[0115] For example, by scanning the operation log of an ordinary user, it is found that there is a need to pre-access business data that occupies a large amount of memory in the operation log. Based on this and certain preset rules, it can be determined that the ordinary user's current resource access operation may or has exceeded the warning level, so that feedback that the memory usage exceeds the warning level can be sent to the user in a timely manner through various means such as email, text message, and phone call, so as to facilitate the ordinary user to adjust the use of memory resources in a timely manner.

[0116] The embodiment of the present application extracts keywords from the operation log of the current resource access operation of the ordinary user, and after judging based on the keywords that the memory usage of the current resource access operation of the ordinary user has or may exceed the preset warning level, timely feedback on the ordinary user's memory usage exceeding the warning level can be sent to the user, which can facilitate the ordinary user to adjust the memory resource usage strategy in time, reduce the impact on the ordinary user due to the actual memory usage limit, and reduce the impact on the entire resource group or even other tasks in the cluster.

[0117] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0118] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0119] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through computer-readable instructions, and the computer-readable instructions can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a non-volatile storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0120] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0121] Further references Figure 4 , as a response to the above Figure 2 The present application provides an embodiment of a high-level user resource access operation guarantee device, and the device embodiment is similar to Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0122] like Figure 4 As shown, the advanced user resource access operation guarantee device 300 of the embodiment of the present application includes: an information query module 301, a configuration acquisition module 302, a level identification module 303, a memory judgment module 304 and a matrix generation module 305. Among them:

[0123] The information acquisition module 301 is used to query the current memory usage of all users who perform the current resource access operation in the cluster;

[0124] The configuration acquisition module 302 is used to acquire preset user resource configuration information; the level identification module 303 is used to identify all user levels that perform the current resource access operation based on the user resource configuration information;

[0125] The memory determination module 304 is used to generate a determination result of whether the current memory is sufficient based on the current memory usage of all users when the user levels are identified to include both ordinary users and advanced users;

[0126] The authority setting module 305 is used to perform corresponding authority setting on the current resource access operation of the common user based on the judgment result, so as to ensure the current resource access operation of the advanced user.

[0127] The embodiment of the present application queries the current memory usage of all users who perform current resource access operations in the cluster; identifies the user levels of all users who perform current resource access operations based on preset user resource configuration information; when the user levels are identified to include ordinary users, a judgment result of whether the current memory is sufficient is generated based on the current memory usage of all users; based on the judgment result, corresponding permission settings are performed on the current resource access operations of ordinary users to ensure that operations such as query requests of high-priority users can obtain sufficient cluster resources, reduce resource preemption, and ensure good response time even during cluster peak periods, so that advanced users can obtain a better service experience, thereby enhancing user satisfaction.

[0128] In some optional implementations of this embodiment, the authority setting module 405 includes:

[0129] An operation blocking submodule is used to block the current resource access operation of excess users among ordinary users if the judgment result is that the current memory is insufficient; the excess users are ordinary users whose current memory usage exceeds a preset proportion of the total memory of all resources in the cluster;

[0130] The blocking sending submodule is used to send blocking prompts to excess users.

[0131] The embodiment of the present application identifies that the user level includes not only ordinary users but also advanced users, and when it is determined that memory resources are insufficient, the current query request and other operations of ordinary users can be blocked, thereby effectively ensuring the current resource access and other operations of advanced users; in addition, by sending a blocking prompt to the user, ordinary users can effectively understand the reason why the current resource access operation is blocked, which is convenient for ordinary users to adjust the operation strategy in time.

[0132] In some optional implementations of this embodiment, the authority setting module 405 further includes:

[0133] The range judgment submodule is used to judge whether the current memory usage of ordinary users exceeds a preset range if the judgment result is that the current memory is sufficient;

[0134] The operation permission submodule is used to allow the current resource access operation of the common user if it is determined that it does not exceed the preset range, and to determine whether the current memory usage of the common user exceeds a preset ratio of the preset range, and if it exceeds the preset ratio, to send a warning prompt to the common user;

[0135] The operation blocking submodule is used to block the current resource access operation of ordinary users if it is judged to exceed a preset range, and send a blocking prompt to the ordinary users.

[0136] The embodiment of the present application determines whether the current memory usage of ordinary users exceeds a preset range (for example, a preset proportion) when memory resources are sufficient. If it does not exceed the preset proportion, the current query of ordinary users is allowed, and a warning prompt is sent to the ordinary users. If it exceeds the preset proportion, the current query of ordinary users is blocked, and a blocking prompt is sent to the ordinary users. A certain amount of memory can be reserved to ensure that it will not affect subsequent operations such as query execution by new trained and advanced users.

[0137] In some optional implementations of this embodiment, the memory determination module 404 includes:

[0138] The condition judgment submodule is used to judge whether the current memory usage of each user who performs the current resource access operation satisfies the preset ratio of the total memory of all resources in the cluster;

[0139] A sufficiency judgment submodule is used to generate a judgment result of current memory sufficiency if the judgment meets the preset ratio less than the total memory of all resources in the cluster;

[0140] The insufficient judgment submodule is used to generate a judgment result that the current memory is insufficient if the judgment does not meet the preset ratio of the total memory of all resources in the cluster.

[0141] The embodiment of the present application determines whether the memory usage of the current resource access operations of all users satisfies the requirement of being less than the total memory of all resources in the cluster. When the memory usage of the current resource access operations of all users satisfies the requirement of being less than the total memory of all resources in the cluster, the current memory is determined to be sufficient. In this way, the memory usage of each user in the cluster is fully considered, thereby obtaining a higher standard judgment result on whether the memory is sufficient, so as to effectively guarantee the current resource access operations of advanced users.

[0142] In some optional implementations of this embodiment, the user resource configuration information includes a user name and a corresponding memory quota; the level identification module 403 includes:

[0143] A quota matching submodule, used for matching a corresponding memory quota in the user resource configuration information based on the user name of the user;

[0144] A normal determination submodule, used for determining that the user is a normal user if the matched memory quota is greater than 0;

[0145] A first determination submodule, configured to determine that if the matched memory quota is equal to 0, the user is regarded as the advanced user;

[0146] The second determining submodule is used to regard the user as the advanced user if the memory quota is not matched.

[0147] The embodiment of the present application matches the corresponding memory quota in the user resource configuration information based on the user's username, identifies whether the user is an ordinary user or an advanced user based on the matched memory quota, and directly links ordinary users and advanced users with memory quotas, thereby effectively ensuring the effective use of memory resources by advanced users.

[0148] In some optional implementations of this embodiment, the device further includes:

[0149] A key extraction module, for including common users in the identified user levels, and extracting keywords from the operation log of the current resource access operation of the common users;

[0150] The warning judgment module is used to judge whether the current memory usage of the current resource access operation of the ordinary user exceeds the warning based on the keyword;

[0151] The feedback sending module is used to send feedback that the memory usage exceeds the warning level to ordinary users if it is judged that the memory usage exceeds the warning level.

[0152] The embodiment of the present application can facilitate ordinary users to adjust their memory resource usage strategies in a timely manner, reduce the impact of memory usage restrictions on ordinary users, and reduce the impact on the entire resource group and even other tasks in the cluster by sending feedback to the user in a timely manner after determining that the memory resources of the ordinary user exceed the warning level.

[0153] To solve the above technical problems, the present application also provides a computer device. Figure 5 , Figure 5 This is a basic structural block diagram of the computer device in this embodiment.

[0154] The computer device 6 includes a memory 61, a processor 62, and a network interface 63 that are interconnected and communicated through a system bus. It should be noted that the figure only shows a computer device 6 having components 61-63, but it should be understood that it is not required to implement all the components shown, and more or fewer components can be implemented instead. Among them, those skilled in the art can understand that the computer device here is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable gate arrays (Field-Programmable Gate Array, FPGA), digital processors (Digital Signal Processor, DSP), embedded devices, etc.

[0155] Computer devices can be computing devices such as desktop computers, notebooks, PDAs, and cloud servers. Computer devices can interact with users through keyboards, mice, remote controls, touch pads, or voice control devices.

[0156] The memory 61 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 61 can be an internal storage unit of the computer device 6, such as a hard disk or memory of the computer device 6. In other embodiments, the memory 61 can also be an external storage device of the computer device 6, such as a plug-in hard disk equipped on the computer device 6, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 61 can also include both the internal storage unit of the computer device 6 and its external storage device. In this embodiment, the memory 61 is generally used to store the operating system and various application software installed on the computer device 6, such as computer-readable instructions of the advanced user resource access operation guarantee method, etc. In addition, the memory 61 can also be used to temporarily store various types of data that have been output or are to be output.

[0157] The processor 62 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips in some embodiments. The processor 62 is generally used to control the overall operation of the computer device 6. In this embodiment, the processor 62 is used to run computer-readable instructions stored in the memory 61 or process data, such as computer-readable instructions for running a high-level user resource access operation guarantee method.

[0158] The network interface 63 may include a wireless network interface or a wired network interface, and the network interface 63 is generally used to establish a communication connection between the computer device 6 and other electronic devices.

[0159] The embodiment of the present application queries the current memory usage of all users who perform current resource access operations in the cluster; based on preset user resource configuration information, identifies the user levels of all users who perform current resource access operations; when it is identified that the user levels include ordinary users, generates a judgment result on whether the current memory is sufficient based on the current memory usage of all users; based on the judgment result, performs corresponding permission settings on the current resource access operations of ordinary users to ensure that operations such as query requests of high-priority users can obtain sufficient cluster resources, reduce resource preemption, and ensure good response time even during cluster peak periods, so that advanced users can obtain a better service experience, thereby enhancing user satisfaction.

[0160] The present application also provides another implementation, namely, providing a computer-readable storage medium, which stores computer-readable instructions. The computer-readable instructions can be executed by at least one processor to enable at least one processor to perform the steps of the advanced user resource access operation assurance method as described above.

[0161] The embodiment of the present application queries the current memory usage of all users who perform current resource access operations in the cluster; based on preset user resource configuration information, identifies the user levels of all users who perform current resource access operations; when it is identified that the user levels include ordinary users, generates a judgment result on whether the current memory is sufficient based on the current memory usage of all users; based on the judgment result, performs corresponding permission settings on the current resource access operations of ordinary users to ensure that operations such as query requests of high-priority users can obtain sufficient cluster resources, reduce resource preemption, and ensure good response time even during cluster peak periods, so that advanced users can obtain a better service experience, thereby enhancing user satisfaction.

[0162] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0163] The non-Company software tools or components appearing in the embodiments of this application are merely examples and do not represent actual use.

[0164] Obviously, the embodiments described above are only some embodiments of the present application, rather than all embodiments. The preferred embodiments of the present application are given in the accompanying drawings, but they do not limit the patent scope of the present application. The present application can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present application more thorough and comprehensive. Although the present application is described in detail with reference to the aforementioned embodiments, for those skilled in the art, it is still possible to modify the technical solutions recorded in the aforementioned specific implementation methods, or to perform equivalent replacement of some of the technical features therein. Any equivalent structure made using the contents of the specification and drawings of this application, directly or indirectly used in other related technical fields, is similarly within the scope of patent protection of this application.

Claims

1. A method for ensuring high-level user resource access operations, characterized in that: The method comprises the following steps: Query the current memory usage of all users who perform the current resource access operation in the cluster; Get preset user resource configuration information; Based on the user resource configuration information, identifying the user levels of all the users who perform the current resource access operation; When it is identified that the user levels include both common users and advanced users, a determination result of whether the current memory is sufficient is generated based on the current memory usage of all the users; Based on the judgment result, corresponding permission setting is performed on the current resource access operation of the ordinary user to ensure the current resource access operation of the advanced user.

2. The method for ensuring access to resources by high-level users according to claim 1, characterized in that: The performing of corresponding permission setting for the current resource access operation of the common user based on the judgment result comprises the following steps: If the judgment result is that the current memory is insufficient, the current resource access operation of excess users among the ordinary users is blocked; the excess users are ordinary users whose current memory usage exceeds a preset proportion of the total memory of all resources in the cluster; A blocking prompt is sent to the excess user.

3. The method for ensuring access to resources by high-level users according to claim 2, characterized in that: When it is identified that the user level also includes the advanced user, the performing of corresponding permission setting for the current resource access operation of the ordinary user based on the determination result further includes the following steps: If the judgment result is that the current memory is sufficient, judging whether the current memory usage of the ordinary user exceeds a preset range; If it is determined that the current resource usage does not exceed the preset range, the current resource access operation of the common user is allowed, and it is determined whether the current memory usage of the common user exceeds a preset ratio of the preset range. If the current memory usage exceeds the preset ratio, a warning prompt is sent to the common user. If it is determined that the resource access exceeds the preset range, the current resource access operation of the ordinary user is blocked, and a blocking prompt is sent to the ordinary user.

4. The method for ensuring access to resources by high-level users according to any one of claims 1 to 3, characterized in that: The generating of a judgment result of whether the current memory is sufficient based on the current memory usage of all the users comprises the following steps: Determine whether the current memory usage of each of the users who performs the current resource access operation satisfies a preset ratio less than the total memory of all resources in the cluster; If it is determined that the preset ratio is less than the total memory of all resources in the cluster, a determination result that the current memory is sufficient is generated; If it is determined that the preset proportion less than the total memory of all resources in the cluster is not satisfied, a determination result that the current memory is insufficient is generated.

5. The method for ensuring access to resources by high-level users according to any one of claims 1 to 3, characterized in that: The user resource configuration information includes a user name and a corresponding memory quota; and the identifying the user levels of all the users who perform the current resource access operation based on the user resource configuration information includes the following steps: Matching a corresponding memory quota in the user resource configuration information based on the user name of the user; If the matched memory quota is greater than 0, the user is regarded as a common user; If the matched memory quota is equal to 0, the user is regarded as the advanced user; If the memory quota is not matched, the user is regarded as the advanced user.

6. The method for ensuring access to resources by high-level users according to any one of claims 1 to 3, characterized in that: After identifying the user levels of all the users who perform the current resource access operation based on the user resource configuration information, the method further includes the following steps: Upon identifying that the user levels include common users, extracting keywords from the operation log of the current resource access operation of the common users; Based on the keyword, determining whether the current memory usage of the current resource access operation of the ordinary user exceeds a warning level; If it is determined that the memory usage exceeds the warning level, a feedback indicating that the memory usage exceeds the warning level is sent to the ordinary user.

7. A high-level user resource access operation guarantee device, characterized in that: include: An information acquisition module, used to query the current memory usage of all users who perform the current resource access operation in the cluster; Configuration acquisition module, used to obtain preset user resource configuration information; A level identification module, used to identify the user levels of all the users who perform the current resource access operation based on the user resource configuration information; A memory judgment module, configured to, upon recognizing that the user level includes the common user, generate a judgment result on whether the current memory is sufficient based on the current memory usage of all the users; The authority setting module is used to perform corresponding authority setting on the current resource access operation of the ordinary user based on the judgment result to ensure the current resource access operation of the advanced user.

8. The high-level user resource access operation guarantee device according to claim 7, characterized in that: When it is identified that the user level also includes the senior user, the authority setting module includes: An operation blocking submodule, configured to block the current resource access operation of the ordinary user if the judgment result is that the current memory is insufficient; The blocking sending submodule is used to send a blocking prompt to the ordinary user.

9. A computer device, characterized in that: The method comprises a memory and a processor, wherein the memory stores computer-readable instructions, and the processor implements the steps of the advanced user resource access operation guarantee method as claimed in any one of claims 1 to 6 when executing the computer-readable instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the steps of the advanced user resource access operation guarantee method according to any one of claims 1 to 6 are implemented.

Images