Big data platform application permission and resource management device, method and equipment
A big data platform and application authority technology, applied in the field of big data platforms, can solve the problems of lack of unified management and control view, waste of resources, lack of control of resources and actual resources used, etc., to achieve multiple types of resources, strong service compatibility, and universal strong effect
Pending Publication Date: 2022-03-15
CHINA CONSTRUCTION BANK
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
When multiple open source products are used at the same time, the Yarn-based big data resource management architecture cannot achieve global optimization of operating priorities
[0004] Thirdly, there is a lack of a unified management and control view for the resources applied by tenants and the actual use of applications. There is a lack of control over the resources applied for by applications and the resources actually used. Some jobs are allocated resources that exceed their needs, resulting in waste of resources. Actual usage monitoring mechanism
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0033] The specific implementation manners of the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation manners described here are only used to illustrate and explain the embodiments of the present invention, and are not intended to limit the embodiments of the present invention.
[0034] The acquisition, storage, use, and processing of data in the technical solution of this application all comply with the relevant provisions of national laws and regulations.
[0035] figure 1 It schematically shows a structural block diagram of an apparatus for managing application rights and resources of a big data platform according to an embodiment of the present application. Such as figure 1 As shown, in this embodiment, a device for managing application rights and resources of a big data platform is provided, including:
[0036] The application project management mo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the technical field of big data platforms, and provides a management device, method and equipment for application permission and resources of a big data platform. The big data platform application permission and resource management device comprises an application project management module which is configured to determine that a project space is basic granularity of project management in a big data platform; and allocating a project space and an application space for the big data service based on the basic granularity, and managing the project space and the application space, the application space is a set of one or more project spaces; an application resource management module; and the application permission management module is configured to store task permission information and developer permission information in the project space. According to the embodiment of the invention, the resource allocation efficiency and utilization efficiency of the big data platform can be improved.
Description
technical field [0001] The present invention relates to the technical field of big data platforms, in particular to a device for managing application rights and resources of a big data platform, a method for managing application rights and resources of a big data platform, and a device for managing application rights and resources of a big data platform and corresponding storage media. Background technique [0002] The computing resource management methods of applications in the prior art are not refined enough. Currently, resources are managed by means of multiple applications corresponding to a resource pool in the resource queue mode. When users in the same queue have resource competition, it is impossible to individually set the maximum usage of the user. Resource size, so resource allocation cannot be flexibly controlled. [0003] Secondly, the same application will use different Hadoop services (such as Spark and Flink). If the resources occupied by different services...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F9/50G06F9/48G06F16/958
CPCG06F9/5005G06F9/5027G06F9/5016G06F9/5038G06F9/4881G06F16/958
Inventor 张晨林林华兵王幼芝
Owner CHINA CONSTRUCTION BANK