Data processing method and device, electronic equipment and storage medium
By determining the deployment method of server cluster based on the differences in physical resource requirements of information technology services and communication technology services, and using virtualization technology to deploy resources, the resource conflicts caused by different services in the same resource pool are solved, and efficient resource utilization is achieved and business performance improvement.
Patent Information
- Application Number
- CN202411986424.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-31
- Publication Date
- 2025-02-07
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
When deploying information technology services and communication technology services in the same resource pool, resource conflicts and performance degradation are likely to occur, mainly due to the significant differences in performance requirements, resource occupation and security isolation of the two types of services.
By obtaining the differences in physical resource requirements of information technology services and communication technology services, we determine the deployment method of server clusters, including different clusters and non-sharing servers, the same cluster but non-sharing servers, and the same cluster and common servers. Then, virtualization technology is used to convert physical resources into virtual resources, and business deployment is carried out in the virtual resources according to the deployment method.
By determining the deployment method of server clusters based on the differences in business resource requirements and combining virtualization technology, we ensure that different businesses receive sufficient resource support, and solving the resource conflicts caused by the deployment of different businesses in the same resource pool.
Smart Images

Figure CN119402442A_ABST
Abstract
Description
Background Art
[0002] With the continuous development of cloud computing technology, large-scale intensive management of network resource pools has become an important trend in current network construction. In this context, the unified bearing of information technology (IT) and communication technology (CT) services has become an important exploration direction.
[0003] In the related technologies, although there are some solutions for the production implementation of the existing network, they only focus on the management and optimization of the resource pool itself, such as resource allocation, scheduling and monitoring, etc., and do not analyze how to effectively carry and manage information technology services and communication technology services with different characteristics and requirements in the same resource pool. Since information technology services and communication technology services have significant differences in performance requirements, resource occupation, security isolation, etc., if they are directly mixed and deployed in the same resource pool (in a co-carrying environment), it is easy to cause resource conflicts and performance degradation.
[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0005] The present disclosure provides a data processing method, device, electronic device and storage medium, which at least to a certain extent overcome the problem of resource conflict caused by different services being deployed in the same resource pool in the related art.
[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.
[0007] According to one aspect of the present disclosure, a data processing method is provided, including: obtaining the physical resource requirements of an information technology business and the physical resource requirements of a communication technology business; determining a deployment method of a server cluster based on the difference in physical resource requirements between the information technology business and the communication technology business, wherein the deployment method of the server cluster includes different clusters that do not share servers, the same cluster but does not share servers, and the same cluster that shares servers; converting physical resources into virtual resources through virtualization technology, and deploying the information technology business and the communication technology business on the virtual resources according to the deployment method of the server cluster.
[0008] In some embodiments, the method of determining the deployment of the server cluster based on the difference in physical resource requirements between the information technology business and the communication technology business includes: when the difference in resource requirements between the information technology business and the communication technology business is greater than a first threshold, the information technology business and the communication technology business are deployed in different clusters and do not share servers; when the difference in resource requirements between the information technology business and the communication technology business is less than the first threshold and greater than a second threshold, the information technology business and the communication technology business are deployed in the same cluster but do not share servers, wherein the first threshold is greater than the second threshold; when the difference in resource requirements between the information technology business and the communication technology business is less than the second threshold, the information technology business and the communication technology business are deployed in the same cluster and share servers.
[0009] In some embodiments, the method also includes: when the information technology business and the communication technology business are deployed in different clusters and do not share servers, determining that the network isolation method is physical isolation; when the information technology business and the communication technology business are deployed in the same cluster but do not share servers, or the information technology business and the communication technology business are deployed in the same cluster and share servers, determining that the network isolation method is intranet isolation.
[0010] In some embodiments, the method also includes: business resources involving CPU binding and business resources not involving CPU binding are deployed in different clusters, wherein the services include the information technology services and the communication technology services; when a server in the cluster involving CPU binding needs to carry a service without a clear CPU binding requirement, the service that needs to carry the service without a clear CPU binding requirement is CPU bound and exclusive.
[0011] In some embodiments, the method also includes: identifying the information technology business or the communication technology business that requires large pages or huge pages of memory; deploying the information technology business or the communication technology business that requires large pages or huge pages of memory on a storage server that independently carries large pages or huge pages of memory.
[0012] In some embodiments, the method further comprises: dividing the reserved resources of the communication technology service demand into one or more standby clusters.
[0013] According to another aspect of the present disclosure, a data processing device is also provided, including: a physical resource demand acquisition module, used to obtain the physical resource demand of information technology business and the physical resource demand of communication technology business; a server cluster deployment module, used to determine the deployment mode of the server cluster according to the difference in physical resource demand between the information technology business and the communication technology business, wherein the deployment mode of the server cluster includes different clusters without sharing servers, the same cluster without sharing servers, and the same cluster with sharing servers; a virtualization module, used to convert physical resources into virtual resources through virtualization technology, and deploy the information technology business and the communication technology business in the virtual resources according to the deployment mode of the server cluster.
[0014] According to another aspect of the present disclosure, an electronic device is also provided, which includes: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute any one of the above-mentioned data processing methods by executing the executable instructions.
[0015] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the data processing method described in any one of the above is implemented.
[0016] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, any one of the above-mentioned data processing methods is implemented.
[0017] The data processing method provided in the embodiments of the present disclosure obtains the physical resource requirements of the information technology business and the physical resource requirements of the communication technology business; determines the deployment mode of the server cluster according to the difference in the physical resource requirements of the information technology business and the communication technology business, wherein the deployment mode of the server cluster includes different clusters without sharing servers, the same cluster but not sharing servers, and the same cluster with sharing servers; converts physical resources into virtual resources through virtualization technology, and deploys the information technology business and the communication technology business in the virtual resources according to the deployment mode of the server cluster. The present disclosure determines different deployment modes of the server cluster according to the difference in the physical resource requirements of the information technology business and the communication technology business and combines virtualization technology to ensure that different businesses can obtain sufficient resource support, thereby solving the problem of resource conflicts caused by different businesses being deployed in the same resource pool.
[0018] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0020] Figure 1 A schematic diagram showing a data processing system structure in an embodiment of the present disclosure; Figure 2 A flow chart of a data processing method in an embodiment of the present disclosure is shown; Figure 3 A flowchart showing a specific example of a data processing method in an embodiment of the present disclosure; Figure 4 A flowchart showing another specific example of a data processing method in an embodiment of the present disclosure; Figure 5 A flowchart showing another specific example of a data processing method in an embodiment of the present disclosure; Figure 6 A flowchart showing another specific example of a data processing method in an embodiment of the present disclosure; Figure 7 A schematic diagram of a data processing device in an embodiment of the present disclosure is shown; Figure 8 A structural block diagram of a computer device in an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0021] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0022] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0023] For ease of understanding, before introducing the embodiments of the present disclosure, several terms involved in the embodiments of the present disclosure are first explained as follows: PaaS: Platform as a Service; CPU: Central Processing Unit.
[0024] The specific implementation of the embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.
[0025] Figure 1 FIG. 1 shows an exemplary application system architecture diagram to which the data processing method in the embodiment of the present disclosure can be applied. Figure 1 As shown, the system architecture may include IT 101 , CT 102 , a unified cloud-side management platform 103 and a server cluster 104 .
[0026] The exemplary application system architecture of the data processing method disclosed in the present invention adopts a shared hosting overall solution architecture, that is, an architecture in which IT / CT services share a resource pool and a shared cloud management. All servers, clusters and other physical resources are uniformly managed, scheduled and deployed using the same management platform. Virtual resources such as virtual machines and containers are obtained by virtualizing physical resources. Services are deployed on virtual machines or containers for business hosting, and related PaaS components are called according to the needs of the business itself. The unified cloud management platform can directly connect to physical resources to create virtual machines and perform resource management, and can pull up, deploy and shut down components through the platform. The business-side deployment plan can also be connected through the cloud management platform. Under the shared hosting architecture, physical resources and virtual resources are uniformly deployed and managed through a unified cloud-side management platform. The functional modules involved include determining the server cluster deployment method, server cluster division and management, resource scheduling and optimization, PaaS component creation and management, and determining the business-side deployment isolation method.
[0027] Server deployment method selection: Based on the different resource requirements of IT / CT services, deployment methods can be divided into the following three categories: IT services and CT services are deployed in different clusters and do not share servers; IT services and CT services are deployed in the same server cluster and do not share servers; IT services and CT services are deployed in the same server cluster and share servers. Different deployment methods correspond to different cluster division results, which will also affect the selection of isolation solutions for co-hosting. The classification standard can be whether the business has consistency in specific requirements for a certain resource. Services with consistent requirements are hosted on the same server and form the same server cluster. The division of clusters can refer to the cluster division principles.
[0028] Cluster division principle: Resource requirements within a cluster should not be mutually exclusive. You can collect business requirements for physical resources including computing, networking, and storage, estimate the number of resources required to carry core business, and add up the number of servers with the same requirements for IT and CT services to form the same cluster.
[0029] The following specific resource requirements include: CPU binding: Among them, business resources involving CPU binding should not be deployed in the same cluster as business resources not involving CPU binding; when the server in the cluster involving CPU binding needs to carry a business without clear CPU binding requirements, the business should be bound to the CPU and exclusively occupied to avoid degradation of business performance; the business demand resources can be analyzed, and separate resource calculations can be performed for some businesses that are strongly dependent on CPU binding, and the above two principles can be used when carrying these businesses on cluster servers. Large or huge pages of memory: Businesses that require large or huge pages of memory should be carried separately on storage servers, and not deployed on the same server as other businesses. When the PaaS layer applies for new large or huge pages of memory resources, the cloud management side needs to coordinate and locate them to the storage server that carries large or huge pages of memory separately, and new resource allocation should not be performed on storage servers that do not have large or huge pages of memory.
[0030] Selection of isolation solutions under shared load: Physical isolation can provide more advanced security isolation properties, corresponding to deployment methods of different clusters and non-shared servers; when the other two deployment methods are used, logical isolation or external firewalls are required for intranet isolation, that is, different server deployment methods will correspond to different isolation solutions. Since IT and CT services usually have different network architecture requirements, CT services usually require underlying physical network networking capabilities, and network architecture affects isolation methods, such as virtual networks and the choice of underlying physical networks will in turn affect the choice of server deployment methods.
[0031] Resource scheduling optimization on the cloud management side: Unified cloud management under shared load needs to consider the differences in business requirements, which lead to the solidification of resource occupation and low resource utilization. When dividing clusters, the reserved resources for CT business requirements can be divided into backup clusters for unified allocation and management to supplement the needs of different clusters. In the deployment mode of not sharing servers and clusters, the cloud management can monitor the resource utilization of different clusters in real time and adjust the resource allocation between clusters according to the situation.
[0032] Those skilled in the art will know that Figure 1 The number of server clusters, Pass components, and virtual machines in the example is only illustrative, and any number of server clusters, Pass components, and virtual machines may be provided according to actual needs. The embodiments of the present disclosure are not limited thereto.
[0033] Figure 2A flow chart of a data processing method in an embodiment of the present disclosure is shown as follows: Figure 2 As shown, the data processing method provided in the embodiment of the present disclosure includes the following steps: S202, obtaining the physical resource requirements of the information technology business and the physical resource requirements of the communication technology business.
[0034] It should be noted that the above-mentioned information technology business can be Internet technology, and also includes computer hardware and software, network technology, etc. The above-mentioned communication technology business can be telecommunication technology, and also includes communication methods such as telephone, fax, and television, as well as technologies such as mobile communications, satellite communications, and the Internet. The main difference between communication technology business and information technology business lies in their different application fields and technical focuses. Communication technology business mainly focuses on the research and development and application of communication technology, including communication methods such as telephone, fax, and television, as well as technologies such as mobile communications, satellite communications, and the Internet. Information technology business focuses more on the research and development and application of computer technology and Internet technology, including computer hardware and software, network technology, etc. The above-mentioned physical resource requirements can be tangible physical resources, such as computing resources, network resources, and storage resources. Computing resources can be hardware devices used to perform computing tasks, such as servers, computer terminals, etc. These devices process and analyze data through built-in processors (such as CPUs), memory, input and output devices, and other components. Network resources are the bridges that connect various computing devices and storage devices. They can include network devices such as routers, switches, firewalls, and communication lines (such as wired cables and optical fibers). Their main function is to transmit data and ensure that data can be efficiently and quickly transmitted between different computing devices and storage devices. In addition, network resources are also responsible for achieving the reliability and security of network communications and preventing data from being stolen or tampered with during transmission. Storage resources are physical devices used to store data.
[0035] S204, determining the deployment mode of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business, wherein the deployment modes of the server cluster include different clusters without sharing servers, the same cluster without sharing servers, and the same cluster with sharing servers.
[0036] It should be noted that the above-mentioned server cluster can be a plurality of physical servers connected together to form an overall computing resource pool. The above-mentioned different clusters and non-shared servers mean that different businesses (such as information technology business and communication technology business) are deployed on different server clusters respectively, and these clusters do not share servers. This method can ensure the physical isolation between different businesses, reduce resource competition and potential security risks, and is suitable for scenarios with large differences in physical resource requirements and strong independence between businesses. The same cluster but non-shared servers means that multiple businesses are deployed in the same server cluster, but they do not share servers. Each business has its own server node, which works together in the cluster, and can achieve resource sharing and collaboration to a certain extent, while maintaining relative independence between businesses. It is suitable for scenarios with similar physical resource requirements, certain correlation between businesses, but still strong independence from each other. The same cluster and shared servers means that multiple businesses are deployed in the same server cluster and share server nodes, which can maximize the use of physical resources, improve resource utilization and cost-effectiveness, and are suitable for scenarios with similar physical resource requirements, strong correlation between businesses, and good control over resource competition and security risks.
[0037] S206, converting physical resources into virtual resources through virtualization technology, and deploying information technology services and communication technology services on virtual resources according to the deployment method of the server cluster.
[0038] It should be noted that the above-mentioned virtualization technology can be a technology that divides the physical entity of a computer (such as a server, storage device, network device, etc.) into multiple virtual entities through software technology. The above-mentioned virtual resources can be logical resources processed by virtualization technology. Among them, virtualization technology abstracts physical resources (such as CPU, memory, storage, network, etc.) into virtual resources, which can be independently run and operated in different virtual machines or containers. For example, a server cluster forms an overall computing resource pool. In this resource pool, virtualization software can create multiple virtual machines, each of which can be regarded as an independent computing unit. The management and optimization of virtual resources are achieved through the management tools of virtualization software. Through the management tools, the performance and resource usage of virtual machines can be monitored, and dynamic resource allocation and adjustment can be performed as needed.
[0039] The present disclosure determines different deployment modes of server clusters according to the differences in physical resource requirements between information technology services and communication technology services and combines virtualization technology to ensure that different services can obtain sufficient resource support and solve the problem of resource conflicts caused by deploying different services in the same resource pool.
[0040] In one embodiment of the present disclosure, Figure 3As shown, the data processing method provided in the embodiment of the present disclosure determines the deployment mode of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business, and specifically includes the following steps: S302, when the difference in resource requirements between the information technology service and the communication technology service is greater than a first threshold, deploying the information technology service and the communication technology service in different clusters without sharing servers; S304, when the difference in resource requirements between the information technology service and the communication technology service is less than a first threshold and greater than a second threshold, deploying the information technology service and the communication technology service in the same cluster but not sharing a server, wherein the first threshold is greater than the second threshold; S306: When the difference in resource requirements between the information technology service and the communication technology service is less than a second threshold, the information technology service and the communication technology service are deployed in the same cluster and use a common server.
[0041] In a specific example, the difference in resource requirements between information technology services and communication technology services is quantified. For example, direct quantitative comparison of resource usage is performed to calculate the respective resource usage, and the usage of CPU, memory, disk space, network bandwidth and other resources of IT services and CT services is calculated respectively. Another example is quantitative comparison based on service characteristics, which is achieved by determining service characteristic indicators. According to the characteristics of IT services and CT services, a series of indicators that can reflect their resource requirements are determined. For example, for IT services, indicators such as data processing volume, storage requirements, and computational complexity can be considered; for CT services, indicators such as communication rate, bandwidth requirements, and transmission delay can be considered. Each service characteristic indicator is quantified to calculate the characteristic difference value. It is also possible to consider the change of resource requirements over time, perform time series analysis on the resource usage of IT services and CT services, and dynamically adjust the threshold according to the results of the time series analysis to ensure the flexibility and adaptability of resource allocation.
[0042] In one embodiment of the present disclosure, Figure 4 As shown, the data processing method provided in the embodiment of the present disclosure also includes the following steps: S402: When the information technology business and the communication technology business are deployed in different clusters and do not share a server, the network isolation method is determined to be physical isolation; S404: When the information technology business and the communication technology business are deployed in the same cluster but do not share a server, or the information technology business and the communication technology business are deployed in the same cluster and share a server, the network isolation method is determined to be intranet isolation.
[0043] For example, the business side deployment isolation method is determined. Physical isolation can provide more advanced security isolation properties and is applied to deployment methods that are different in clusters and do not share servers. When the other two deployment methods are used, logical isolation or external firewalls are required for intranet isolation, that is, different server deployment methods will correspond to different isolation solutions. Since IT business and CT business usually have different network architecture requirements, CT business usually requires the networking capabilities of the underlying physical network, and the network architecture affects the isolation method, such as the virtual network (built on the underlying physical network) and the choice of the underlying physical network will in turn affect the choice of server deployment method.
[0044] In one embodiment of the present disclosure, Figure 5 As shown, the data processing method provided in the embodiment of the present disclosure also includes the following steps: S502, deploying service resources involving CPU binding cores and service resources not involving CPU binding cores in different clusters, where the services include information technology services and communication technology services; S504: When a server in the cluster involved in CPU core binding needs to carry a service without explicit CPU core binding requirement, CPU core binding is performed exclusively on the service that needs to be carried without explicit CPU core binding requirement.
[0045] It should be noted that the above-mentioned CPU core binding is a technology that binds a specific thread or process to a specific core of the CPU for execution, which can reduce the frequent switching of threads between different cores, improve the CPU cache hit rate, and thus improve the efficiency of program execution. For businesses involving CPU core binding, separate planning and deployment of clusters are performed to ensure that they can monopolize specific CPU resources and avoid resource competition with other businesses. For businesses that do not have clear CPU core binding requirements, performance analysis and resource evaluation are performed, and then appropriate CPU cores are selected for binding based on the evaluation results, which can ensure that the business can obtain stable CPU resources during operation and avoid performance degradation due to resource competition.
[0046] In a specific example, the first criterion is that business resources involving CPU binding should not be deployed in the same cluster as business resources not involving CPU binding. The second criterion is that when a server in a cluster involving CPU binding needs to carry a business without a clear CPU binding requirement, the business should be bound to the CPU and exclusively occupied to avoid degradation of business performance. The business demand resources can be analyzed, and separate resource calculations can be performed for some businesses that are strongly dependent on CPU binding, and these businesses can be carried on cluster servers, using the above two criteria.
[0047] In one embodiment of the present disclosure, Figure 6 As shown, the data processing method provided in the embodiment of the present disclosure also includes the following steps: S602, identifying information technology services or communications technology services that require large pages or huge pages of memory; S604, deploying information technology services or communication technology services that require large pages or huge page memories on a storage server that independently carries large pages or huge page memories.
[0048] For example, services that require large pages or huge page memory are hosted separately on storage servers and are not deployed on the same server as other services. When the PaaS layer applies for new large pages or huge page memory resources, the cloud management side needs to coordinate and locate the storage server that hosts the large pages or huge page memory separately. New resource allocation should not be performed on storage servers that do not have large pages or huge page memory.
[0049] The present disclosure can allocate resources more accurately and avoid resource waste by accurately identifying which businesses require large pages or huge pages of memory. At the same time, by identifying and distinguishing businesses that require large pages or huge pages of memory, it helps to achieve isolation between businesses, reduce mutual interference, ensure that different businesses run stably in their respective resource pools, and improve the reliability and stability of the system.
[0050] In an example of the present disclosure, the above data processing method further includes: dividing the reserved resources of the communication technology service demand into one or more standby clusters.
[0051] For example, unified cloud management under shared hosting needs to consider the differences in business requirements that lead to fixed resource usage and low resource utilization. When dividing clusters, the reserved resources for CT business requirements can be divided into backup clusters for unified allocation and management to supplement the needs of different clusters. In the deployment mode of not sharing servers and clusters, the cloud management can monitor the resource utilization of different clusters in real time and adjust the resource allocation between clusters according to the situation.
[0052] Based on the same inventive concept, the present disclosure also provides a data processing device in the following embodiments. Since the principle of solving the problem in the device embodiment is similar to that in the above method embodiment, the implementation of the device embodiment can refer to the implementation of the above method embodiment, and the repeated parts will not be repeated.
[0053] Figure 7 A schematic diagram of a data processing device in an embodiment of the present disclosure is shown. Figure 7 As shown, the device includes: a physical resource demand acquisition module 71, a server cluster deployment module 72, and a virtualization module 73.
[0054] The physical resource requirement acquisition module 71 is used to acquire the physical resource requirements of information technology services and the physical resource requirements of communication technology services.
[0055] The server cluster deployment module 72 is used to determine the deployment method of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business, wherein the deployment methods of the server cluster include different clusters without sharing servers, the same cluster but without sharing servers, and the same cluster with sharing servers.
[0056] The virtualization module 73 is used to transform physical resources into virtual resources through virtualization technology, and deploy information technology services and communication technology services on virtual resources according to the deployment method of the server cluster.
[0057] In one example of the present disclosure, the server cluster deployment module 72 is specifically used to, when the difference in resource requirements between the information technology business and the communication technology business is greater than a first threshold, deploy the information technology business and the communication technology business in different clusters and do not share servers; when the difference in resource requirements between the information technology business and the communication technology business is less than the first threshold and greater than the second threshold, deploy the information technology business and the communication technology business in the same cluster but do not share servers, wherein the first threshold is greater than the second threshold; when the difference in resource requirements between the information technology business and the communication technology business is less than the second threshold, deploy the information technology business and the communication technology business in the same cluster and share servers.
[0058] In one example of the present disclosure, the above-mentioned data processing device also includes an isolation module, which is used to determine that the network isolation method is physical isolation when the information technology business and the communication technology business are deployed in different clusters and do not share servers; when the information technology business and the communication technology business are deployed in the same cluster but do not share servers, or the information technology business and the communication technology business are deployed in the same cluster and share servers, determine that the network isolation method is intranet isolation.
[0059] In one example of the present disclosure, the above-mentioned data processing device also includes a core binding module, which is used to deploy business resources involving CPU core binding and business resources not involving CPU core binding in different clusters, wherein the services include information technology services and communication technology services; when a server in a cluster involving CPU core binding needs to carry a service without a clear CPU core binding requirement, the service that needs to carry the service without a clear CPU core binding requirement is CPU bound and exclusive.
[0060] In one example of the present disclosure, the above-mentioned data processing device also includes a large page identification module for identifying information technology services or communication technology services that require large pages or huge page memory; and deploying information technology services or communication technology services that require large pages or huge page memory on a storage server that independently carries large pages or huge page memory.
[0061] In an example of the present disclosure, the above-mentioned data processing device also includes a spare cluster division module, which is used to divide the reserved resources of the communication technology service demand into one or more spare clusters.
[0062] It should be noted that the above-mentioned physical resource demand acquisition module 71, server cluster deployment module 72, and virtualization module 73 correspond to S202 to S206 in the method embodiment, and the examples and application scenarios implemented by the above-mentioned modules and corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned method embodiment. It should be noted that the above-mentioned modules as part of the device can be executed in a computer system such as a set of computer executable instructions.
[0063] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0064] Refer to the following Figure 8 The electronic device 800 according to this embodiment of the present disclosure is described. Figure 8 The electronic device 800 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0065] like Figure 8 As shown, the electronic device 800 is in the form of a general computing device. The components of the electronic device 800 may include but are not limited to: at least one processing unit 810, at least one storage unit 820, and a bus 830 connecting different system components (including the storage unit 820 and the processing unit 810).
[0066] The storage unit stores program codes, which can be executed by the processing unit 810, so that the processing unit 810 executes the steps described in the above “exemplary method” section of this specification according to various exemplary embodiments of the present disclosure.
[0067] For example, the processing unit 810 can execute the following steps of the above method embodiment: obtain the physical resource requirements of the information technology business and the physical resource requirements of the communication technology business; determine the deployment method of the server cluster based on the difference in the physical resource requirements of the information technology business and the communication technology business, wherein the deployment method of the server cluster includes different clusters that do not share servers, the same cluster but do not share servers, and the same cluster and share servers; convert physical resources into virtual resources through virtualization technology, and deploy the information technology business and the communication technology business on the virtual resources according to the deployment method of the server cluster.
[0068] For example, the processing unit 810 can execute the following steps of the above method embodiment: when the difference in resource requirements between the information technology business and the communication technology business is greater than a first threshold, the information technology business and the communication technology business are deployed in different clusters and do not share servers; when the difference in resource requirements between the information technology business and the communication technology business is less than the first threshold and greater than the second threshold, the information technology business and the communication technology business are deployed in the same cluster but do not share servers, wherein the first threshold is greater than the second threshold; when the difference in resource requirements between the information technology business and the communication technology business is less than the second threshold, the information technology business and the communication technology business are deployed in the same cluster and share servers.
[0069] For example, the processing unit 810 can execute the following steps of the above method embodiment: when the information technology business and the communication technology business are deployed in different clusters and do not share servers, the network isolation method is determined to be physical isolation; when the information technology business and the communication technology business are deployed in the same cluster but do not share servers, or the information technology business and the communication technology business are deployed in the same cluster and share servers, the network isolation method is determined to be intranet isolation.
[0070] For example, the processing unit 810 can execute the following steps of the above method embodiment: business resources involving CPU binding and business resources not involving CPU binding are deployed in different clusters, where the services include information technology services and communication technology services; when a server in the cluster involving CPU binding needs to carry a service without a clear CPU binding requirement, the service that needs to carry the service without a clear CPU binding requirement is bound to the CPU and is exclusive.
[0071] For example, the processing unit 810 can execute the following steps of the above method embodiment: identifying information technology services or communication technology services that require large pages or huge page memory; deploying information technology services or communication technology services that require large pages or huge page memory on a storage server that independently carries large pages or huge page memory.
[0072] For example, the processing unit 810 may execute the following steps of the above method embodiment: dividing the reserved resources of the communication technology service demand into one or more standby clusters.
[0073] The storage unit 820 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 8201 and / or a cache storage unit 8202 , and may further include a read-only storage unit (ROM) 8203 .
[0074] The storage unit 820 may also include a program / utility 8204 having a set (at least one) of program modules 8205, such program modules 8205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0075] Bus 830 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0076] The electronic device 800 may also communicate with one or more external devices 840 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 800, and / or communicate with any device that enables the electronic device 800 to communicate with one or more other computing devices (e.g., routers, modems, etc.). This communication may be performed through an input / output (I / O) interface 850. In addition, the electronic device 800 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 860. As shown, the network adapter 860 communicates with other modules of the electronic device 800 through a bus 830. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 800, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.
[0077] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.
[0078] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer program product, which includes: a computer program, which implements the above data processing method when executed by a processor.
[0079] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, which may be a readable signal medium or a readable storage medium. A program product capable of implementing the above method of the present disclosure is stored thereon. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above “Exemplary Method” section of this specification.
[0080] More specific examples of computer-readable storage media in the present disclosure may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0081] In the present disclosure, a computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A readable signal medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0082] Alternatively, the program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0083] In specific implementation, the program code for performing the operation of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).
[0084] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.
[0085] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.
[0086] Through the description of the above implementation modes, it is easy for those skilled in the art to understand that the example implementation modes described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation mode of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation mode of the present disclosure.
[0087] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.
Claims
1. A data processing method, characterized in that: include: Obtain the physical resource requirements of information technology services and the physical resource requirements of communications technology services; Determine the deployment mode of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business, wherein the deployment mode of the server cluster includes different clusters without sharing servers, the same cluster but without sharing servers, and the same cluster with sharing servers; The physical resources are converted into virtual resources through virtualization technology, and the information technology business and the communication technology business are deployed on the virtual resources according to the deployment method of the server cluster.
2. The data processing method according to claim 1, characterized in that: Determining the deployment mode of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business includes: When the difference in resource requirements between the information technology service and the communication technology service is greater than a first threshold, deploying the information technology service and the communication technology service in different clusters without sharing a server; When the difference in resource requirements between the information technology service and the communication technology service is less than the first threshold and greater than a second threshold, deploying the information technology service and the communication technology service in the same cluster but not sharing a server, wherein the first threshold is greater than the second threshold; When the difference in resource requirements between the information technology service and the communication technology service is less than the second threshold, the information technology service and the communication technology service are deployed in the same cluster and use a common server.
3. The data processing method according to claim 1, characterized in that: The method further comprises: When the information technology business and the communication technology business are deployed in different clusters and do not share a common server, the network isolation method is determined to be physical isolation; When the information technology business and the communication technology business are deployed in the same cluster but do not share a server, or the information technology business and the communication technology business are deployed in the same cluster and share a server, the network isolation method is determined to be intranet isolation.
4. The data processing method according to claim 1, characterized in that: The method further comprises: The service resources involving CPU binding core and the service resources not involving CPU binding core are deployed in different clusters, wherein the services include the information technology services and the communication technology services; When a server in a cluster involving CPU core binding needs to carry a service without a clear CPU core binding requirement, CPU core binding is performed exclusively on the service without a clear CPU core binding requirement.
5. The data processing method according to claim 1, characterized in that: The method further comprises: identifying the information technology business or the communications technology business requiring large pages or huge pages of memory; The information technology business or the communication technology business requiring large pages or huge page memory is deployed on a storage server that independently carries large pages or huge page memory.
6. The data processing method according to any one of claims 1 to 5, characterized in that: The method further comprises: The reserved resources for the communication technology service requirement are divided into one or more standby clusters.
7. A data processing device, characterized in that: include: A physical resource demand acquisition module, used to acquire the physical resource demand of information technology services and the physical resource demand of communication technology services; A server cluster deployment module, used to determine the deployment mode of the server cluster according to the difference in physical resource requirements between the information technology business and the communication technology business, wherein the deployment mode of the server cluster includes different clusters without sharing servers, the same cluster but without sharing servers, and the same cluster with sharing servers; The virtualization module is used to transform physical resources into virtual resources through virtualization technology, and deploy the information technology business and the communication technology business on the virtual resources according to the deployment method of the server cluster.
8. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the data processing method according to any one of claims 1 to 6 by executing the executable instructions.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 6 is implemented.
10. A computer program product comprising: A computer program or instruction, characterized in that when the computer program or instruction is executed by a processor, it implements the data processing method described in any one of claims 1 to 6.
Citation Information
Patent Citations
Method for processing seismic data by utilizing virtualization technology
CN105389196A
Method for quickly receiving and storing data in shared file system
CN107749893A
Resource deployment method and device, server and storage medium
CN111274033A
CPU resource allocation method and device, electronic equipment and storage medium
CN111694658A
Virtual resource deployment method and system and computer readable medium
CN113778668A