Service cloud management method, system and device based on micro-service platform
Through the microservice platform, analyze application business needs, create cloud service components and monitor operating data, solving the problem of inefficient application service updates, achieving rapid response and efficient data transmission, and improving cloud service efficiency and user experience.
Patent Information
- Application Number
- CN202411246485.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2024-11-15
AI Technical Summary
When data updates and environment changes, existing application services need to be packaged and deployed repeatedly, resulting in inefficient cloud services, errors in configuration information modification or unmodified, resulting in production losses and increasing the workload of developers.
Through the microservice platform, we analyze application business needs, create cloud service components, obtain target business data, generate application data packets, and monitor operation data in preset databases to build cross-domain communication channels to achieve fast response and efficient data transmission.
It improves the cloud service efficiency of the application, reduces the workload of developers, avoids unnecessary production losses, and improves the user's application experience.
Smart Images

Figure CN118964041A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of distributed microservice technology, and in particular to a business cloud management method, system and device based on a microservice platform. Background Art
[0002] With the development of network technology, users have more and more demands for user services, and the types and demands of applications are also increasing. However, the variety of applications is also accompanied by a large amount of data. A large amount of data interaction will lead to slow application data transmission and untimely response.
[0003] At present, the data transmission and storage of application services can be met through cloud services and other means, but the application itself also needs maintenance and data updates, and the functions of the application are diverse. If the application needs to update data or the application environment changes, the developer needs to repackage, deploy and release it. As a result, relevant personnel need to repeatedly repackage, deploy and release, and conduct necessary tests after release. If some configuration information is not modified or modified incorrectly, it will also cause unnecessary production losses to the service. All of these increase the comparison workload of developers and lead to low efficiency of the application's cloud service. Therefore, how to improve the efficiency of the application's cloud service has become a technical problem that needs to be solved urgently. Summary of the invention
[0004] The present invention provides a business cloud management method, system and device based on a microservice platform, which can achieve rapid response to client application requirements, improve the cloud service efficiency of applications, and enhance the user's application usage experience.
[0005] In order to solve the above technical problems, a first aspect of the present invention provides a service cloud management method based on a microservice platform, comprising:
[0006] When receiving an application service requirement sent by the first terminal, performing data analysis on the application service requirement to determine a target application and target service data corresponding to the application service requirement;
[0007] Creating a cloud service component of the target application by analyzing the application business requirements;
[0008] Acquire the target service data in a preset database;
[0009] The cloud service component of the target application and the target business data are called to generate an application data packet, and the application data packet is sent to the first terminal.
[0010] Further, after determining the target application and target service data corresponding to the application service requirement, the method further includes:
[0011] Determine a first data domain where the first terminal is located, and a second data domain where the target application and the target service data are located;
[0012] When the first data domain is different from the second data domain, building a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain;
[0013] Based on the communication channel, the cloud service component of the target application and the target business data are called to generate an application data packet, and the application data packet is sent to the first terminal.
[0014] Furthermore, the creation of the cloud service component of the target application by parsing the application business requirements is specifically as follows:
[0015] Analyze the application business requirements, determine the configuration information, dependencies, service specifications, and service framework and operating environment of the target application, and form application creation requirements;
[0016] According to the application creation requirements, a cloud service component of the target application is created.
[0017] Further, the calling of the cloud service component of the target application and the target business data to generate an application data packet also includes:
[0018] When the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time;
[0019] When abnormal data is detected in the operating data, abnormal alarm information is generated based on the abnormal data.
[0020] Furthermore, when the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time, specifically:
[0021] When calling the cloud service component of the target application, the response time, processing speed and throughput of the target application are collected in real time to form performance data;
[0022] When calling the cloud service component of the target application, collecting the processing error rate of the application in real time;
[0023] When calling the cloud service component of the target application, the usage of CPU, memory, disk I / O and network bandwidth is collected in real time to form resource usage data;
[0024] When calling the cloud service component of the target application, error information in the system log is collected in real time to form log data;
[0025] When calling the cloud service component of the target application, according to the dependency relationship of the target application, the fault information of the component on which the target application depends is collected in real time to form dependency fault data;
[0026] The performance data, the processing error rate, the resource usage data, the log data, and the dependency failure data are determined as operation data of a cloud service component.
[0027] Furthermore, the monitoring of abnormal data in the operating data is specifically:
[0028] Obtaining the normal operating data range of the cloud service component of the target application in a preset database;
[0029] comparing the operating data with the normal operating data range;
[0030] When the operating data exceeds the normal operating data range, it is determined that abnormal data exists in the operating data.
[0031] The first aspect of the present invention provides a business cloud management method based on a microservice platform. When an application business demand is received from a first terminal, data is parsed for the application business demand to determine the target application and target business data corresponding to the application business demand; a cloud service component of the target application is created by parsing the application business demand; the target business data is obtained from a preset database; the cloud service component and target business data of the target application are called to generate an application data packet, and the application data packet is sent to the first terminal. Wherein, when the application business demand is a cross-domain application access request, a communication channel is constructed based on the cloud service bus; the cloud service component and target business data of the target application are called based on the communication channel. The present invention realizes a rapid response to client application demands, improves the cloud service efficiency of the application, and improves the user's application usage experience.
[0032] The second aspect of the present invention further provides a microservice platform-based business cloud management system, which is used to execute the microservice platform-based business cloud management method described in the first aspect of the present invention, including: a microservice platform, an application monitoring service module, a message queue and a cloud service bus;
[0033] The microservice platform is used to create cloud service components of target applications based on application business requirements and to perform operation management on the cloud service components;
[0034] The application monitoring service module is used to monitor the operation data of the cloud service component;
[0035] The message queue is used to manage application messages to achieve asynchronous decoupling and peak load shifting of the application messages;
[0036] The cloud service bus is used for communication connection between cloud services across environments and protocols.
[0037] Furthermore, the business cloud management system based on the microservice platform also includes a log service;
[0038] The log service is used for log data management; wherein the log data management includes log collection, log query analysis, log alarm and log consumption.
[0039] The second aspect of the present invention provides a business cloud management system based on a microservice platform. The system provides a development environment for application creation and application hosting services through the microservice platform. It can directly realize the separate development and maintenance of each functional component of the application, reducing the workload and data volume of application maintenance. At the same time, the application data of the cloud service components is supervised by the application monitoring service module, which can avoid repeated testing of application functions and improve the work efficiency of application development and maintenance. The message queue can realize asynchronous decoupling and peak shaving of messages, improve the speed and efficiency of data transmission and response, and realize cross-domain application service requests and responses through the cloud service bus, expand the service scope of the application, avoid multiple cloud operations, and improve the cloud service efficiency of the application.
[0040] The third aspect of the present invention further provides a business cloud management device based on a microservice platform, comprising: a demand analysis module, an application creation module, a data acquisition module and a first response module;
[0041] The demand analysis module is used to perform data analysis on the application service demand when receiving the application service demand sent by the first terminal, and determine the target application and target service data corresponding to the application service demand;
[0042] The application creation module is used to create a cloud service component of the target application by analyzing the application business requirements;
[0043] The data acquisition module is used to acquire the target business data in a preset database;
[0044] The first response module is used to call the cloud service component of the target application and the target business data, generate an application data packet, and send the application data packet to the first terminal.
[0045] Furthermore, the business cloud management device based on the microservice platform further includes: a data domain determination module, a channel construction module and a second response module;
[0046] The data domain determination module is used to determine a first data domain where the first terminal is located, and a second data domain where the target application and the target service data are located;
[0047] The channel construction module is used to construct a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain when the first data domain and the second data domain are different;
[0048] The second response module is used to call the cloud service component of the target application and the target business data based on the communication channel, generate an application data packet, and send the application data packet to the first terminal.
[0049] The third aspect of the present invention provides a business cloud management system based on a microservice platform, which is based on the organic combination of modules. When an application business demand issued by a first terminal is received, the application business demand is analyzed to determine the target application and target business data corresponding to the application business demand; a cloud service component of the target application is created by analyzing the application business demand; the target business data is obtained in a preset database; the cloud service component and target business data of the target application are called to generate an application data packet, and the application data packet is sent to the first terminal. Among them, when the application business demand is a cross-domain application access request, a communication channel is constructed based on the cloud service bus; the cloud service component and target business data of the target application are called based on the communication channel. The present invention realizes a rapid response to client application needs, improves the cloud service efficiency of the application, and improves the user's application usage experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 A schematic diagram of a process flow of an embodiment of a business cloud management method based on a microservice platform provided by the present invention;
[0051] Figure 2 A schematic diagram of the structure of an embodiment of a business cloud management system based on a microservice platform provided by the present invention;
[0052] Figure 3 A schematic diagram of the structure of an embodiment of the microservice platform provided by the present invention;
[0053] Figure 4 A schematic diagram of the structure of an embodiment of the cloud service bus provided by the present invention;
[0054] Figure 5 A schematic diagram of the structure of an embodiment of a business cloud management device based on a microservice platform provided by the present invention;
[0055] Figure 6 A structural schematic diagram of another embodiment of a business cloud management device based on a microservice platform provided by the present invention. DETAILED DESCRIPTION
[0056] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0057] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0058] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0059] Example 1
[0060] See also Figure 1 , is a flow chart of an embodiment of a business cloud management method based on a microservice platform provided by the present invention, the method includes steps 101 to 104, each step is specifically as follows:
[0061] Step 101: When an application service requirement sent by a first terminal is received, data analysis is performed on the application service requirement to determine a target application and target service data corresponding to the application service requirement.
[0062] In an embodiment of the present invention, the microservice platform provides application hosting services and can store a large amount of application components and functional information. Users send application business requirements to the microservice platform, and the microservice platform can determine the user's needs based on the application business requirements, and then determine the target application and business data that need to be called. When the microservice platform receives the application business requirements sent by the first terminal, it performs data analysis on the application business requirements. Data analysis refers to the process of converting a data format into a data format that is easier to read. By analyzing the application business requirements, the target application and target business data corresponding to the application business requirements can be obtained.
[0063] Step 102: Create a cloud service component of the target application by parsing the application business requirements.
[0064] Further, in an embodiment of the present invention, by parsing the application business requirements, a cloud service component of the target application is created, specifically:
[0065] Analyze the application business requirements, determine the configuration information, dependencies, service specifications, and service framework and operating environment of the target application, and form application creation requirements;
[0066] According to the application creation requirements, a cloud service component of the target application is created.
[0067] In an embodiment of the present invention, the microservice platform can provide application hosting services and provide full-stack solutions such as application development, deployment, monitoring, and operation and maintenance. By analyzing the business requirements, the resources, service framework, and operating environment required by the target application can be obtained, and then an application creation request for the target application can be generated. The generated application creation request includes data such as the configuration information, dependencies, and service specifications of the application. Based on the application creation request, cloud service components corresponding to different functions can be created. Different cloud service components are independent of each other and can be coupled to each other, thereby reducing the amount of development data and development difficulty of application maintenance and improving application maintenance efficiency.
[0068] Step 103: Acquire the target service data from a preset database.
[0069] Furthermore, in an embodiment of the present invention, the microservice platform stores a variety of data. After obtaining the target business data by parsing the application business requirements, the target business data can be obtained from a preset database of the microservice platform, thereby responding to the application business requirements by calling the target business data.
[0070] Step 104: calling the cloud service component of the target application and the target business data, generating an application data packet, and sending the application data packet to the first terminal.
[0071] Further, in the embodiment of the present invention, calling the cloud service component of the target application and the target business data to generate an application data packet also includes:
[0072] When the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time;
[0073] When abnormal data is detected in the operating data, abnormal alarm information is generated based on the abnormal data.
[0074] In an embodiment of the present invention, the microservice platform can call the cloud service component of the target application and the target data stored in the database, and then package the cloud service component and the target data into an application data packet and send it to the client. The client loads the cloud service component and the target data by parsing the application data packet and executes the corresponding function to respond to the application business needs. The present invention hosts the application through the microservice platform and provides cloud services, which can achieve rapid response to client application needs, improve application service efficiency, and improve the user's application experience.
[0075] Furthermore, in an embodiment of the present invention, when the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time, specifically:
[0076] When calling the cloud service component of the target application, the response time, processing speed and throughput of the target application are collected in real time to form performance data;
[0077] When calling the cloud service component of the target application, collecting the processing error rate of the application in real time;
[0078] When calling the cloud service component of the target application, the usage of CPU, memory, disk I / O and network bandwidth is collected in real time to form resource usage data;
[0079] When calling the cloud service component of the target application, error information in the system log is collected in real time to form log data;
[0080] When calling the cloud service component of the target application, according to the dependency relationship of the target application, the fault information of the component on which the target application depends is collected in real time to form dependency fault data;
[0081] The performance data, the processing error rate, the resource usage data, the log data, and the dependency failure data are determined as operation data of a cloud service component.
[0082] Further, in the embodiment of the present invention, it is monitored that the operating data contains abnormal data, specifically:
[0083] Obtaining the normal operating data range of the cloud service component of the target application in a preset database;
[0084] comparing the operating data with the normal operating data range;
[0085] When the operating data exceeds the normal operating data range, it is determined that abnormal data exists in the operating data.
[0086] In an embodiment of the present invention, during the operation of the cloud service component of the target application, the operation data of the cloud service component is monitored in real time. When abnormal data is detected in the operation data, abnormal alarm information is generated based on the abnormal data to remind the user that the operation data is abnormal. Usually, the operation data threshold is set according to the data when the cloud service component is operating normally, and the data threshold can be used to determine whether there is abnormal data in the cloud service component.
[0087] In the embodiment of the present invention, the operation data of the cloud service component includes performance indicators, error rates, resource usage data, log data, dependency failure data, user feedback data, security events and configuration change data, etc. Among them, if the response time, processing speed or throughput in the cloud service component exceeds the preset normal range, these performance indicator data are considered abnormal; if the error rate suddenly increases, such as the frequent occurrence of HTTP error status codes (such as 500, 404, etc.), it indicates that the operation data is abnormal; if the use of CPU, memory, disk I / O or network bandwidth exceeds the normal threshold, it is considered that the resource usage data is abnormal; if abnormal or error information appears in the system log, such as stack traces, error messages or warnings, it is considered that there is abnormal data; if other services or components that the application depends on fail or respond late, which may affect the normal operation of the application, it is considered abnormal; user feedback data based on user feedback can also be used as a basis for judging whether the operation data is abnormal; when there is a security warning or intrusion attempt, such as DDoS attack, SQL injection, etc., it is considered to be a signal of abnormal data; unexpected configuration changes or updates will affect the stability and performance of the application, so whether it is abnormal can also be judged based on the configuration change data.
[0088] Furthermore, in the embodiment of the present invention, after determining the target application and target service data corresponding to the application service requirement, the method further includes:
[0089] Determine a first data domain where the first terminal is located, and a second data domain where the target application and the target service data are located;
[0090] When the first data domain is different from the second data domain, building a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain;
[0091] Based on the communication channel, the cloud service component of the target application and the target business data are called to generate an application data packet, and the application data packet is sent to the first terminal.
[0092] In an embodiment of the present invention, when the application business demand is a cross-domain application access request, that is, when the first terminal sends an access request to an application in a different data domain, it is necessary to build a bridge channel between the two data domains through the cloud service bus, and then perform data communication through the bridge channel, call the application data and cloud service components in the target data domain, generate a response data packet and send it to the client application to provide services for the client application.
[0093] The embodiment of the present invention provides a business cloud management method based on a microservice platform. When an application business demand is received from a first terminal, data analysis is performed on the application business demand to determine the target application and target business data corresponding to the application business demand; a cloud service component of the target application is created by analyzing the application business demand; the target business data is obtained from a preset database; the cloud service component and target business data of the target application are called to generate an application data packet, and the application data packet is sent to the first terminal. Wherein, when the application business demand is a cross-domain application access request, a communication channel is constructed based on the cloud service bus; the cloud service component and target business data of the target application are called based on the communication channel. The present invention realizes a rapid response to client application demands, improves the cloud service efficiency of the application, and improves the user's application usage experience.
[0094] See also Figure 2 , is a schematic diagram of the structure of an embodiment of a business cloud management system based on a microservice platform provided by the present invention, the system is used to execute the business cloud management method based on a microservice platform described in the first aspect, including a microservice platform 201, an application monitoring service module 202, a message queue 203 and a cloud service bus 204;
[0095] The microservice platform 201 is used to create cloud service components of target applications based on application business requirements and to perform operation management on the cloud service components.
[0096] In an embodiment of the present invention, the microservice platform can be a cloud-native PaaS platform for application hosting and microservice management, providing full-stack solutions such as application development, deployment, monitoring, and operation and maintenance, while supporting microservice operating environments such as Spring Cloud and ApacheDubbo. The microservice platform is an application hosting platform based on a distributed architecture and digital business cloud. Using distributed application services, it is easy to build a microservice architecture and build a large-scale distributed system to publish and manage applications.
[0097] In the embodiment of the present invention, the microservice platform can provide an application container framework, which can provide full life cycle hosting for applications. On the visual operation interface, it supports one-stop management and control of the application life cycle, including creation, deployment, start, stop, expansion, reduction and application offline.
[0098] In an embodiment of the present invention, the microservice platform can integrate a complete set of mature distributed computing frameworks of middleware, including distributed service frameworks, service governance, operation and maintenance management, link tracking and stability components, etc.; it can provide full-link support to meet scenario-based business needs, and can be compatible with a variety of commercial and open source microservice frameworks (such as HSF, Dubbo, Spring Cloud). Applications developed based on the distributed microservice framework can be directly migrated to the cloud to provide cloud services without the need to change the business code.
[0099] In the embodiments of the present invention, see Figure 3 , is a schematic diagram of a structure of an embodiment of the microservice platform provided by the present invention. The running container of the microservice platform may include: Figure 3 The functions and components shown in the figure. Distributed applications are packaged and deployed in the Web runtime container. Taking Java applications as an example, application deployment supports multiple forms such as war, jar, and mirror. The microservice platform helps users monitor, operate, diagnose, and solve high availability and other operation and maintenance problems during the management process, and provides a variety of application releases and lightweight microservice solutions. The microservice platform provides good support for application lifecycle management, elastic scaling, and full-link tracking and monitoring. Distributed application services have a complete authentication system to protect every call of the business.
[0100] The application monitoring service module 202 is used to monitor the operation data of the cloud service component.
[0101] In an embodiment of the present invention, the application monitoring service module can provide monitoring of the CPU, memory, disk, and network of the application deployment cluster and a single node and present curves in a graphical form by hour, day, or week.
[0102] In an embodiment of the present invention, the application monitoring service module can perform holographic troubleshooting, integrate the call link information with the business events, and bidirectionally associate the business events through the traceID of the call chain. When an abnormality occurs in the business, the problem can be troubleshooted based on the link tracking information associated with the business event.
[0103] In an embodiment of the present invention, the application monitoring service module can provide detailed monitoring of scheduled tasks, including overview, SQL call analysis, NoSQL call analysis, exception analysis, error analysis, link downstream and call chain query.
[0104] In an embodiment of the present invention, the application monitoring service module can provide various indicators of the thread pool used by the application, including the number of core threads, the current number of threads, the maximum number of threads, the number of active threads and the queue size. The thread pool types include at least: Tomcat, service grid, Dubbo, Druid, and Jedis. Statistics of CPU time consumption and the number of threads of each type at thread granularity are provided, and abnormal threads can be quickly found based on CPU time consumption statistics. For abnormal threads, the CPU time consumption and thread number curve graph is supported to analyze the changes in CPU time consumption and thread number, and it supports viewing the method stack of the thread and viewing the actual running method stack within the specified time.
[0105] In an embodiment of the present invention, the application monitoring service module can support application layer monitoring, including but not limited to the number and time consumption of YoungGc and FullGc of the JVM, the heap memory usage of the JVM, the off-heap memory usage of the JVM, the number of JVM threads and other dimensions of monitoring.
[0106] In an embodiment of the present invention, the application monitoring service module can support counting the number of exceptions within a specified time range, as well as detailed information about the exceptions including the exception interface name, exception information summary, percentage, exception stack, and the call link that triggered the exception.
[0107] In an embodiment of the present invention, the application monitoring service module can provide alarms for application indicators in various dimensions, including but not limited to JVM, abnormal interface calls, application call type statistics, host monitoring, database indicators and other application monitoring risk information alarms.
[0108] In the embodiment of the present invention, the application monitoring service module can quickly and conveniently build a business monitoring capability with a second-level response for the enterprise based on dimensions such as application and business customization; the application real-time monitoring module includes a series of sub-products such as application monitoring, front-end monitoring, Prometheus monitoring, cloud dialing, Grafana service, and alarm management. It covers different observable environments and scenarios such as browsers, applets, APPs, distributed applications, and containers, helping enterprises to achieve full-stack performance monitoring and end-to-end tracking and diagnosis. Improve monitoring efficiency and reduce operation and maintenance workload.
[0109] The message queue 203 is used to manage application messages to achieve asynchronous decoupling and peak load shifting of the application messages.
[0110] In an embodiment of the present invention, the message queue MQ is based on high-availability distributed cluster technology, provides a series of message cloud services such as message subscription and publishing, message trajectory query, scheduled (delayed) messages, resource statistics, etc., and is the core product of the enterprise-level extranet (integrated data network, etc.) architecture.
[0111] In the embodiment of the present invention, the message queue provides the microservice platform with the capabilities of asynchronous decoupling and peak shaving and valley filling, and at the same time has the characteristics required for external network (integrated data network, etc.) applications such as massive message accumulation, high throughput, and reliable retry.
[0112] In an embodiment of the present invention, the message queue can provide access methods at the TCP protocol and HTTP protocol levels, support multiple programming languages such as Java, C++ and .NET, and facilitate rapid access to message cloud services developed in different programming languages.
[0113] In the embodiment of the present invention, application scenarios of the message queue may include application coupling, asynchronous processing, current limiting and peak shaving, and message-driven systems.
[0114] Among them, application coupling refers to the processing of the same message by multiple applications through message queues to avoid the failure of the entire process due to the failure of calling the interface. For example, in order to use a certain application, the user registers and the system needs to send a registration email and a verification SMS. There are two ways to handle these two operations: serial and parallel. The serial method means that after the new registration information is generated, the registration email is sent first, and then the verification SMS is sent. In this way, the verification SMS needs to be sent in the end before it is returned to the client. Parallel processing means that after the new registration information is written, the SMS and email are processed in parallel. In this way, the SMS and email need to be processed and returned to the client.
[0115] Asynchronous processing refers to multiple applications processing the same message in the message queue, and the applications process messages concurrently, which reduces the processing time compared to serial processing. For example, when a user uploads a picture using QQ photo album, the face recognition system will perform face recognition on the picture. During the message queue processing, after the client uploads the picture, the picture upload system writes the picture information such as uin and batch into the message queue and directly returns success; while the face recognition system periodically takes data from the message queue to complete the recognition of the newly added pictures. At this time, the picture upload system does not need to care whether the face recognition system processes these picture information, and when to process these picture information. In fact, since users do not need to know the face recognition results immediately, the face recognition system can choose different scheduling strategies to process the picture information in the queue according to idle time, busy time, and normal time.
[0116] Current limiting and peak shaving is widely used in flash sales or rush purchases to prevent the application system from crashing due to excessive traffic. For example, when a shopping website conducts a flash sale, the server receives too much traffic due to the excessive instantaneous traffic, which will cause a surge in traffic and the related system will be unable to process the request or even crash. After joining the message queue, the request is first entered into the message queue instead of being directly processed by the business processing system, which makes a buffer and greatly reduces the pressure on the business processing system.
[0117] The message-driven system is divided into message queues, message producers, and message consumers. Producers are responsible for generating messages, and consumers (there may be multiple) are responsible for processing messages. A user has uploaded a batch of new photos, and the face recognition system needs to cluster all the photos of this user. After the clustering is completed, the reconciliation system regenerates the user's face index (to speed up the query). Through message queue processing, the processing results of the previous stage are placed in the queue, and the next stage obtains the message from the queue to continue processing, avoiding the direct call to the next system causing the current system to fail.
[0118] The cloud service bus 204 is used for communication connection between cloud services across environments and protocols.
[0119] In the embodiment of the present invention, the cloud service bus has the service protocol adaptation and open management and control capabilities, which can realize cross-environment and cross-protocol service interoperability. It mainly provides unified security authorization, traffic restriction and other management and control for the scenarios where application system capabilities are open to the outside world and services access each other.
[0120] In an embodiment of the present invention, the cloud service bus has protocol adaptation capabilities, supports the access and opening of commonly used protocol services, supports multiple service registration and discovery mechanisms, and microservices and services of legacy systems can be directly opened as APIs on the cloud service bus. The cloud service bus also supports cross-environment linkage, allowing access to services in other environments like accessing local services.
[0121] In the embodiments of the present invention, see Figure 4 , is a schematic diagram of a structure of an embodiment of the cloud service bus provided by the present invention. The big data domain and the acquisition monitoring domain belong to two different and independent data domains. The applications of the big data domain and the acquisition monitoring domain can be openly interconnected in a manageable and controllable manner through the cloud service bus open platform, so that the application of one domain can access its internal application service through the cloud service bus instance of another domain, and the bridge channel formed by the cloud service bus instances of the two domains can realize interconnection.
[0122] Furthermore, in the embodiment of the present invention, the business cloud management system based on the microservice platform further includes: a log service;
[0123] The log service is used for log data management; wherein the log data management includes log collection, log query analysis, log alarm and log consumption.
[0124] In the embodiment of the present invention, the log service is a one-stop service for log data, which can quickly complete functions such as log data collection, consumption, query and analysis, improve operation and maintenance efficiency, and establish massive log processing capabilities.
[0125] In the embodiment of the present invention, the log service has the following functions: log collection, query analysis, alarm, real-time consumption, etc. It can realize application scenarios such as data collection, real-time computing, data warehouse and offline analysis, product operation and analysis, operation and maintenance, and management.
[0126] In an embodiment of the present invention, the business cloud management system based on the microservice platform further includes: an application programming interface API gateway;
[0127] The application programming interface (API) gateway is used to provide managed services for the API life cycle, where the API life cycle includes API design, development, testing, release, operation and maintenance monitoring, security management and decommissioning.
[0128] In the embodiment of the present invention, the API gateway can provide complete API hosting services, covering all API life cycle stages such as design, development, testing, release, operation and maintenance monitoring, security management, and offline. Quickly build a system architecture with API as the core to meet the needs of many scenarios such as new technology introduction, system integration, and business middle office.
[0129] In the embodiment of the present invention, the API gateway can provide multiple means such as anti-attack, anti-replay, request encryption, identity authentication, permission management, and flow control to ensure API security and reduce the risk of API opening.
[0130] In the embodiment of the present invention, the API gateway can automatically generate SDK and API description documents to improve the efficiency of API management and iteration. The API gateway improves the capability reuse rate and accelerates business innovation.
[0131] In an embodiment of the present invention, the API gateway is responsible for request routing, API composition, and protocol conversion. All API requests from external clients will first go to the API gateway, which will then route the request to the corresponding service. The API gateway uses the API composition mode to handle other requests, call multiple services and aggregate the results. At the same time, it can also convert between client-friendly protocols (such as HTTP) and client-unfriendly protocols.
[0132] In the embodiment of the present invention, the API gateway encapsulates the internal structure of the application so that the client only needs to interact with the gateway without calling specific services. At the same time, the API gateway provides a specific API for each type of client, thereby reducing the number of interactions between the client and the application and simplifying the processing of the client code.
[0133] An embodiment of the present invention also provides a business cloud management system based on a microservice platform. The system provides a development environment for application creation and application hosting services through the microservice platform, which can directly realize the separate development and maintenance of various functional components of the application, reducing the workload and data volume of application maintenance. At the same time, by supervising the application data of the cloud service components through the application monitoring service module, repeated testing of application functions can be avoided, and the work efficiency of application development and maintenance can be improved. The asynchronous decoupling and peak-shaving of messages can be achieved through the message queue, and the speed and efficiency of data transmission and response can be improved. Through the cloud service bus, cross-domain application service requests and responses can be realized, which expands the service scope of the application, avoids multiple cloud operations, and improves the cloud service efficiency of the application.
[0134] See also Figure 5 , is a structural diagram of an embodiment of a business cloud management device based on a microservice platform provided by the present invention, the device includes a demand parsing module 301, an application creation module 302, a data acquisition module 303 and a first response module 304;
[0135] The demand analysis module 301 is used to perform data analysis on the application service demand when receiving the application service demand sent by the first terminal, and determine the target application and target service data corresponding to the application service demand;
[0136] The application creation module 302 is used to create a cloud service component of the target application by analyzing the application business requirements;
[0137] The data acquisition module 303 is used to acquire the target business data in a preset database;
[0138] The first response module 304 is used to call the cloud service component of the target application and the target business data, generate an application data packet, and send the application data packet to the first terminal.
[0139] See also Figure 6 , is a schematic diagram of the structure of another embodiment of the business cloud management device based on the microservice platform provided by the present invention, the device also includes: a data domain determination module 305, a channel construction module 306 and a second response module 307;
[0140] The data domain determination module 305 is used to determine the first data domain where the first terminal is located, and the second data domain where the target application and the target service data are located;
[0141] The channel construction module 306 is used to construct a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain when the first data domain and the second data domain are different;
[0142] The second response module 307 is used to call the cloud service component of the target application and the target business data based on the communication channel, generate an application data packet, and send the application data packet to the first terminal.
[0143] Further, in an embodiment of the present invention, by parsing the application business requirements, a cloud service component of the target application is created, specifically:
[0144] Analyze the application business requirements, determine the configuration information, dependencies, service specifications, and service framework and operating environment of the target application, and form application creation requirements;
[0145] According to the application creation requirements, a cloud service component of the target application is created.
[0146] Further, in the embodiment of the present invention, calling the cloud service component of the target application and the target business data to generate an application data packet also includes:
[0147] When the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time;
[0148] When abnormal data is detected in the operating data, abnormal alarm information is generated based on the abnormal data.
[0149] Furthermore, in an embodiment of the present invention, when the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time, specifically:
[0150] When calling the cloud service component of the target application, the response time, processing speed and throughput of the target application are collected in real time to form performance data;
[0151] When calling the cloud service component of the target application, collecting the processing error rate of the application in real time;
[0152] When calling the cloud service component of the target application, the usage of CPU, memory, disk I / O and network bandwidth is collected in real time to form resource usage data;
[0153] When calling the cloud service component of the target application, error information in the system log is collected in real time to form log data;
[0154] When calling the cloud service component of the target application, according to the dependency relationship of the target application, the fault information of the component on which the target application depends is collected in real time to form dependency fault data;
[0155] The performance data, the processing error rate, the resource usage data, the log data, and the dependency failure data are determined as operation data of a cloud service component.
[0156] Further, in the embodiment of the present invention, it is monitored that the operating data contains abnormal data, specifically:
[0157] Obtaining the normal operating data range of the cloud service component of the target application in a preset database;
[0158] comparing the operating data with the normal operating data range;
[0159] When the operating data exceeds the normal operating data range, it is determined that abnormal data exists in the operating data.
[0160] The embodiment of the present invention also provides a business cloud management device based on a microservice platform, which is based on the organic combination of modules. When an application business demand issued by a first terminal is received, the application business demand is analyzed to determine the target application and target business data corresponding to the application business demand; a cloud service component of the target application is created by analyzing the application business demand; the target business data is obtained in a preset database; the cloud service component and target business data of the target application are called to generate an application data packet, and the application data packet is sent to the first terminal. Among them, when the application business demand is a cross-domain application access request, a communication channel is constructed based on the cloud service bus; the cloud service component and target business data of the target application are called based on the communication channel. The present invention realizes a rapid response to client application needs, improves the cloud service efficiency of the application, and improves the user's application usage experience.
[0161] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.
Claims
1. A business cloud management method based on a microservice platform, characterized in that: include: When receiving an application service requirement sent by the first terminal, performing data analysis on the application service requirement to determine a target application and target service data corresponding to the application service requirement; Creating a cloud service component of the target application by analyzing the application business requirements; Acquire the target service data in a preset database; The cloud service component of the target application and the target business data are called to generate an application data packet, and the application data packet is sent to the first terminal.
2. The service cloud management method based on the microservice platform according to claim 1 is characterized in that: After determining the target application and target service data corresponding to the application service requirement, the method further includes: Determine a first data domain where the first terminal is located, and a second data domain where the target application and the target service data are located; When the first data domain is different from the second data domain, building a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain; Based on the communication channel, the cloud service component of the target application and the target business data are called to generate an application data packet, and the application data packet is sent to the first terminal.
3. The microservice platform-based business cloud management method according to claim 1 or 2, characterized in that: The step of creating the cloud service component of the target application by analyzing the application business requirements is specifically as follows: Analyze the application business requirements, determine the configuration information, dependencies, service specifications, and service framework and operating environment of the target application, and form application creation requirements; According to the application creation requirements, a cloud service component of the target application is created.
4. The microservice platform-based business cloud management method according to claim 1 or 2, characterized in that: The calling of the cloud service component of the target application and the target business data to generate an application data packet also includes: When the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time; When abnormal data is detected in the operating data, abnormal alarm information is generated based on the abnormal data.
5. The microservice platform-based business cloud management method according to claim 4, characterized in that: When the cloud service component of the target application is called, the operation data of the cloud service component is monitored in real time, specifically: When calling the cloud service component of the target application, the response time, processing speed and throughput of the target application are collected in real time to form performance data; When calling the cloud service component of the target application, collecting the processing error rate of the application in real time; When calling the cloud service component of the target application, the usage of CPU, memory, disk I / O and network bandwidth is collected in real time to form resource usage data; When calling the cloud service component of the target application, error information in the system log is collected in real time to form log data; When calling the cloud service component of the target application, according to the dependency relationship of the target application, the fault information of the component on which the target application depends is collected in real time to form dependency fault data; The performance data, the processing error rate, the resource usage data, the log data, and the dependency failure data are determined as operation data of a cloud service component.
6. The service cloud management method based on the microservice platform according to claim 5 is characterized in that: The monitoring of abnormal data in the operating data is specifically: Obtaining the normal operating data range of the cloud service component of the target application in a preset database; comparing the operating data with the normal operating data range; When the operating data exceeds the normal operating data range, it is determined that abnormal data exists in the operating data.
7. A business cloud management system based on a microservice platform, characterized in that: A method for managing a business cloud based on a microservice platform according to any one of claims 1 to 6, comprising: a microservice platform, an application monitoring service module, a message queue and a cloud service bus; The microservice platform is used to create cloud service components of target applications based on application business requirements and to perform operation management on the cloud service components; The application monitoring service module is used to monitor the operation data of the cloud service component; The message queue is used to manage application messages to achieve asynchronous decoupling and peak load shifting of the application messages; The cloud service bus is used for communication connection between cloud services across environments and protocols.
8. The microservice platform-based business cloud management system according to claim 7, characterized in that: Also includes: Log service; The log service is used for log data management; wherein the log data management includes log collection, log query analysis, log alarm and log consumption.
9. A business cloud management device based on a microservice platform, characterized in that: include: Demand analysis module, application creation module, data acquisition module and first response module; The demand analysis module is used to perform data analysis on the application service demand when receiving the application service demand sent by the first terminal, and determine the target application and target service data corresponding to the application service demand; The application creation module is used to create a cloud service component of the target application by analyzing the application business requirements; The data acquisition module is used to acquire the target business data in a preset database; The first response module is used to call the cloud service component of the target application and the target business data, generate an application data packet, and send the application data packet to the first terminal.
10. The service cloud management device based on the microservice platform according to claim 9, characterized in that: Also includes: A data domain determination module, a channel construction module, and a second response module; The data domain determination module is used to determine a first data domain where the first terminal is located, and a second data domain where the target application and the target service data are located; The channel construction module is used to construct a communication channel between the first data domain and the second data domain based on the cloud service bus of the first data domain and the second data domain when the first data domain and the second data domain are different; The second response module is used to call the cloud service component of the target application and the target business data based on the communication channel, generate an application data packet, and send the application data packet to the first terminal.
