Software performance data acquisition method, device, equipment and storage medium
By deploying client connection components on the target server and using virtual proxy addresses, combining data collection and storage of grid servers and clients, the software performance data acquisition problem caused by network isolation in government and enterprise affairs is solved, and the software performance measurement center is realized efficient data acquisition and operation and maintenance support.
Patent Information
- Application Number
- CN202311764075.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-20
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2043-12-20
AI Technical Summary
In the context of big data, artificial intelligence and cloud computing, the rapid expansion of government and enterprise affairs has led to network isolation, making it difficult for intelligent operation and maintenance systems to obtain edge software performance data automatically or quickly, and cannot cope with complex scenarios, which brings difficulties to operation and maintenance.
Provide a software performance data acquisition method, by deploying client connection components on the target server, using a virtual proxy address to achieve communication with the target server, obtaining software performance data, and collecting data through the grid server and grid client. Storage, combines neural network models to generate performance prediction models, perform data cleaning and feature extraction, and realize performance situation evaluation and data storage.
Ensure that the software performance metric center obtains software performance data from the target server isolated in the network without barriers, solves the data acquisition problem, improves the convenience of operation and maintenance and data accuracy, and can cope with software performance monitoring and operation and maintenance in complex environments. .
Smart Images

Figure CN117834706B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of big data technology, and in particular to a method and apparatus, device and storage medium for acquiring software performance data. Background Art
[0002] At present, under the background of mainstream new technologies such as big data, artificial intelligence, and cloud computing, and in the process of ongoing production business, governments and enterprises always need to ensure the efficient management and smooth operation of application software, accurately locate fault information, ensure real-time equipment network security, prevent network attacks, etc. In order to respond to scientific and technological requirements, it is necessary to obtain application software performance data without obstacles.
[0003] However, with the rapid expansion of government and enterprise businesses, in order to ensure the smooth and normal operation of each business, different cloud networks and isolation strategies are usually established to prevent each business from interfering with each other, thus extending the time for smooth operation of the business. On the contrary, such network isolation brings many disadvantages to operation and maintenance. The intelligent operation and maintenance system cannot automatically or quickly obtain edge software performance data. At the same time, each edge network structure also has layers and cannot cope with various complex scenarios, which brings many difficulties to operation and maintenance work. Summary of the invention
[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the embodiments of the present disclosure provide a method and apparatus for obtaining software performance data, a device and a storage medium.
[0005] In a first aspect, an embodiment of the present disclosure provides a method for acquiring software performance data, which is applied to a software performance measurement center. The method includes:
[0006] Provide the client connection component deployment package to the target server;
[0007] After the client connection component is deployed in the target server, a connection request from the client connection component is received, the connection request is verified, and verification success information is sent to the target server;
[0008] Receiving a channel establishment request initiated by the target server in response to the verification success information, mapping a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component;
[0009] A software performance data acquisition request is sent to a target server, returned software performance data is received, and the software performance data is stored, wherein the software performance data includes associated indicator data, log data, and link data.
[0010] In a possible implementation, the associated indicator data, log data, and link data are obtained by the following steps:
[0011] Convert log data into standard log data;
[0012] Process the specified data and remove empty and invalid data;
[0013] According to the timestamp, the removed indicator data, standard log data and link data are associated to obtain the associated indicator data, log data and link data.
[0014] In a possible implementation, the software performance measurement center includes a grid server, the target server includes a grid client and a target server, and sending a software performance data acquisition request to the target server includes:
[0015] The grid server sends the software performance data acquisition request to the grid client of the target server;
[0016] The grid client receives the software performance data acquisition request, calls the data reporting service, extracts data corresponding to the software performance data acquisition request from a local database for storing software performance data, and transmits the data to the grid server.
[0017] In a possible implementation, storing the software performance data includes:
[0018] Storing the software performance data in full in different types of databases in different formats;
[0019] Monitor and collect data on the storage status of each database in real time, collect and obtain migration bottleneck status data information, and detect cache adjustment status data information in real time;
[0020] Data cleaning and feature extraction are performed on the migration bottleneck status data information and cache adjustment status data information, and the processed data information is standardized based on the dimensionless processing technology;
[0021] Comprehensively analyze and learn the migration bottleneck status data information after data cleaning to obtain the bottleneck factor, and combine it with the number of interruptions that occur during data migration to generate the migration status coefficient;
[0022] Obtain block size and cache hit rate through cache adjustment status data information after feature extraction, and associate the block size with the cache hit rate to obtain a cache adjustment coefficient, conduct a comprehensive analysis on the cache adjustment coefficient and the migration state coefficient, and generate a software storage performance prediction model by combining with a neural network model and training, and obtain a performance status evaluation index after dimensionless processing;
[0023] The preset evaluation threshold is compared and analyzed with the performance status evaluation index to obtain a prediction result, and a corresponding level improvement strategy is obtained based on the prediction result.
[0024] In a possible implementation, the performance status evaluation index is obtained by the following formula:
[0025]
[0026] Among them, TSzs represents the performance situation evaluation index, Ttlz represents the throughput, F1, F2 and F3 represent the proportional coefficients of the cache control coefficient Tkxs, the migration state coefficient Pyxs and the throughput Ttlz respectively, among which, 0.10≤F1≤0.22, 0.15≤F2≤0.36, 0.20≤F3≤0.42, and 0.55≤F1+F2+F3≤1.0, and C represents the first correction constant.
[0027] In a possible implementation manner, the migration state coefficient is obtained by the following formula:
[0028]
[0029] Among them, Pyxs represents the migration state coefficient, Ysjz represents the amount of migrated data, α and β both represent proportional coefficients, and M1 represents the third correction constant.
[0030] In a possible implementation manner, the cache control coefficient is obtained by the following formula:
[0031]
[0032] Among them, Tkxs represents the cache control coefficient, RLz represents the cache capacity, Kds represents the block size, Hcmz represents the cache hit rate, a1 and a2 both represent proportional coefficients, and M2 represents the fourth correction constant.
[0033] In a second aspect, an embodiment of the present disclosure provides a software performance data acquisition device, the device comprising:
[0034] Provide a module for providing a client connection component deployment package to a target server;
[0035] A verification module, configured to receive a connection request from the client connection component after the client connection component is deployed in the target server, verify the connection request, and send verification success information to the target server;
[0036] A mapping module, used to receive a channel establishment request initiated by the target server in response to the verification success information, and map a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component;
[0037] The receiving module is used to send a software performance data acquisition request to the target server, receive the returned software performance data, and store the software performance data, wherein the software performance data includes associated indicator data, log data, and link data.
[0038] In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;
[0039] Memory, used to store computer programs;
[0040] The processor is used to implement the above-mentioned method for acquiring software performance data when executing the program stored in the memory.
[0041] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the above-mentioned method for acquiring software performance data when executed by a processor.
[0042] The above technical solution provided by the embodiment of the present disclosure has at least some or all of the following advantages compared with the prior art:
[0043] The software performance data acquisition method described in the embodiment of the present disclosure provides a client connection component deployment package for the target server; after the client connection component is deployed in the target server, a connection request from the client connection component is received, the connection request is verified, and a verification success message is sent to the target server; a channel establishment request initiated by the target server in response to the verification success message is received, and a virtual proxy address corresponding to the target server is mapped to achieve communication with the target server through data interaction with the client connection component through the virtual proxy address; a software performance data acquisition request is sent to the target server, the returned software performance data is received, and the software performance data is stored, so as to ensure that a software performance measurement center can obtain software performance data from a target server isolated from its network without obstacles. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0046] Figure 1 The following schematically shows a flow chart of a method for acquiring software performance data according to an embodiment of the present disclosure;
[0047] Figure 2 A schematic diagram of a process of data collection between a software performance measurement center and multiple edge grids according to an embodiment of the present disclosure is schematically shown;
[0048] Figure 3 A schematic diagram of a three-dimensional software performance measurement method flow chart of a software performance measurement center according to an embodiment of the present disclosure is shown;
[0049] Figure 4 A schematic diagram of the interaction process between application software and a software performance measurement center in an edge grid according to an embodiment of the present disclosure is shown;
[0050] Figure 5 The following schematically shows a structural diagram of a device for acquiring software performance data according to an embodiment of the present disclosure;
[0051] Figure 6 The structural block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION
[0052] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure.
[0053] See also Figure 1 The embodiment of the present disclosure provides a method for acquiring software performance data, which is applied to a software performance measurement center. The method includes:
[0054] S1, providing the target server with a client connection component deployment package;
[0055] S2, after the client connection component is deployed in the target server, a connection request from the client connection component is received, the connection request is verified, and a verification success message is sent to the target server;
[0056] S3, receiving a channel establishment request initiated by the target server in response to the verification success information, mapping a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component;
[0057] S4, sending a software performance data acquisition request to the target server, receiving the returned software performance data, and storing the software performance data, wherein the software performance data includes associated indicator data, log data, and link data.
[0058] In this embodiment, in step S4, the associated indicator data, log data and link data are obtained by the following steps:
[0059] Convert log data into standard log data;
[0060] Process the specified data and remove empty and invalid data;
[0061] According to the timestamp, the removed indicator data, standard log data and link data are associated to obtain the associated indicator data, log data and link data.
[0062] In this embodiment, in step S4, the software performance measurement center includes a grid server, the target server includes a grid client and a target server, and sending a software performance data acquisition request to the target server includes:
[0063] The grid server sends the software performance data acquisition request to the grid client of the target server;
[0064] The grid client receives the software performance data acquisition request, calls the data reporting service, extracts data corresponding to the software performance data acquisition request from a local database for storing software performance data, and transmits the data to the grid server.
[0065] In this embodiment, in step S4, storing the software performance data includes:
[0066] Storing the software performance data in full in different types of databases in different formats;
[0067] Monitor and collect data on the storage status of each database in real time, collect and obtain migration bottleneck status data information, and detect cache adjustment status data information in real time;
[0068] Data cleaning and feature extraction are performed on the migration bottleneck status data information and cache adjustment status data information, and the processed data information is standardized based on the dimensionless processing technology;
[0069] Comprehensively analyze and learn the migration bottleneck status data information after data cleaning to obtain the bottleneck factor, and combine it with the number of interruptions that occur during data migration to generate the migration status coefficient;
[0070] Obtain block size and cache hit rate through cache adjustment status data information after feature extraction, and associate the block size with the cache hit rate to obtain a cache adjustment coefficient, conduct a comprehensive analysis on the cache adjustment coefficient and the migration state coefficient, and generate a software storage performance prediction model by combining with a neural network model and training, and obtain a performance status evaluation index after dimensionless processing;
[0071] The preset evaluation threshold is compared and analyzed with the performance status evaluation index to obtain a prediction result, and a corresponding level improvement strategy is obtained based on the prediction result.
[0072] In this embodiment, the performance status evaluation index is obtained by the following formula:
[0073]
[0074] Among them, TSzs represents the performance situation evaluation index, Ttlz represents the throughput, F1, F2 and F3 represent the proportional coefficients of the cache control coefficient Tkxs, the migration state coefficient Pyxs and the throughput Ttlz respectively, among which, 0.10≤F1≤0.22, 0.15≤F2≤0.36, 0.20≤F3≤0.42, and 0.55≤F1+F2+F3≤1.0, and C represents the first correction constant.
[0075] In this embodiment, the migration state coefficient is obtained by the following formula:
[0076]
[0077] Among them, Pyxs represents the migration state coefficient, Ysjz represents the amount of migrated data, α and β both represent proportional coefficients, and M1 represents the third correction constant.
[0078] In this embodiment, the cache control coefficient is obtained by the following formula:
[0079]
[0080] Among them, Tkxs represents the cache control coefficient, RLz represents the cache capacity, Kds represents the block size, Hcmz represents the cache hit rate, a1 and a2 both represent proportional coefficients, and M2 represents the fourth correction constant.
[0081] See also Figure 2, taking the proxy server of the edge grid as the target server, the data collection of multiple edge grids can collect software performance data of multiple private clouds or intranets, and report the data to the software performance measurement center in the form of pipeline services. Each grid can build its own data reporting system and report it to the software performance measurement center layer by layer, so as to realize orderly data collection and high decoupling. The specific process is as follows:
[0082] The data collection of multiple edge grids depends on the grid clients of each edge grid and the grid server of the software performance measurement center. The grid client can be deployed on the proxy server in the edge grid. When the grid client is started, it actively connects to the grid server and establishes a long connection pipeline, which is responsible for the communication between networks. When the channel is disconnected due to abnormal reasons, it will retry the connection. After the long connection pipeline is established, the grid server will create a monitoring service, which is used to obtain the collection request of software performance data of multiple edge grids in real time from the software performance measurement center. When the grid server monitors the data collection request, the grid server sends the request to the grid client. After receiving the request, the grid client reports the data to the grid server, that is, the software performance measurement center, to achieve the aggregation of software performance data.
[0083] The present invention is based on multi-cloud network technology and self-developed pipeline technology, and can collect software data from different edge grids, software performance data from different edge grids, build multi-level data reporting and collection channels, and achieve accurate, unified and efficient data collection processes. It can solve the problem encountered in the prior art that complex environments are formed by developing specified data separately and then connecting the interfaces to the software performance measurement center, resulting in the inability to report data layer by layer in an automated manner during the data collection phase, and there are faults between the networks for data reporting, requiring a large amount of customized development work. Among them, the complex environment refers to the situation where the networks between the software performance measurement center and each edge grid are different, and the grids between different edge grids are also different. It realizes a cross-network, cross-regional, and cross-space architecture system for software operation and maintenance, and brings scalability and basic support to software performance monitoring and operation and maintenance.
[0084] See also Figure 2, the proxy servers of each edge grid can be used to aggregate, manage, filter and prioritize data reporting. When the server structure and data collection volume of an edge grid are particularly large, the dirty data in the edge grid needs to be managed in advance. In addition to deploying grid servers for communication with the software performance measurement center, the proxy servers of each edge grid can also serve as the data center of the edge grid, query data through the visualization page, and set filtering strategies and reporting priority strategies for the data to prevent the data reporting channel from being blocked due to the surge in data volume, and the failure to find problems and alarm in time, which will cause problems for the normal operation of the business. It avoids the problem that the existing technology cannot partially aggregate the collected data, and report it to the intelligent software performance measurement center after being managed by big data technology, which may store a large amount of garbage data, which brings great obstacles to the operation and maintenance personnel in handling problems, and because the synchronization priority and synchronization time interval cannot be set according to the importance of the data, effective differentiated monitoring cannot be formed, and the key monitoring data cannot be obtained in time due to the surge in data volume.
[0085] The disclosed edge grid is based on big data technology and integrates multiple links such as data governance, data filtering and data reporting. It reports and governs software performance data in different levels to achieve differentiated, rationalized and effective data monitoring.
[0086] See also Figure 2 The designated data of each edge grid is aggregated and reported to the proxy server of the edge grid. The proxy server then stores the data in full and aggregates the valid data to the software performance measurement center through data governance and filtering. The software performance measurement center stores the data and performs hot and cold storage based on the validity and timeliness of the data. Based on the bidirectional storage of big data, it can not only provide hot and cold storage modes, but also provide data storage modes between the software performance measurement center and the edge, realizing double data protection.
[0087] After the software performance data is reported, the present invention stores the data at the software performance measurement center end, and backs up the data at the edge grid end, and performs hot and cold processing on the data, which can avoid the risk of data loss caused by the fact that the specified data in the prior art is only stored at the software performance measurement center end, and the problem that the data is stored centrally, which easily occupies a large amount of storage resources and cannot access the specified data of different edge grids by modules.
[0088] See also Figure 3, provides a data aggregation analysis and measurement method in three dimensions of indicators, logs and links. First, the three software performance data are aggregated and classified. Secondly, the data of each dimension is analyzed and visualized, and then a separate alarm or joint alarm strategy is set. Not only is the alarm issued through simple indicator data, but the combined log and link data can accurately locate the root causes of all problems and improve operation and maintenance efficiency. It can solve the problem of setting alarm strategies for the collected specified data in the existing technology and then issuing alarms. It only pays attention to the abnormal conditions of the existing software. The type of data concerned is relatively single and cannot completely cover all specified data types. It only provides a single indicator, log or link data, aggregates or discretely analyzes data for a period of time, cannot achieve full-stack, full-angle periodic monitoring, and cannot conduct comprehensive analysis and measurement of the performance and operation of the software.
[0089] The present invention provides full-stack three-dimensional software performance measurement and situation analysis based on the measurement of three-dimensional monitoring data, aggregates and discretely analyzes software monitoring data, effectively operates and maintains the entire life cycle of software, quickly locates problems, discovers performance defects, and adjusts software performance parameters in a timely manner.
[0090] See also Figure 4 ,The interaction process between application software A and the software ,performance measurement center in the edge grid is as follows:
[0091] The first step is edge grid data collection:
[0092] First, deploy probes on the monitored devices of the edge grid to collect indicators, logs, and link data of software or applications on the servers in the edge grid. Take application A as an example, collect the log data of application A on that day, and deploy corresponding probes to the corresponding log directory to obtain data.
[0093] Aggregate the collected data to the proxy server of the edge grid, and push the collected log data of application A on that day to the proxy server through the data reporting service;
[0094] The proxy server stores the collected data in full in different formats into different types of databases;
[0095] After the data is stored in the database, you can manage, filter and set reporting rules for the data. Taking the log of application A on the day as an example, after the data is stored in the database, you can perform keyword filtering, deduplicate empty data and set the reporting priority of the data.
[0096] The second step is the data collection method based on multi-grid:
[0097] The data collection is not only within the edge grid network, but also can collect the performance data of monitored devices and software isolated in different networks. In addition, the data collection and reporting of each grid can be customized, thus achieving cross-network, cross-device, and cross-regional data collection effects:
[0098] The software performance measurement center sends a request to collect the daily log of application A and forwards the request message to the grid server;
[0099] The grid server and the grid client always keep the channel connected. The grid server sends the request message to the grid client corresponding to application A through this technology.
[0100] After receiving the request to collect the daily log of application A, the grid client calls the data reporting service, extracts the corresponding log data according to the different parameters and data governance, filtering and other strategies, and then transmits it to the software performance measurement center through the channel.
[0101] Step 3: Data storage and software performance measurement:
[0102] After receiving the log data of application A, the software performance measurement center stores the data in the hot database for timely retrieval, and then transfers it to the cold database according to the hot and cold storage strategy;
[0103] The database will store a large amount of continuous indicators, logs, and link data of application A, and use the three-dimensional performance measurement method to perform algorithmic analysis and display on the data;
[0104] Through the three-dimensional performance measurement method, the analyzed data is compared with the set alarm strategy to generate software failures or performance alarms, and provide corresponding decision data to help locate the problem, or bind through alarms, set automatic disposal commands and scripts, and perform automated fault handling; faults and alarms can also be assigned to relevant personnel in the form of work orders and notifications for offline processing.
[0105] In this embodiment, determining the performance of application software A according to the specified data includes:
[0106] Extracting the latest specified data of application A from the data source corresponding to the specified data at regular intervals, wherein the specified data includes indicator data, log data and link data;
[0107] Convert log data into standard log data;
[0108] Set up the monitoring model and define the indicator data, standard log data, and link data range to be measured;
[0109] Process the specified data and remove empty and invalid data;
[0110] Metrically correlate indicator data, standard log data, and link data to perform three-dimensional measurements after an alarm occurs;
[0111] Visually display real-time 3D monitoring data and set alarm strategies. When an alarm occurs, calculations are performed based on the associated 3D data. If all associated data are abnormal, the alarm is judged to be a serious risk. When no alarm occurs, the 3D data calculation model compares and analyzes the monitoring performance data within a certain period of time in real time based on scheduled tasks, and issues a performance monitoring report for performance optimization.
[0112] The present disclosure breaks the original problem of difficult data collection and inability to expand operation and maintenance monitoring due to network isolation through communication channels, which makes it impossible for software operation and maintenance of multiple grids to be unified into one platform, or requires a lot of manual adjustments to provide monitoring data. The convenience of operation and maintenance data collection is greatly improved. The problem of disordered and full data reporting is solved through big data governance. The data is effectively reported after data processing at the edge, which can prevent monitoring delays caused by data surge or network jitter, affecting the normal operation of the business system. The three-dimensional software performance measurement technology solves the problems of insufficient software performance parameters, unclear software monitoring effect and long tracing time of abnormal problems. The health of the software and the root causes of the problem are comprehensively analyzed from three perspectives, and the alarm jitter problem caused by less data and incomplete analysis is improved. At the same time, some problems that cannot be discovered due to the depth of the root cause of the problem are also visualized. Data hierarchical storage is used to ensure data security, prevent the software operation and maintenance from stagnating due to data loss at the center, and perform cold and hot processing on the data to improve data utilization.
[0113] The present disclosure uses big data technology and multi-grid intercommunication technology to provide unified data collection, storage, governance, monitoring, alarm, disposal, analysis and display, etc., breaking the original operation and maintenance islands, establishing standard operation and maintenance specifications and systems, and completing software performance data integration and capability improvement. Relying on multi-scenario operation and maintenance adaptation with intelligent operation and maintenance as the core, it maintains the stable and efficient operation of business and operation and maintenance work, and provides a bottom-up standard governance process through hierarchical management of monitoring data. The data-driven operation and maintenance system architecture improves the security of equipment monitoring data transmission, reduces the occupancy of network bandwidth resources, reduces the cost of use, and opens the way for digital and intelligent transformation of operation and maintenance.
[0114] See also Figure 5 , an embodiment of the present disclosure provides a software performance data acquisition device, the device comprising:
[0115] Providing module 11, used to provide a client connection component deployment package for the target server;
[0116] A verification module 12 is used for receiving a connection request from the client connection component after the client connection component is deployed in the target server, verifying the connection request, and sending verification success information to the target server;
[0117] A mapping module 13 is used to receive a channel establishment request initiated by the target server in response to the verification success information, and map a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component;
[0118] The receiving module 14 is used to send a software performance data acquisition request to the target server, receive the returned software performance data, and store the software performance data, wherein the software performance data includes associated indicator data, log data, and link data.
[0119] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.
[0120] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of the present invention. Ordinary technicians in this field can understand and implement it without paying creative work.
[0121] In the above embodiment, any multiple of the providing module 11, the checking module 12, the mapping module 13 and the receiving module 14 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. At least one of the providing module 11, the checking module 12, the mapping module 13 and the receiving module 14 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in any appropriate combination of any of them. Alternatively, at least one of the providing module 11, the checking module 12, the mapping module 13 and the receiving module 14 can be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function can be executed.
[0122] Reference Figure 6 As shown, an electronic device provided by an embodiment of the present invention includes a processor 1110, a communication interface 1120, a memory 1130 and a communication bus 1140, wherein the processor 1110, the communication interface 1120, and the memory 1130 communicate with each other through the communication bus 1140;
[0123] Memory 1130, used for storing computer programs;
[0124] The processor 1110 is used to implement the following method for obtaining software performance data when executing the program stored in the memory 1130:
[0125] Provide the client connection component deployment package to the target server;
[0126] After the client connection component is deployed in the target server, a connection request from the client connection component is received, the connection request is verified, and verification success information is sent to the target server;
[0127] Receiving a channel establishment request initiated by the target server in response to the verification success information, mapping a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component;
[0128] A software performance data acquisition request is sent to a target server, returned software performance data is received, and the software performance data is stored, wherein the software performance data includes associated indicator data, log data, and link data.
[0129] The communication bus 1140 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus 1140 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
[0130] The communication interface 1120 is used for communication between the above electronic device and other devices.
[0131] The memory 1130 may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory 1130 may also be at least one storage device located away from the processor 1110.
[0132] The above-mentioned processor 1110 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
[0133] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for taming the clock of a navigation satellite of an autonomous driving domain controller as described above is implemented.
[0134] The computer-readable storage medium may be included in the device / apparatus described in the above embodiment; or it may exist independently without being assembled into the device / apparatus. The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed, the method for taming the navigation satellite clock of the autonomous driving domain controller according to the embodiment of the present invention is implemented.
[0135] According to an embodiment of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.
[0136] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0137] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.
Claims
1. A method for acquiring software performance data, characterized in that: Applied to a software performance measurement center, the method comprises: Provide the client connection component deployment package to the target server; After the client connection component is deployed in the target server, a connection request from the client connection component is received, the connection request is verified, and verification success information is sent to the target server; Receiving a channel establishment request initiated by the target server in response to the verification success information, mapping a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component; Send a software performance data acquisition request to the target server, receive the returned software performance data, and store the software performance data, wherein the software performance data includes associated indicator data, log data, and link data, Wherein, storing the software performance data includes: Storing the software performance data in full in different types of databases in different formats; Monitor and collect data on the storage status of each database in real time, collect and obtain migration bottleneck status data information, and detect cache adjustment status data information in real time; Data cleaning and feature extraction are performed on the migration bottleneck status data information and cache adjustment status data information, and the processed data information is standardized based on the dimensionless processing technology; Comprehensively analyze and learn the migration bottleneck status data information after data cleaning to obtain the bottleneck factor, and combine it with the number of interruptions that occur during data migration to generate the migration status coefficient; Obtain block size and cache hit rate through cache adjustment status data information after feature extraction, and associate the block size with the cache hit rate to obtain a cache adjustment coefficient, conduct a comprehensive analysis on the cache adjustment coefficient and the migration state coefficient, and generate a software storage performance prediction model by combining with a neural network model and training, and obtain a performance status evaluation index after dimensionless processing; Compare and analyze the preset evaluation threshold with the performance status evaluation index to obtain the prediction result, and obtain the corresponding level improvement strategy based on the prediction result. The cache control coefficient is obtained by the following formula: Among them, Tkxs represents the cache control coefficient, RLz represents the cache capacity, Kds represents the block size, Hcmz represents the cache hit rate, a1 and a2 both represent proportional coefficients, and M2 represents the fourth correction constant.
2. The method according to claim 1, characterized in that The associated indicator data, log data and link data are obtained by the following steps: Convert log data into standard log data; Process the specified data and remove empty and invalid data; According to the timestamp, the removed indicator data, standard log data and link data are associated to obtain the associated indicator data, log data and link data.
3. The method according to claim 1, characterized in that The software performance measurement center includes a grid server, the target server includes a grid client and a target server, and sending a software performance data acquisition request to the target server includes: The grid server sends the software performance data acquisition request to the grid client of the target server; The grid client receives the software performance data acquisition request, calls the data reporting service, extracts data corresponding to the software performance data acquisition request from a local database for storing software performance data, and transmits the data to the grid server.
4. The method according to claim 1, characterized in that: The performance status evaluation index is obtained by the following formula: Among them, TSzs represents the performance situation evaluation index, Ttlz represents the throughput, F1, F2 and F3 represent the proportional coefficients of the cache control coefficient Tkxs, the migration state coefficient Pyxs and the throughput Ttlz respectively, among which, 0.10≤F1≤0.22, 0.15≤F2≤0.36, 0.20≤F3≤0.42, and 0.55≤F1+F2+F3≤1.0, and C represents the first correction constant.
5. A software performance data acquisition device, characterized in that: The device comprises: Provide a module for providing a client connection component deployment package to a target server; A verification module, configured to receive a connection request from the client connection component after the client connection component is deployed in the target server, verify the connection request, and send verification success information to the target server; A mapping module, used to receive a channel establishment request initiated by the target server in response to the verification success information, and map a virtual proxy address corresponding to the target server, so as to realize communication with the target server through data interaction between the virtual proxy address and the client connection component; A receiving module is used to send a software performance data acquisition request to a target server, receive returned software performance data, and store the software performance data, wherein the software performance data includes associated indicator data, log data, and link data. Wherein, storing the software performance data includes: Storing the software performance data in full in different types of databases in different formats; Monitor and collect data on the storage status of each database in real time, collect and obtain migration bottleneck status data information, and detect cache adjustment status data information in real time; Data cleaning and feature extraction are performed on the migration bottleneck status data information and cache adjustment status data information, and the processed data information is standardized based on the dimensionless processing technology; Comprehensively analyze and learn the migration bottleneck status data information after data cleaning to obtain the bottleneck factor, and combine it with the number of interruptions that occur during data migration to generate the migration status coefficient; Obtain block size and cache hit rate through cache adjustment status data information after feature extraction, and associate the block size with the cache hit rate to obtain a cache adjustment coefficient, conduct a comprehensive analysis on the cache adjustment coefficient and the migration state coefficient, and generate a software storage performance prediction model by combining with a neural network model and training, and obtain a performance status evaluation index after dimensionless processing; Compare and analyze the preset evaluation threshold with the performance status evaluation index to obtain the prediction result, and obtain the corresponding level improvement strategy based on the prediction result. The cache control coefficient is obtained by the following formula: Among them, Tkxs represents the cache control coefficient, RLz represents the cache capacity, Kds represents the block size, Hcmz represents the cache hit rate, a1 and a2 both represent proportional coefficients, and M2 represents the fourth correction constant.
6. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory, used to store computer programs; A processor is used to implement the software performance data acquisition method described in any one of claims 1 to 4 when executing a program stored in a memory.
7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for obtaining software performance data according to any one of claims 1 to 4 is implemented.
