Analysis Method, Device, Medium and Electronic Device for Data Storage Object

By crawling and analyzing data request packets, the analysis results of data storage objects are generated, and the problems of low efficiency and insufficient real-time analysis of data storage objects in the prior art are solved, and efficient and accurate data storage objects are realized.

CN113821512BActive Publication Date: 2025-06-10CHINA TELECOM CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111101629.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-18
Publication Date
2025-06-10
Estimated Expiration
2041-09-18

AI Technical Summary

Technical Problem

In the prior art, the running state analysis of data storage objects is low, the real-time performance is not strong, and errors are prone to occur.

Method used

By crawling the data operation request packet sent by the terminal device, analyzing the data packets to obtain the data operation statements, and generating the analysis results of the target data storage object based on the statements, providing an automated real-time analysis method.

Benefits of technology

It improves the efficiency and accuracy of determining the running state analysis results of data storage objects, and realizes automated real-time analysis of data storage objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113821512B_ABST
    Figure CN113821512B_ABST
Patent Text Reader

Abstract

The present disclosure provides an analysis method, device, medium, and electronic device for data storage objects, relating to the technical field of data analysis. The method includes: capturing a data operation request data packet sent by a terminal device; parsing the data operation request data packet to obtain a data operation statement; and generating an analysis result of a target data storage object according to the data operation statement. The present disclosure provides an automated real-time analysis solution for the running state of data storage objects, improving the efficiency and accuracy of determining the analysis result of the running state of data storage objects.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] With the rapid development of the Internet, the data to be processed has expanded rapidly. To facilitate data management, databases have emerged and become the main data management method.

[0003] In related technologies, the data generated by devices in the Internet can be stored in a database. When a device needs to operate on the data in the database, it can send a data operation request to a data service device. The data service device can execute corresponding data operations in response to the data operation request and return a data operation result to the device. Summary of the Invention

[0004] The present disclosure provides a method for analyzing a data storage object, an apparatus for analyzing a data storage object, a computer-readable storage medium, and an electronic device, thereby at least to a certain extent improving the efficiency and accuracy of determining the analysis result of the running state of the data storage object.

[0005] According to a first aspect of the present disclosure, there is provided a method for analyzing a data storage object, the method comprising:

[0006] Capturing a data operation request data packet sent by a terminal device;

[0007] Parsing the data operation request data packet to obtain a data operation statement;

[0008] Generating an analysis result of a target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement.

[0009] According to a second aspect of the present disclosure, there is provided an apparatus for analyzing a data storage object, the apparatus comprising:

[0010] A data packet capturing module configured to capture a data operation request data packet sent by a terminal device;

[0011] A parsing module configured to parse the data operation request data packet to obtain a data operation statement;

[0012] An analysis module configured to generate an analysis result of a target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement.

[0013] According to a third aspect of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, characterized in that the computer program, when executed by a processor, implements the method of the first aspect.

[0014] According to a fourth aspect of the present disclosure, there is provided an electronic device, comprising:

[0015] A processor; and

[0016] a memory for storing executable instructions of the processor;

[0017] wherein the processor is configured to execute the method of the first aspect by executing the executable instructions.

[0018] The technical solution of the present disclosure has the following beneficial effects:

[0019] The present disclosure provides a method, apparatus, medium and electronic device for analyzing data storage objects, and provides an automated real-time analysis method for the operating state of data storage objects. By capturing data operation request data packets sent by a terminal device; parsing the data operation request data packets to obtain data operation statements; generating an analysis result of a target data storage object according to the data operation statements, the efficiency and accuracy of the analysis result for determining the operating state of the data storage object are improved.

[0020] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0022] Figure 1 Showing a schematic architecture diagram of an analysis system for a data storage object in this exemplary embodiment;

[0023] Figure 2 Showing a flowchart of a method for analyzing a data storage object in this exemplary embodiment;

[0024] Figure 3 Showing a schematic flow diagram of generating an analysis result of a target data storage object in this exemplary embodiment;

[0025] Figure 4 Showing a schematic flow diagram of determining operation information of a data operation statement in this exemplary embodiment;

[0026] Figure 5 Showing another schematic flow diagram of generating an analysis result of a target data storage object in this exemplary embodiment;

[0027] Figure 6Schematic diagram showing the structure of an analysis device for a data storage object in this exemplary embodiment;

[0028] Figure 7 Schematic diagram showing the structure of an electronic device in this exemplary embodiment. Detailed implementation manners

[0029] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The features, structures, or characteristics described may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will realize that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be used. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring the various aspects of the present disclosure.

[0030] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0031] The flowcharts shown in the accompanying drawings are only exemplary illustrations and do not necessarily include all steps. For example, some steps can be decomposed, while some steps can be combined or partially combined, so the actual execution order may change according to the actual situation.

[0032] In the related art, an analysis solution for data storage objects has emerged. After receiving a data operation request data packet sent by a data request device, a data service device can obtain relevant information of the data operation request in the data operation request data packet, generate a data operation log of the data storage object, and determine whether the data storage object is abnormal and whether the data storage object is a hot operation object, etc. by manually analyzing the data operation log, so as to obtain an analysis result of the running state of the data storage object and guide database developers to reasonably plan the database. Among them, the data storage object can be a data service device, as well as databases, data tables, and data table shards in the data service device.

[0033] However, the analysis methods for the operating status of data storage objects provided in the related art are generally inefficient, lack real-time performance, and are prone to errors.

[0034] In view of the above problems, exemplary embodiments of the present disclosure provide an analysis method for data storage objects, targeting the analysis scenario of the operating status of data storage objects. The application scenarios of this analysis method for data storage objects include, but are not limited to: a data request device may send a data query request to a data service device. After receiving the data query request, the data service device may parse the data query request to obtain a data query statement, and through analyzing the data query statement, an analysis result of the data storage object requested to be queried by the data query statement can be obtained.

[0035] To implement the above analysis method for data storage objects, exemplary embodiments of the present disclosure provide an analysis system for data storage objects. Figure 1 A schematic architecture diagram of the analysis system for data storage objects is shown. As Figure 1 shown, the analysis system 100 for data storage objects may include a data service device 110 and a data request device 120. Among them, the data service device 110 may be a back-end server of a data service provider. For example, it may be a database server. The data request device 120 may be a terminal device that sends a data operation request data packet to the data server device, and the terminal device may be a computer, a smart phone, a personal computer, a tablet computer, etc. The data server device 110 and the data request device 120 may be connected through a network.

[0036] Among them, a data packet acquisition system may run in the data service device 110. After the data service device 110 obtains the data operation request data packet sent by the data request device 120, it may parse the data operation request data packet to obtain a data operation statement; generate an analysis result of a target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement. Among them, the data packet acquisition system may be determined based on actual needs, and the embodiments of the present disclosure do not limit this. By way of example, the data packet acquisition system may be a packet capture tool, and this packet capture tool may be a tcpcopy tool.

[0037] In an alternative embodiment, the data service device 110 may receive a large number of data operation request data packets at the same time, and the databases in multiple data service devices 110 may be databases of the same service. To quickly and accurately analyze the running status of the target data storage object corresponding to each data operation request data packet, the analysis system 100 of the data storage object may further include a message management server and an analysis device. Among them, after receiving the data operation request data packet, the data service device 110 may parse the data operation request data packet to obtain a data operation statement, and send the data operation statement to the message management server. After receiving the data operation statement, the message management server may push the data operation statement to the analysis device, and the analysis device may generate an analysis result of the target data storage object according to the data operation statement. Among them, the message management server may be a streaming Kafka (Kafka Stream) server, which can obtain the data operation statements sent by the data service device 110 in real time, and send the data operation statements to the analysis device for analysis, improving the analysis efficiency of the running status of the data operation object.

[0038] It should be understood that the server in the analysis system 100 of the data storage object may be a single server or a cluster formed by multiple servers. The present disclosure does not limit the specific architecture of the server.

[0039] Next, from the perspective of the data service device, the analysis method of the data storage object will be described. Figure 2 An exemplary process of the analysis method of the data storage object executed by the data service device is shown, which may include steps S201 to S203:

[0040] Step S201, capture the data operation request data packet sent by the terminal device.

[0041] In the embodiment of the present disclosure, the data service device and the data request device communicate based on a predefined database communication protocol. The data operation request data packet of the data request device can be transmitted according to the database communication protocol. After receiving the data packet transmitted according to the database communication protocol, the data service device captures the data packet to obtain the data operation request data packet.

[0042] Step S202, parse the data operation request data packet to obtain a data operation statement.

[0043] Step S203, generate an analysis result of the target data storage object according to the data operation statement.

[0044] In the embodiment of the present disclosure, the target data storage object is the data storage object requested to be operated in the data operation statement. The data storage object may be a data service device, as well as a database, a data table, or a data table shard in the data service device.

[0045] In summary, the analysis method for data storage objects provided by the embodiments of the present disclosure can capture data operation request data packets, parse the data operation request data packets to obtain data operation statements, and determine the analysis results of the data storage objects corresponding to the data operation requests by analyzing the data operation statements, providing an automated analysis solution for the running status of data storage objects, and improving the efficiency and accuracy of determining the analysis results of the running status of data storage objects.

[0046] In an alternative embodiment, in the above step S201, the data service device may capture the data operation request data packet sent by the terminal device.

[0047] Among them, a packet capture tool may be running in the data service device, which can capture the data operation request data packet sent by the terminal device. The process of the data service device capturing the data operation request data packet sent by the terminal device may include: after receiving any data packet, the data service device may call the packet capture tool to analyze the data packet. If it is determined that the data packet is a data packet transmitted based on the database communication protocol, it may be determined that the data packet is a data operation request data packet, and the data operation request data packet is captured.

[0048] Optionally, the data operation request data packet may include an information field and the data type corresponding to the information field. Among them, the information field includes: systemId, indicating the operating system information of the data request device; appId, indicating the application program information corresponding to the data operation request triggered in the data request device; nodeflag, indicating the identification information of the data service device receiving the data operation request; keyword, indicating the keyword information of the data operation statement, beginTime, indicating the generation time of the data operation request data packet, and beginTime, indicating the latest processing time of the data operation request data packet.

[0049] In an alternative embodiment, in the above step S202, the data service device may parse the data operation request data packet to obtain the data operation statement.

[0050] Among them, the process of the data service device parsing the data operation request data packet to obtain the data operation statement may include: parsing the data operation request data packet using the database communication protocol to obtain data operation request information. The data operation request information may include: data operation statement, information of the data request device, generation time of the data operation request data packet, and latest processing time of the data operation request data packet. By way of example, the information of the data request device may include the information of the data request device and / or the application program information corresponding to the data operation request triggered in the data request device.

[0051] In an alternative embodiment, if the analysis system of the data storage object further includes a message management server and an analysis device, after parsing the data operation request to obtain the data operation statement, the data service device may further send the data operation statement to the message management server; the message management server may, after receiving the data operation statement sent by the data service device, push it to the analysis device, so that the analysis device, in response to receiving the data operation statement sent by the message management server, generates an analysis result of the target data storage object according to the data operation statement. Among them, the message management server may be a streaming Kafka server, which can receive and push data operation statements in a timely manner, further improving the timeliness of analyzing the running state of the data storage object.

[0052] Optionally, before sending the data operation statement to the message management server, the data operation statement may be compressed, and the compressed data operation statement is sent to the message management server, which can reduce the data volume and the network pressure during the transmission of the data operation statement. Among them, the compression process may be determined based on the type of data used to manage the database in the data service device, and the embodiments of the present disclosure do not limit this. By way of example, if the database is MySQL (structured query language, relational database), the compression process may be to perform fingerprint extraction on the data operation statement to obtain the compressed data request statement.

[0053] Optionally, after receiving the data operation statement, the message management server may store the data operation statement according to the red-black tree data storage structure, which is convenient for the quick storage and extraction of the data operation statement.

[0054] In an alternative embodiment, in step S203 above, the data service device may generate an analysis result of the target data storage object according to the data operation statement.

[0055] Among them, as Figure 3 shown, the process by which the data service device generates an analysis result of the target data storage object according to the data operation statement may include steps S301 to S302:

[0056] Step S301: Perform statement analysis on the data operation statement to obtain the operation information of the data operation statement.

[0057] In this step S301, the data service device may perform statement analysis on the data operation statement to obtain the operation information of the data operation statement.

[0058] Among them, as Figure 4As shown. The process by which the data service device performs statement analysis on the data operation statement to obtain the operation information of the data operation statement may include steps S401 to S402:

[0059] Step S401: Perform statement analysis on the data operation statement to obtain the keywords of the data operation statement.

[0060] Among them, the process by which the data service device performs statement analysis on the data operation statement to obtain the keywords of the data operation statement may include: determining the data operation type field in the data operation statement, determining the corresponding keyword extraction rule according to the data operation type field to obtain the target keyword extraction rule, and using the target keyword extraction rule to parse the data operation statement to obtain the keywords of the data operation statement. Among them, the keywords of the data operation statement may include the target data storage object requested to be operated by the data operation statement and the data operation condition of the data operation statement. Among them, the data operation type may be a data query operation, a data deletion operation, a data modification operation, or a data deletion operation, etc. The data operation condition may be a restriction condition on the data acquisition range or a threshold condition, etc.

[0061] It should be noted that in the embodiments of the present disclosure, the keyword extraction rules corresponding to different operation type fields may be predefined in advance. After determining the data operation type field in the data operation statement, the keyword extraction rule corresponding to the data operation type field may be determined. It can be understood that based on this keyword extraction rule, the target data storage object in the data operation statement can be determined.

[0062] For example, if the data operation statement M1 is to query the age information of user identifiers a1, a2, and a5 from the data table a in database A, it can be determined that the data operation type field in the data operation statement M1 is "query", and the keywords in the data operation statement M1 can be extracted according to the keyword extraction rule corresponding to the query operation, including the target data storage object: database A, and the query condition: user identifiers a1, a2, and a5.

[0063] Step S402: Determine the operation information of the data operation statement according to the keywords of the data operation statement.

[0064] In an alternative embodiment, the process of determining the operation information of a data operation statement by a data service device may include: obtaining historical execution frequency information of a target data storage object; determining the current execution frequency information of the target data storage object according to the historical execution frequency information; combining the target data storage object and the current execution frequency information of the target data storage object to obtain the operation information of the data operation statement. Among them, the historical execution frequency information may include the historical execution times and / or the historical execution frequency. The historical execution times are the number of times the target data storage object executes the data operation statement in response to the data operation statement within a preset historical duration; the historical execution frequency is the frequency at which the target data storage object executes the data operation statement in response to the data operation statement within a preset historical duration; the preset historical duration can be determined based on actual needs, and the embodiments of the present disclosure do not limit this. By way of example, the preset historical duration may be 2 hours before the moment when the data operation request data packet is obtained.

[0065] Among them, the process of determining the current execution frequency information of the target data storage object according to the historical execution frequency information may include: determining the sum of the historical execution times of the target data storage object and a reference value to obtain the current execution times of the target data storage object, and determining the ratio of the current execution times of the target data storage object to the preset historical duration to obtain the current execution frequency of the target data storage object. Among them, the reference value is 1.

[0066] By way of example, if the target data storage object in the data operation statement is data table A2 in database A, and the preset historical duration is 1 hour, and within 1 hour before the moment when the operation request data packet for data table A2 in database A is captured, the number of operation request data packets received for data table A2 in database A is 9, then it is determined that the historical execution frequency information of data table A2 in database A includes: the historical execution times of data table A2 in database A are 9 times, and the historical execution frequency of data table A2 in database A is 0.15 times per minute. Then it is determined that the current execution frequency information of data table A2 in database A includes: the current execution times of data table A2 in database A are 10, and the current execution frequency of data table A2 in database A is 0.17 times per minute, and the current execution frequency information of data table A2 in database A and data table A2 in database A are combined to obtain the operation information of the data operation statement.

[0067] In an alternative embodiment, the process by which the data service device determines the operation information of the data operation statement based on the keyword of the data operation statement may include: obtaining the historical response times of the data operation statement corresponding to the target data storage object; determining the current response times of the data operation statement corresponding to the target data storage object based on the historical response times, so as to obtain the operation information of the data operation statement. Among them, the historical response times of the data operation statement corresponding to the target data storage object may be the number of times the target data storage object responds to the same data operation statement within a preset historical duration; the same data operation statement may include a statement that is exactly the same as the data operation statement, or a statement with the same operation type as the data operation statement, and the preset historical duration may be determined based on actual needs, and the embodiments of the present disclosure do not limit this. For example, if the data operation statement is an operation statement for querying all information of data table A5 in database A, and the preset historical duration is 1 hour, then the historical response times of the data operation statement corresponding to the target data storage object may be the number of times data table A5 in database A responds to the operation statement for querying all information of data table A5 in database A within the past 1 hour.

[0068] Among them, the process of determining the current response times of the data operation statement corresponding to the target data storage object based on the historical response times may include: determining the sum of the historical response times and a reference value to obtain the current response times of the data operation statement corresponding to the target data storage object, where the reference value is 1.

[0069] For example, if the data operation statement is an operation statement for querying all information of data table A5 in database A, the preset historical duration is 1 hour, and within 1 hour before the moment when the operation request data packet regarding data table A5 in database A is captured, the number of times data table A5 in database A responds to the query of all its information is 6 times, then it is determined that the current response times of the operation statement for querying all information of data table A5 in database A is 7 times.

[0070] Step S302: Process the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object.

[0071] In this step S302, the data service device may process the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object.

[0072] Among them, the operation information of the data operation statement may include the current execution times of the target data storage object, such as Figure 5 As shown, the process by which the data service device processes the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object may include steps S501 to S507:

[0073] Step S501: Obtain the execution times threshold of the target data storage object.

[0074] In the embodiments of the present disclosure, the execution times threshold of the target data storage object is the reference execution times for determining whether the target data storage object runs abnormally. The execution times threshold of the target data storage object can be determined based on actual needs, and the embodiments of the present disclosure do not limit this.

[0075] Step S502: Determine whether the current execution times of the target data storage object is greater than the execution times threshold of the target data storage object.

[0076] Step S503: If the current execution times of the target data storage object is not greater than the execution times threshold of the target data storage object, determine that the target data storage object runs normally, and end the operation.

[0077] Step S504: If the current execution times of the target data storage object is greater than the execution times threshold of the target data storage object, obtain the record information of the target data storage object.

[0078] Step S505: Determine whether the record information of the target data storage object indicates that the target data storage object is an abnormal target data storage object.

[0079] Step S506: If the record information indicates that the target data storage object is a non-abnormal target data storage object, determine that the target data storage object is an abnormal target data storage object, and update the record information of the target data storage object to obtain the analysis result of the target data storage object, where the analysis result of the target data storage object is used to indicate that the target data storage object is marked as an abnormal data storage object.

[0080] Step S507: If the record information indicates that the target data storage object is an abnormal target data storage object, obtain the analysis result of the target data storage object according to the analysis rule of the abnormal target data storage object.

[0081] Among them, the process of obtaining the analysis result of the target data storage object according to the analysis rule of the abnormal target data storage object may include: determining the time difference between the time when the data operation request data packet is captured and the time when the target data storage object was last determined to be an abnormal target data storage object; if the time difference is greater than the preset detection duration, generating a running report of the abnormal target data storage object to obtain the analysis result of the target data storage object; among them, the running report of the abnormal target data storage object may include the time when the abnormal target data storage object was last determined to be an abnormal target data storage object, the time when the abnormal target data storage object was determined to be an abnormal target data storage object this time, and information such as the current execution times of the abnormal target data storage object, and the running status of the data storage object can be analyzed from the dimension of the execution times of the data operation statement by the target data storage object.

[0082] If the time difference is not greater than the preset detection duration, it is determined that the abnormal target data storage object is a non-abnormal target data storage object, and the record information of the target data storage object is updated to obtain the analysis result of the target data storage object, where the analysis result of the target data storage object is used to indicate that the target data storage object is marked as a non-abnormal data storage object.

[0083] In an alternative embodiment, the operation information of the data operation statement includes the current response times of the data operation statement corresponding to the target data storage object. The process of the data service device processing the operation information of the data operation statement according to the preset rule to obtain the analysis result of the target data storage object may include: if the current response times of the data operation statement are greater than the response times threshold of the data operation statement corresponding to the target data storage object, it is determined that the data operation statement is a high-frequency operation statement of the target data storage object to obtain the analysis result of the target data storage object. Among them, the response times threshold of the data operation statement corresponding to the target data storage object is a reference operation times for judging whether the number of times the target data storage object responds to the same data operation statement is abnormal. The response times threshold of the data operation statement corresponding to the target data storage object can be determined based on actual needs, and the embodiments of the present disclosure do not limit this. The running status of the data storage object can be analyzed from the dimension of the response times of the target data storage object to the same data operation statement, further improving the accuracy of analyzing the running status of the data storage object.

[0084] In an alternative embodiment, if the analysis system of the data storage object further includes a message management server and an analysis device, the analysis device may generate an analysis result of the target data storage object according to the data operation statement. The process by which the analysis device generates an analysis result of the target data storage object according to the data operation statement may refer to the process by which the data service device generates an analysis result of the target data storage object according to the data operation statement in the foregoing embodiment, and this embodiment of the present disclosure will not elaborate on this.

[0085] Optionally, in the embodiments of the present disclosure, after generating the analysis result of the target data storage object, the analysis result of the target storage object may be displayed, or the target analysis result may be sent to the terminal device used by the database developer to facilitate the optimization of the database.

[0086] The embodiments of the present disclosure provide an analysis device for a data storage object, such as Figure 6 shown, the analysis device 600 for the data storage object includes:

[0087] A data packet capture module 601, configured to capture a data operation request data packet sent by a terminal device;

[0088] A parsing module 602, configured to parse the data operation request data packet to obtain a data operation statement;

[0089] An analysis module 603, configured to generate an analysis result of the target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement.

[0090] In an alternative embodiment, the analysis module 603 is configured to:

[0091] Perform statement analysis on the data operation statement to obtain operation information of the data operation statement;

[0092] Process the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object.

[0093] In an alternative embodiment, the analysis module 603 is configured to:

[0094] Perform statement analysis on the data operation statement to obtain keywords of the data operation statement;

[0095] Determine the operation information of the data operation statement according to the keywords of the data operation statement.

[0096] In an alternative embodiment, the keyword includes the target data storage object, and the analysis module 603 is configured to:

[0097] Obtain the historical execution frequency information of the target data storage object;

[0098] Determine the current execution frequency information of the target data storage object according to the historical execution frequency information;

[0099] Combine the target data storage object and the current execution frequency information of the target data storage object to obtain the operation information of the data operation statement.

[0100] In an alternative embodiment, the keyword includes the target data storage object, and the analysis module 603 is configured to:

[0101] Obtain the historical response times of the data operation statement corresponding to the target data storage object;

[0102] Determine the current response times of the data operation statement corresponding to the target data storage object according to the historical response times to obtain the operation information of the data operation statement.

[0103] In an alternative embodiment, the operation information of the data operation statement includes the current execution times of the target data storage object, and the analysis module 603 is configured to:

[0104] If the current execution times of the target data storage object are greater than the execution times threshold of the target data storage object, obtain the record information of the target data storage object;

[0105] If the record information indicates that the target data storage object is an abnormal target data storage object, obtain the analysis result of the target data storage object according to the abnormal target data storage object analysis rule.

[0106] In an alternative embodiment, the analysis module 603 is configured to:

[0107] Determine the time difference between the time when the data operation request data packet is captured and the time when the target data storage object was last determined to be an abnormal target data storage object;

[0108] If the time difference is greater than the preset detection duration, generate an operation report of the abnormal target data storage object to obtain the analysis result of the data target data storage object.

[0109] In an alternative embodiment, the operation information of the data operation statement includes the current response times of the data operation statement corresponding to the target data storage object, and the analysis module 603 is configured to:

[0110] If the current response times of the data operation statement are greater than the response times threshold of the data operation statement corresponding to the target data storage object, determine that the data operation statement is a high-frequency operation statement of the target data storage object to obtain the analysis result of the target data storage object.

[0111] In an alternative embodiment, after parsing the data operation request to obtain the data operation statement, as Figure 6 shown, the analysis device 600 of the data storage object further includes a sending module 604, configured to:

[0112] Send the data operation statement to the message management server;

[0113] Generate an analysis result of the target data storage object according to the data operation statement, including:

[0114] The analysis device generates an analysis result of the target data storage object in response to receiving the data operation statement sent by the message management server according to the data operation statement.

[0115] Exemplary embodiments of the present disclosure also provide a computer-readable storage medium, which can be implemented in the form of a program product, including program code. When the program product runs on an electronic device, the program code is used to cause the electronic device to execute the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of this specification. In one embodiment, the program product can be implemented as a portable compact disc read-only memory (CD-ROM) and includes program code, and can run on an electronic device, such as a personal computer. However, the program product of the present disclosure is not limited to this. In this document, the readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device.

[0116] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive list) of the readable storage medium include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0117] The computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which the readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable signal medium can also be any readable medium other than the readable storage medium, and this readable medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device.

[0118] The program code contained on a readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the above.

[0119] The program code for performing the operations of the present disclosure can be written in any combination of one or more programming languages. The programming languages include object-oriented programming languages such as Java, C++, etc., and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., by connecting through the Internet using an Internet service provider).

[0120] Exemplary embodiments of the present disclosure also provide an electronic device, which can be a back-end server of a data service device. The following refers to Figure 7 for an explanation of this electronic device. It should be understood that Figure 7 the electronic device 700 shown is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0121] As Figure 7 shown, the electronic device 700 is presented in the form of a general-purpose computing device. The components of the electronic device 700 may include but are not limited to: at least one processing unit 710, at least one storage unit 720, and a bus 730 connecting different system components (including the storage unit 720 and the processing unit 710).

[0122] Among them, the storage unit stores program code, and the program code can be executed by the processing unit 710, so that the processing unit 710 executes the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section of this specification. For example, the processing unit 710 can execute method steps such as Figure 2 shown.

[0123] The storage unit 720 may include a volatile storage unit, such as a random access storage unit (RAM) 721 and / or a cache storage unit 722, and may further include a read-only storage unit (ROM) 723.

[0124] The storage unit 720 may also include a program / utilities 724 having a set (at least one) of program modules 725. Such program modules 725 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment.

[0125] The bus 730 may include a data bus, an address bus, and a control bus.

[0126] The electronic device 700 may also communicate with one or more external devices 800 (such as a keyboard, a pointing device, a Bluetooth device, etc.). Such communication may be through the input / output (I / O) interface 740. The electronic device 700 may also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 750. As shown in the figure, the network adapter 750 communicates with other modules of the electronic device 700 through the bus 730. It should be understood that although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0127] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, such a division is not mandatory. In fact, according to the exemplary embodiments of the present disclosure, the features and functions of two or more of the above-described modules or units may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided and embodied by multiple modules or units.

[0128] Those skilled in the art to which the present disclosure pertains can understand that various aspects of the present disclosure can be implemented as a system, a method, or a program product. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as "circuits", "modules", or "systems" here. After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily think of other embodiments of the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.

[0129] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only defined by the appended claims.

Claims

1. A method for analyzing a data storage object, characterized in that, the method includes: capturing a data operation request data packet sent by a terminal device; parsing the data operation request data packet to obtain a data operation statement; generating an analysis result of a target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement; the generating an analysis result of a target data storage object according to the data operation statement includes: performing statement analysis on the data operation statement to obtain operation information of the data operation statement; processing the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object; the operation information of the data operation statement includes the current response times of the data operation statement corresponding to the target data storage object, and the processing the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object includes: if the current response times of the data operation statement are greater than the response times threshold of the data operation statement corresponding to the target data storage object, determining that the data operation statement is a high-frequency operation statement of the target data storage object and obtaining an analysis result of the target data storage object; the operation information of the data operation statement includes the current execution times of the target data storage object, and the processing the operation information of the data operation statement according to a preset rule to obtain an analysis result of the target data storage object includes: if the current execution times of the target data storage object are greater than the execution times threshold of the target data storage object, obtaining record information of the target data storage object; if the record information indicates that the target data storage object is an abnormal target data storage object, obtaining an analysis result of the target data storage object according to the abnormal target data storage object analysis rule; the obtaining an analysis result of the target data storage object according to the abnormal target data storage object analysis rule includes: determining a time difference between the time when the data operation request data packet is captured and the time when the target data storage object was last determined to be an abnormal target data storage object; if the time difference is greater than a preset detection duration, generating an operation report of the abnormal target data storage object and obtaining an analysis result of the target data storage object.

2. The method according to claim 1, characterized in that, the performing statement analysis on the data operation statement to obtain operation information of the data operation statement includes: performing statement analysis on the data operation statement to obtain keywords of the data operation statement; determining the operation information of the data operation statement according to the keywords of the data operation statement.

3. The method according to claim 2, characterized in that, the keywords include a target data storage object, and the determining the operation information of the data operation statement according to the keywords of the data operation statement includes: obtaining historical execution frequency information of the target data storage object; Determine the current execution frequency information of the target data storage object according to the historical execution frequency information; Combine the target data storage object and the current execution frequency information of the target data storage object to obtain the operation information of the data operation statement.

4. The method according to claim 2, wherein, the keyword includes a target data storage object, and determining the operation information of the data operation statement according to the keyword of the data operation statement includes: Obtain the historical response times of the data operation statement corresponding to the target data storage object; Determine the current response times of the data operation statement corresponding to the target data storage object according to the historical response times to obtain the operation information of the data operation statement.

5. The method according to claim 1, wherein, after parsing the data operation request to obtain the data operation statement, the method further includes: Send the data operation statement to the message management server; Generating an analysis result of the target data storage object according to the data operation statement includes: The analysis device, in response to receiving the data operation statement sent by the message management server, generates an analysis result of the target data storage object according to the data operation statement.

6. An analysis device for a data storage object, wherein, the device includes: A data packet capture module configured to capture data operation request data packets sent by a terminal device; A parsing module configured to parse the data operation request data packets to obtain data operation statements; An analysis module configured to generate an analysis result of a target data storage object according to the data operation statement, where the target data storage object is the data storage object requested to be operated in the data operation statement; Generating an analysis result of the target data storage object according to the data operation statement is configured to: Perform statement analysis on the data operation statement to obtain the operation information of the data operation statement; Process the operation information of the data operation statement according to a preset rule to obtain the analysis result of the target data storage object; The operation information of the data operation statement includes the current response times of the data operation statement corresponding to the target data storage object, and processing the operation information of the data operation statement according to a preset rule to obtain the analysis result of the target data storage object is configured to: If the current response times of the data operation statement are greater than the response times threshold of the data operation statement corresponding to the target data storage object, determine that the data operation statement is a high-frequency operation statement of the target data storage object to obtain the analysis result of the target data storage object; The operation information of the data operation statement includes the current execution times of the target data storage object, and processing the operation information of the data operation statement according to a preset rule to obtain the analysis result of the target data storage object is configured to: If the current execution times of the target data storage object are greater than the execution times threshold of the target data storage object, obtain the record information of the target data storage object; If the recorded information indicates that the target data storage object is an abnormal target data storage object, obtain the analysis result of the target data storage object according to the analysis rules for abnormal target data storage objects; The obtaining of the analysis result of the target data storage object according to the analysis rules for abnormal target data storage objects is configured to: Determine the time difference between the time when the data operation request data packet is captured and the time when the target data storage object was last determined to be an abnormal target data storage object; If the time difference is greater than a preset detection duration, generate an operation report for the abnormal target data storage object to obtain the analysis result of the target data storage object.

7. A computer-readable storage medium, on which a computer program is stored, wherein, the computer program, when executed by a processor, implements the method according to any one of claims 1 to 5.

8. An electronic device, wherein, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the method according to any one of claims 1 to 5 by executing the executable instructions.

Citation Information

Patent Citations

  • Data packet analysis method and device

    CN105608202A

  • Method and device for migrating database data

    CN106970920A