Data playback method and device, computer equipment and storage medium

Abstract

The invention discloses a data playback method and device, computer equipment and a storage medium, and belongs to the technical field of big data. According to the application, the service project development document is analyzed, the core service data is identified, the data flow of the service system is monitored, the associated service data link is determined, the key concerned target interception point is accurately positioned in combination with the core service data, and the recording component and the data interceptor in the preset data playback platform are utilized to replay the service project development document. According to the method, data recording and interception of a target interception point in a target service data link are achieved, local interception data are captured, the local interception data are marked and then stored in a system database, when a data playback instruction is received, the system retrieves the corresponding local interception data according to an interception point identifier in the instruction, and data playback is achieved. The invention relates to the technical field of block chains. Business data is stored on a block chain node. The flexibility and accuracy of data playback are improved through local data interception.

Description

Technical Field

[0001] The present application belongs to the field of big data technology, and specifically relates to a data playback method, device, computer equipment and storage medium. Background Art

[0002] Data playback refers to the process of re-presenting stored or recorded data through specific technical means. The data playback process is widely used in many fields, such as radar, communication, hydroacoustic telemetry, remote sensing, seismic survey, and vehicle operation data monitoring. The main purpose of data playback is to facilitate users to view, analyze and calculate historical data. Through data playback, users can more intuitively understand the changing trends, characteristic information and possible problems of the data, thereby providing strong support for subsequent signal processing, decision making, etc.

[0003] At present, data playback technology widely relies on the method of full data recording to ensure the true restoration of the test environment. However, for complex systems, the amount of data generated by this full recording method will explode as the system runs longer, and may reach tens of GB or even TB levels. This not only puts higher requirements on storage media, but also makes the processing of data during recording, transmission, storage and playback extremely time-consuming and resource-intensive, affecting the test efficiency and the system's rapid iteration capabilities. Summary of the invention

[0004] The purpose of the embodiments of the present application is to propose a data playback method, apparatus, computer equipment and storage medium to solve the technical problems of the existing data recording-based data playback method, which is time-consuming, occupies excessive memory, and affects the test efficiency and the system's rapid iteration capability.

[0005] In order to solve the above technical problems, the present application provides a data playback method, which adopts the following technical solutions:

[0006] A data playback method is applied to a data playback platform, the data playback platform includes a recording component and a data interceptor, and the method includes:

[0007] Obtain the development documents of the business project and identify the core business data of the business project from the development documents;

[0008] Monitor the data flow of the business system, determine the business data link associated with the development document, and obtain the target business data link;

[0009] Determine the target interception point in the target business data link based on the core business data;

[0010] Use the recording component to record the data section of the target business data link, and use the data interceptor to intercept the data at the target interception point during the data recording process to obtain local interception data;

[0011] Use the target interception point to mark the local interception data, and store the marked local interception data in the database of the business system;

[0012] Receive a data playback instruction, obtain an interception point identifier carried in the data playback instruction, determine partial interception data to be played back according to the interception point identifier, and output the partial interception data to be played back.

[0013] Furthermore, the steps of obtaining the development documents of the business project and identifying the core business data of the business project from the development documents specifically include:

[0014] Use the preset document parsing tool to parse the development document and obtain the document parsing result;

[0015] Identify a data structure of a document parsing result, wherein the data structure of the document parsing result includes a string structure, a tree structure, and a nested data structure;

[0016] Obtain matching core business identification rules based on the data structure of the document parsing results;

[0017] Identify the core business data of the business project in the document parsing results based on the core business identification rules.

[0018] Furthermore, the data flow of the business system is monitored, and the business data link associated with the development document is determined to obtain the target business data link, which specifically includes:

[0019] Use the preset API interface to monitor the data flow of the business system and obtain monitoring data;

[0020] Encapsulate the monitoring data into a message format, and send the monitoring data encapsulated into a message format to the message queue of the business system;

[0021] Consume the messages in the message queue and obtain the message consumption results;

[0022] The message consumption result and the document parsing result are compared, and the business data link associated with the development document in the data flow is determined according to the data comparison result to obtain the target business data link.

[0023] Further, a data comparison is performed on the message consumption result and the document parsing result, and a business data link associated with the development document in the data flow is determined according to the data comparison result to obtain a target business data link, specifically including:

[0024] Identify the data structure of the message consumption result;

[0025] Compare the data structure of the document parsing result with the data structure of the message consumption result to obtain a data structure comparison result;

[0026] Extract keywords from the document parsing results to obtain document keywords;

[0027] Extract keywords from the message consumption results to obtain message keywords;

[0028] Compare the document keywords with the message keywords to obtain keyword comparison results;

[0029] Determine the relevance of the message to the development document based on the data structure comparison results and the keyword comparison results;

[0030] The business data link associated with the development document in the data flow is determined according to the association degree, and the target business data link is obtained.

[0031] Further, the step of using a recording component to record a data section of a target service data link, and using a data interceptor to intercept data at a target interception point during the data recording process to obtain local interception data specifically includes:

[0032] Determine the service start point and service end point of the target service data link;

[0033] Record the data section of the target service data link from the service start point until the service end point;

[0034] During data recording, obtain the data interception rules corresponding to the target interception point;

[0035] The target interception point is captured by using the data interceptor, and the context data of the target interception point is intercepted based on the data interception rule to obtain the local interception data.

[0036] Furthermore, the data interception rule includes a class name and a context object, a data interceptor is used to capture a target interception point, and context data of the target interception point is intercepted based on the data interception rule to obtain a step of local interception data, specifically including:

[0037] Parse the data interception rules to obtain the class name and context object corresponding to the target interception point;

[0038] Use the data interceptor to capture the target interception point based on the class name corresponding to the target interception point;

[0039] Determine the context interception range of the target interception point based on the context object;

[0040] The context data of the target interception point is intercepted according to the context interception range to obtain local interception data.

[0041] Furthermore, the context object includes a rule processor chain and a rule configuration class, and before the step of obtaining the data interception rule corresponding to the target interception point, it also includes:

[0042] Create a rule configuration class corresponding to the target interception point and initialize the rule configuration class;

[0043] Get the rule context object corresponding to the target interception point;

[0044] Create a rule processor corresponding to the target interception point and instantiate the rule processor;

[0045] Pass the rule context object to the instantiated rule processor to obtain the context object rule processor;

[0046] Associate the initialized rule configuration class with the context object rule processor;

[0047] The associated context object rule processors are sorted according to the timestamp of the target interception point to obtain a rule processor chain.

[0048] In order to solve the above technical problems, the embodiment of the present application further provides a data playback device, which adopts the following technical solution:

[0049] A data playback device is provided with a data playback platform, the data playback platform includes a recording component and a data interceptor, and the device includes:

[0050] A business identification module is used to obtain the development documents of a business project and identify the core business data of the business project from the development documents;

[0051] The data flow monitoring module is used to monitor the data flow of the business system, determine the business data link associated with the development document, and obtain the target business data link;

[0052] An interception point identification module, used to determine a target interception point in a target service data link based on core service data;

[0053] The data interception module is used to use the recording component to perform data section recording on the target business data link, and use the data interceptor to intercept data at the target interception point during the data recording process to obtain local interception data;

[0054] A data storage module, used to mark the local interception data using the target interception point, and store the marked local interception data in the database of the business system;

[0055] The data playback module is used to receive a data playback instruction, obtain an interception point identifier carried in the data playback instruction, determine the local interception data to be played back according to the interception point identifier, and output the local interception data to be played back.

[0056] In order to solve the above technical problems, the embodiment of the present application further provides a computer device, which adopts the following technical solution:

[0057] A computer device comprises a memory and a processor, wherein the memory stores computer-readable instructions, and the processor implements the steps of any one of the above-mentioned data playback methods when executing the computer-readable instructions.

[0058] In order to solve the above technical problems, the embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solution:

[0059] A computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the steps of the data playback method described in any one of the above are implemented.

[0060] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0061] The present application discloses a data playback method, device, computer equipment and storage medium, which belongs to the field of big data technology. The present application parses business project development documents to identify core business data, monitors the data flow of the business system, determines the associated business data link, and accurately locates the target interception point of focus in combination with the core business data, and uses the recording components and data interceptors in the preset data playback platform to realize data recording and interception of the target interception point in the target business data link, capture local interception data, and store the local interception data in the system database after marking. When a data playback instruction is received, the system retrieves the corresponding local interception data according to the interception point identifier in the instruction to realize data playback. The present application realizes efficient data recording and local data interception by identifying the business data link and the interception point corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while speeding up the data playback speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the scheme in the present application, a brief introduction is given below to the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0063] Figure 1An exemplary system architecture diagram is shown in which the present application can be applied;

[0064] Figure 2 A flow chart showing an embodiment of a data playback method according to the present application is shown;

[0065] Figure 3 A schematic structural diagram of an embodiment of a data playback device according to the present application is shown;

[0066] Figure 4 A schematic structural diagram of an embodiment of a computer device according to the present application is shown. DETAILED DESCRIPTION

[0067] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of the present application; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present application; the terms "including" and "having" and any variations thereof in the specification and claims of the present application and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present application or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

[0068] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0069] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0070] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0071] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0072] Terminal devices 101, 102, 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop computers, desktop computers, etc.

[0073] Server 105 can be a server that provides various services, such as a background server that provides support for pages displayed on terminal devices 101, 102, and 103. The server can be an independent server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (CDNs), and big data and artificial intelligence platforms.

[0074] It should be noted that the data playback method provided in the embodiment of the present application is generally executed by a server, and accordingly, the data playback device is generally arranged in the server.

[0075] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0076] Continue to refer Figure 2 , showing a flow chart of an embodiment of the data playback method according to the present application. The embodiment of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0077] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0078] This embodiment discloses a data playback method, which is applied to a data playback platform. The data playback platform includes a recording component and a data interceptor. The data playback method includes the following specific implementation steps:

[0079] S201, obtaining development documents of a business project, and identifying core business data of the business project from the development documents.

[0080] After parsing the development document of the business project using a preset document parsing tool, the core business data of the business project in the development document can be obtained. Among them, the preset document parsing tool can be a parser based on regular expressions, an XML parser, a JSON parser, etc. The specific parser type selection depends on the structure of the original document, which is not limited in this application.

[0081] Specifically, the system first needs to access and parse the development documents of the business project. Automated tools scan the document content, such as regular expression-based parsers, XML parsers, JSON parsers and other automated document parsing tools, to identify key business logic and data structures. By analyzing the descriptions and definitions in the development documents, the core business data of the business project, such as user information, transaction records, etc., are identified.

[0082] S202, monitoring the data flow of the business system, and determining the business data link associated with the development document to obtain the target business data link.

[0083] Business data link refers to a series of paths and processes in the business system, from data generation, transmission, processing to storage. Business data link ensures the integrity and consistency of business data. Business data link includes multiple links, such as data collection points, data transmission channels, data processing units, and data storage warehouses. Each link has a specific task and together constitutes the circulation and management system of business data.

[0084] In the process of data link identification, the various link nodes through which the data flow passes can be determined by monitoring network traffic, analyzing packet header information, and tracking the data processing logic in the system. At the same time, combined with the architecture design of the business system, network topology, and the logical relationship of data flow, a complete view of the data link can be constructed to achieve accurate identification of the data flow and clear definition of the data link.

[0085] Specifically, after determining the core business data, the real-time data flow of the business system is monitored. By deploying data flow monitoring components, such as API interfaces for data flows, the system can capture the flow of data in the business system and identify the data links associated with the development documents based on the information in the development documents, so as to facilitate subsequent data recording. The key to this step is the real-time and accuracy of data flow monitoring, that is, the system needs to respond quickly to changes in data flows and accurately match the target business data links.

[0086] S203: Determine a target interception point in a target business data link based on the core business data.

[0087] Specifically, the system determines specific target interception points in the target business data link based on the core business data. These target interception points are usually key data processing or transmission links in the data flow, such as database operations, API calls, etc. The system selects the most critical interception points in the data flow based on the characteristics of the core business data and business needs to ensure that the most valuable data fragments can be captured.

[0088] S204, use the recording component to perform data section recording on the target business data link, and use the data interceptor to intercept data at the target interception point during the data recording process to obtain local interception data.

[0089] Data slice recording is a technical means to capture and record the flow and changes of specific data links or data points in real time during the data processing process. Data slice recording allows the system to "slice" the selected data stream without interfering with the normal business process, and record the details of the data in each link such as transmission, processing, and storage.

[0090] Specifically, the data playback platform includes a recording component and a data interceptor. After determining the target interception point, the system uses the recording component to record the data section of the target business data link, and captures and records the data flow on the selected link in real time without interfering with the normal business process. At the same time, the data interceptor implements precise interception at the target interception point and captures the local interception data passing through the point.

[0091] By utilizing the recording components and data interceptors in the preset data playback platform, data recording and interception of the target interception point in the target business data link can be realized, and local interception data can be captured and stored in the system database after being marked, so as to realize efficient data recording and local data interception. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, and the data playback speed is accelerated.

[0092] S205, marking the local interception data using the target interception point, and storing the marked local interception data in a database of the business system.

[0093] Specifically, after obtaining the local interception data, the system uses the target interception point to mark the data. The marking process includes adding the timestamp, business identifier, operation type and other information of the target interception point to facilitate subsequent data management and query. Subsequently, the system stores the marked local interception data in the database of the business system.

[0094] S206, receiving a data playback instruction, obtaining an interception point identifier carried in the data playback instruction, determining partial interception data to be played back according to the interception point identifier, and outputting the partial interception data to be played back.

[0095] Specifically, when receiving a data playback instruction, the system will determine the local interception data to be played back based on the interception point identifier carried in the instruction. The interception point identifier is used to quickly retrieve and match the data in the database to ensure that the data segment required by the user can be quickly located. Once the data to be played back is found, the system will output it to the specified display interface or processing flow. This is achieved by relying on efficient indexing and query mechanisms, as well as friendly user interaction design, to provide users with a convenient and efficient data playback experience.

[0096] In the above embodiments, the present application realizes efficient data recording and local data interception by identifying the business data link and the interception points corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while the data playback speed is accelerated.

[0097] Furthermore, the steps of obtaining the development documents of the business project and identifying the core business data of the business project from the development documents specifically include:

[0098] Use the preset document parsing tool to parse the development document and obtain the document parsing result;

[0099] Identify a data structure of a document parsing result, wherein the data structure of the document parsing result includes a string structure, a tree structure, and a nested data structure;

[0100] Obtain matching core business identification rules based on the data structure of the document parsing results;

[0101] Identify the core business data of the business project in the document parsing results based on the core business identification rules.

[0102] The preset document parsing tools can be regular expression-based parsers, XML parsers, JSON parsers, and so on. Parsing documents using regular expressions usually results in strings or string arrays that match specific patterns. These strings include specific data fragments in the document, such as phone numbers, email addresses, dates, and so on. Parsing documents using an XML parser usually results in a tree structure (DOM tree) that reflects the hierarchy and content of the document. This tree structure can be traversed to obtain the data in the document. Parsing documents using a JSON parser usually results in a nested object or similar data structure. This object or structure directly maps the key-value pairs and nested structure of the JSON document, making data access and manipulation simple and intuitive.

[0103] In this embodiment, first, a preset document parsing tool is used to automatically process the document and quickly generate the document parsing result. Then, the data structure of the parsing result is identified, including but not limited to the string structure, tree structure and nested data structure, to ensure the comprehensiveness and accuracy of the data structure identification. Based on these identified data structures, the core business identification rules are matched and applied, so as to extract the key business project data, i.e., the core business data, from the document parsing result.

[0104] For the document parsing results obtained by the regular expression parser, you can use the string operation functions provided by the programming language (such as splitting, searching, replacing, etc.) to extract the core business data. For the document parsing results obtained by the XML parser, you can access each node in the document by traversing the tree structure, and extract the core business data based on the node name, attribute or content. For the document parsing results obtained by the JSON parser, you can directly access the value in the JSON object through the key name. If the core business data is located in a nested object or array, you can use the dot symbol "." or square brackets "[]" to access it layer by layer to obtain the core business data.

[0105] Through the above steps, this application uses a preset document parsing tool to automatically process development documents, accurately identify various data structures, and match core business identification rules accordingly to efficiently extract core business data.

[0106] Furthermore, the data flow of the business system is monitored, and the business data link associated with the development document is determined to obtain the target business data link, which specifically includes:

[0107] Use the preset API interface to monitor the data flow of the business system and obtain monitoring data;

[0108] Encapsulate the monitoring data into a message format, and send the monitoring data encapsulated into a message format to the message queue of the business system;

[0109] Consume the messages in the message queue and obtain the message consumption results;

[0110] The message consumption result and the document parsing result are compared, and the business data link associated with the development document in the data flow is determined according to the data comparison result to obtain the target business data link.

[0111] The document parsing results provide a detailed description of the business logic and data structure, while the message consumption results reflect the dynamic changes in the actual data flow. By comparing the message consumption results and the document parsing results, the business data in the data flow can be accurately matched with the actual business logic, thereby determining the target business data link.

[0112] In this embodiment, the system realizes real-time monitoring of the business system data flow by integrating the preset API interface, effectively captures key data changes, and ensures efficient data transmission and asynchronous processing capabilities by encapsulating the acquired monitoring data into a standard message format and pushing it to the message queue. Subsequently, the messages in the queue are consumed, and by comparing the message consumption results with the document parsing data, the business data links in the data flow that match the development documents are accurately identified.

[0113] According to the needs of the business system, choose a suitable message queue, such as RabbitMQ, Kafka, ActiveMQ, etc. These message queues provide high throughput, low latency, and high reliability message delivery capabilities. Integrate the business system with the message queue to ensure that the data flow in the business system can be sent to the message queue for consumption.

[0114] Through the above steps, the data flow is monitored through the API, the message queue realizes asynchronous data processing, and the document parsing results are compared to accurately identify the business data link, which improves the data processing efficiency and accuracy and ensures the consistency and traceability of the business data link.

[0115] Further, a data comparison is performed on the message consumption result and the document parsing result, and a business data link associated with the development document in the data flow is determined according to the data comparison result to obtain a target business data link, specifically including:

[0116] Identify the data structure of the message consumption result;

[0117] Compare the data structure of the document parsing result with the data structure of the message consumption result to obtain a data structure comparison result;

[0118] Extract keywords from the document parsing results to obtain document keywords;

[0119] Extract keywords from the message consumption results to obtain message keywords;

[0120] Compare the document keywords with the message keywords to obtain keyword comparison results;

[0121] Determine the relevance of the message to the development document based on the data structure comparison results and the keyword comparison results;

[0122] The business data link associated with the development document in the data flow is determined according to the association degree, and the target business data link is obtained.

[0123] In this embodiment, by deeply analyzing the data structure and keywords of the message consumption results and the document parsing results, accurate identification of business data links in the data stream is achieved based on the double comparison of data structure and keywords. First, the data structure of the message consumption results and the document parsing results is compared to ensure the consistency of the data structure; then, the keywords of the message consumption results and the document parsing results are extracted, and the keywords of the two are compared to capture the key elements of the business logic. This multi-dimensional comparison strategy not only improves the accuracy of the identification process, but also enhances the system's adaptability to complex business scenarios. Finally, based on the double comparison results of data structure and keywords, the correlation between the message and the development document is determined, thereby accurately locking the target business data link.

[0124] For example, in an insurance business system, the data structure includes policy information (such as policy number, insured information, insurance period, etc.), claim records (such as claim application number, claim amount, claim status, etc.) and financial transaction data, etc. These data are stored and transmitted in the system in the form of specific data structures.

[0125] For property insurance business, keywords include "policy number", "insured person's name", "claim status", "payment amount", etc. These keywords frequently appear in business documents and messages and are important bases for identifying business logic and data links.

[0126] When determining the business data link, first use the preset API interface to monitor the data flow of the business system in real time and capture all relevant business messages. Then encapsulate the monitored data into a standard message format and send it to the message queue for processing. After taking the message from the message queue, first parse its data structure and compare it with the pre-defined data structure template that is consistent with the development document. For example, check whether the message contains a complete policy information data structure, including all necessary fields and the correct data type. At the same time, extract keywords from the message and document, use the parsing tool to identify the keyword set from the message and document, compare the keywords of the message and document, and check the keyword matching degree between the message and document. For example, determine whether both contain keywords such as "policy number", "insured person's name", "claim status", and "payment amount".

[0127] By combining the double comparison results of data structure and keywords and calculating the relevance between the message and the development document, a scoring mechanism can be designed to give a relevance score based on the matching degree of the data structure and the matching degree of the keywords. A scoring threshold is set. When the relevance score exceeds the scoring threshold, the message is considered to be highly relevant to the development document, thereby locking the target business data link. Based on the relevance score results, the business data link associated with the development document in the data flow is determined. For example, in the insurance claim process, the entire data link from insurance policy application to claim completion can be accurately identified.

[0128] Through the above steps, the dual comparison scheme based on data structure and keywords can more effectively monitor and identify key data links in the business system, which not only improves the accuracy and efficiency of the business process, but also enhances the maintainability and scalability of the system.

[0129] Further, the step of using a recording component to record a data section of a target service data link, and using a data interceptor to intercept data at a target interception point during the data recording process to obtain local interception data specifically includes:

[0130] Determine the service start point and service end point of the target service data link;

[0131] Record the data section of the target service data link from the service start point until the service end point;

[0132] During data recording, obtain the data interception rules corresponding to the target interception point;

[0133] The target interception point is captured by using the data interceptor, and the context data of the target interception point is intercepted based on the data interception rule to obtain the local interception data.

[0134] In this embodiment, by identifying the starting and ending points of the target business data link, accurate control of the entire data flow process is achieved. The target business data link is recorded using a recording component from the business start point to the end point, ensuring the integrity and traceability of the data link without interfering with the normal business process. At the same time, interception rules are introduced, and the context data of the target interception point is captured using a data interceptor to extract local interception data.

[0135] Through the above steps, the local data interception method is adopted, which significantly reduces the amount of data processing and memory usage, and improves the flexibility and accuracy of data monitoring. The system can also respond quickly to changes in business needs by dynamically adjusting the interception rules to ensure the security and compliance of business data.

[0136] Furthermore, the data interception rule includes a class name and a context object, a data interceptor is used to capture a target interception point, and context data of the target interception point is intercepted based on the data interception rule to obtain a step of local interception data, specifically including:

[0137] Parse the data interception rules to obtain the class name and context object corresponding to the target interception point;

[0138] Use the data interceptor to capture the target interception point based on the class name corresponding to the target interception point;

[0139] Determine the context interception range of the target interception point based on the context object;

[0140] The context data of the target interception point is intercepted according to the context interception range to obtain local interception data.

[0141] In this embodiment, the capture of context data of the target interception point is achieved through the definition and parsing of data interception rules in combination with the data interceptor. First, the data interception rules are parsed to clarify the class name and context object of the target interception point, providing precise guidance for the interception operation. Subsequently, the data interceptor is used to locate the interception point according to the class name to ensure the accuracy of the interception operation. Furthermore, the interception range is defined based on the context object, and only necessary data fragments are captured to avoid data redundancy and improve processing efficiency. Finally, according to the defined context interception range, local data is effectively intercepted and extracted, which significantly reduces the amount of data processing and memory usage, significantly enhances the flexibility and pertinence of data processing, and optimizes system performance and security.

[0142] Through the above steps, the interception point is accurately located by parsing the interception rules, and combined with the context range determination, efficient local data interception is achieved, which improves the data processing accuracy and flexibility, optimizes the system resource utilization, and supports accurate business analysis and monitoring.

[0143] Furthermore, the context object includes a rule processor chain and a rule configuration class, and before the step of obtaining the data interception rule corresponding to the target interception point, it also includes:

[0144] Create a rule configuration class corresponding to the target interception point and initialize the rule configuration class;

[0145] Get the rule context object corresponding to the target interception point;

[0146] Create a rule processor corresponding to the target interception point and instantiate the rule processor;

[0147] Pass the rule context object to the instantiated rule processor to obtain the context object rule processor;

[0148] Associate the initialized rule configuration class with the context object rule processor;

[0149] The associated context object rule processors are sorted according to the timestamp of the target interception point to obtain a rule processor chain.

[0150] A rule processor chain is an ordered set of rules used to process data or business logic. It is formed by connecting multiple rule processors in series in a specific order. Each processor is responsible for executing specific rules or logical judgments and passing the processing results to the next processor.

[0151] A rule configuration class is a class used to define and configure business rules or data processing logic in software development and system design. The rule configuration class encapsulates the configuration information related to the rule, such as the rule definition, parameters, conditions, etc., so that these rules can be flexibly applied and adjusted in different contexts or scenarios. The rule configuration class usually provides a set of interfaces or methods to allow developers to dynamically modify the configuration of the rules at runtime or in the configuration file, thereby supporting the flexibility and scalability of the business logic.

[0152] In this embodiment, first, by creating and initializing the rule configuration class, a customized configuration basis is provided for the interception point to ensure that the interception operation can meet specific business needs. Subsequently, the rule context object is obtained to introduce context awareness into the interception process, so that the interception operation can be dynamically adjusted based on the current environment or state. Further, a rule processor is created and instantiated, and the context object is combined with the rule processor to form a context object rule processor, which not only enhances the reusability of the interception logic, but also improves the intelligence level of the interception operation.

[0153] Associating the rule configuration class with the context object rule processor ensures the tight coupling between the interception rule and the specific execution logic. Finally, the context object rule processors are sorted according to the timestamp to form a rule processor chain, so that multiple interception points or interception rules can be executed in a predetermined order, avoiding potential conflicts or confusion.

[0154] Through the above steps, an efficient, flexible and scalable data interception mechanism is built through refined rule configuration, context awareness, rule processor instantiation and sorting, which provides strong support for the stable operation of business systems and data analysis.

[0155] In the above embodiment, the present application discloses a data playback method, which belongs to the field of big data technology. The present application parses the business project development document, identifies the core business data, monitors the data flow of the business system, determines the associated business data link, and accurately locates the target interception point of focus in combination with the core business data, and uses the recording component and data interceptor in the preset data playback platform to realize the data recording and interception of the target interception point in the target business data link, captures the local interception data, and stores the local interception data in the system database after marking. When receiving the data playback instruction, the system retrieves the corresponding local interception data according to the interception point identifier in the instruction to realize data playback. The present application realizes efficient data recording and local data interception by identifying the business data link and the interception point corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while speeding up the data playback speed.

[0156] In this embodiment, the electronic device (eg, Figure 1 The server shown in the figure) can receive instructions or obtain data through a wired connection or a wireless connection. It should be noted that the above wireless connection method may include but is not limited to 3G / 4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0157] It should be emphasized that in order to further ensure the privacy and security of the above business data, the above business data can also be stored in a blockchain node.

[0158] The blockchain referred to in this application is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, platform product service layer, and application service layer.

[0159] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through computer-readable instructions, and the computer-readable instructions can be stored in a computer-readable storage medium. When the computer-readable instructions are executed, they can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a non-volatile storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0160] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0161] Further references Figure 3 , as a response to the above Figure 2 In order to realize the method shown in the figure, the present application provides an embodiment of a data playback device, and the device embodiment is Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0162] like Figure 3 As shown, the data playback device 300 described in this embodiment is provided with a data playback platform, the data playback platform includes a recording component and a data interceptor, and the data playback device 300 includes:

[0163] The business identification module 301 is used to obtain the development documents of the business project and identify the core business data of the business project from the development documents;

[0164] The data flow monitoring module 302 is used to monitor the data flow of the business system, determine the business data link associated with the development document, and obtain the target business data link;

[0165] An interception point identification module 303, used to determine a target interception point in a target service data link based on core service data;

[0166] The data interception module 304 is used to use the recording component to perform data section recording on the target service data link, and use the data interceptor to perform data interception on the target interception point during the data recording process to obtain local interception data;

[0167] The data storage module 305 is used to mark the local interception data using the target interception point and store the marked local interception data in the database of the business system;

[0168] The data playback module 306 is used to receive a data playback instruction, obtain an interception point identifier carried in the data playback instruction, determine the local interception data to be played back according to the interception point identifier, and output the local interception data to be played back.

[0169] Furthermore, the service identification module 301 is used to:

[0170] Use a preset document parsing tool to parse the development document to obtain a document parsing result; identify the data structure of the document parsing result, wherein the data structure of the document parsing result includes a string structure, a tree structure, and a nested data structure; obtain matching core business identification rules based on the data structure of the document parsing result; identify the core business data of the business project in the document parsing result based on the core business identification rules.

[0171] Furthermore, the data flow monitoring module 302 is used to:

[0172] Use the preset API interface to monitor the data flow of the business system to obtain monitoring data; encapsulate the monitoring data into a message format, and send the monitoring data encapsulated in the message format to the message queue of the business system; consume the messages in the message queue to obtain the message consumption results; compare the message consumption results with the document parsing results, determine the business data link associated with the development document in the data flow according to the data comparison results, and obtain the target business data link.

[0173] Furthermore, the data flow monitoring module 302 is further used to:

[0174] Identify the data structure of the message consumption result; compare the data structure of the document parsing result with the data structure of the message consumption result to obtain the data structure comparison result; perform keyword extraction on the document parsing result to obtain document keywords; perform keyword extraction on the message consumption result to obtain message keywords; compare the document keywords with the message keywords to obtain the keyword comparison result; determine the correlation between the message and the development document based on the data structure comparison result and the keyword comparison result; determine the business data link associated with the development document in the data flow based on the correlation to obtain the target business data link.

[0175] Furthermore, the data interception module 304 is used to:

[0176] Determine the business start point and business end point of the target business data link; record the data section of the target business data link from the business start point until the business end point is recorded; during the data recording process, obtain the data interception rule corresponding to the target interception point; use the data interceptor to capture the target interception point, and intercept the context data of the target interception point based on the data interception rule to obtain local interception data.

[0177] Furthermore, the data interception rule includes a class name and a context object, and the data interception module 304 is further used to:

[0178] Parse the data interception rules to obtain the class name and context object corresponding to the target interception point; use the data interceptor to capture the target interception point based on the class name corresponding to the target interception point; determine the context interception range of the target interception point based on the context object; intercept the context data of the target interception point according to the context interception range to obtain local interception data.

[0179] Furthermore, the context object includes a rule processor chain and a rule configuration class. The data playback device 300 also includes a context object configuration module. The context object configuration module is used to:

[0180] Create a rule configuration class corresponding to the target interception point and initialize the rule configuration class; obtain the rule context object corresponding to the target interception point; create a rule processor corresponding to the target interception point and instantiate the rule processor; pass the rule context object to the instantiated rule processor to obtain a context object rule processor; associate the initialized rule configuration class with the context object rule processor; sort the associated context object rule processors according to the timestamp of the target interception point to obtain a rule processor chain.

[0181] In the above embodiment, the present application discloses a data playback device, which belongs to the field of big data technology. The present application parses the business project development documents, identifies the core business data, monitors the data flow of the business system, determines the associated business data link, and accurately locates the target interception point of focus in combination with the core business data, and uses the recording components and data interceptors in the preset data playback platform to realize data recording and interception of the target interception point in the target business data link, capture local interception data, and store the local interception data in the system database after marking. When a data playback instruction is received, the system retrieves the corresponding local interception data according to the interception point identifier in the instruction to realize data playback. The present application realizes efficient data recording and local data interception by identifying the business data link and the interception point corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while speeding up the data playback speed.

[0182] To solve the above technical problems, the present application also provides a computer device. Figure 4 , Figure 4 This is a basic structural block diagram of the computer device in this embodiment.

[0183] The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are interconnected through a system bus. It should be noted that the figure only shows a computer device 4 with components 41-43, but it should be understood that it is not required to implement all the components shown, and more or fewer components can be implemented instead. Among them, those skilled in the art can understand that the computer device here is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmab l eGate Array, FPGA), digital processors (Digital Signal Processor, DSP), embedded devices, etc.

[0184] The computer device may be a computing device such as a desktop computer, a notebook, a PDA, a cloud server, etc. The computer device may interact with a user through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device.

[0185] The memory 41 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 41 can be an internal storage unit of the computer device 4, such as a hard disk or memory of the computer device 4. In other embodiments, the memory 41 can also be an external storage device of the computer device 4, such as a plug-in hard disk equipped on the computer device 4, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (FlashCard), etc. Of course, the memory 41 can also include both the internal storage unit of the computer device 4 and its external storage device. In this embodiment, the memory 41 is generally used to store the operating system and various application software installed on the computer device 4, such as computer-readable instructions of the data playback method, etc. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or are to be output.

[0186] The processor 42 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips in some embodiments. The processor 42 is generally used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is used to run computer-readable instructions stored in the memory 41 or process data, such as computer-readable instructions for running the data playback method.

[0187] The network interface 43 may include a wireless network interface or a wired network interface. The network interface 43 is generally used to establish a communication connection between the computer device 4 and other electronic devices.

[0188] In the above embodiment, the present application discloses a computer device, which belongs to the field of big data technology. The present application parses the business project development documents, identifies the core business data, monitors the data flow of the business system, determines the associated business data link, and accurately locates the target interception point of focus in combination with the core business data, and uses the recording components and data interceptors in the preset data playback platform to realize the data recording and interception of the target interception point in the target business data link, captures the local interception data, and stores the local interception data in the system database after marking. When receiving the data playback instruction, the system retrieves the corresponding local interception data according to the interception point identifier in the instruction to realize data playback. The present application realizes efficient data recording and local data interception by identifying the business data link and the interception point corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while speeding up the data playback speed.

[0189] The present application also provides another embodiment, namely, providing a computer-readable storage medium, wherein the computer-readable storage medium stores computer-readable instructions, and the computer-readable instructions can be executed by at least one processor to enable the at least one processor to perform the steps of the data playback method as described above.

[0190] In the above embodiment, the present application discloses a computer-readable storage medium, which belongs to the field of big data technology. The present application parses the business project development documents to identify the core business data, monitors the data flow of the business system, determines the associated business data link, and accurately locates the target interception point of focus in combination with the core business data, and uses the recording components and data interceptors in the preset data playback platform to realize the data recording and interception of the target interception point in the target business data link, capture the local interception data, and store the local interception data in the system database after marking. When receiving the data playback instruction, the system retrieves the corresponding local interception data according to the interception point identifier in the instruction to realize data playback. The present application realizes efficient data recording and local data interception by identifying the business data link and the interception point corresponding to the core business data. By storing only the necessary local interception data, the data volume and memory usage are significantly reduced, while speeding up the data playback speed.

[0191] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0192] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0193] Obviously, the embodiments described above are only some embodiments of the present application, rather than all embodiments. The preferred embodiments of the present application are given in the accompanying drawings, but they do not limit the patent scope of the present application. The present application can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present application more thorough and comprehensive. Although the present application is described in detail with reference to the aforementioned embodiments, for those skilled in the art, it is still possible to modify the technical solutions recorded in the aforementioned specific implementation methods, or to perform equivalent replacement of some of the technical features therein. Any equivalent structure made using the contents of the specification and drawings of this application, directly or indirectly used in other related technical fields, is similarly within the scope of patent protection of this application.

Claims

1. A data playback method, It is characterized in that The data playback method is applied to a data playback platform, the data playback platform includes a recording component and a data interceptor, and the method includes: Acquire development documents of the business project, and identify core business data of the business project from the development documents; Monitor the data flow of the business system, and determine the business data link associated with the development document to obtain the target business data link; Determine a target interception point in the target service data link based on the core service data; Using the recording component to perform data section recording on the target service data link, and using the data interceptor to perform data interception on the target interception point during the data recording process to obtain local interception data; Using the target interception point to mark the local interception data, and storing the marked local interception data in a database of a business system; A data playback instruction is received, an interception point identifier carried in the data playback instruction is obtained, local interception data to be played back is determined according to the interception point identifier, and the local interception data to be played back is output.

2. The data playback method according to claim 1, It is characterized in that The step of obtaining the development document of the business project and identifying the core business data of the business project from the development document specifically includes: Using a preset document parsing tool to parse the development document to obtain a document parsing result; Identifying a data structure of the document parsing result, wherein the data structure of the document parsing result includes a string structure, a tree structure, and a nested data structure; Acquire matching core business identification rules according to the data structure of the document parsing result; The core business data of the business project is identified in the document parsing result according to the core business identification rule.

3. The data playback method according to claim 2, It is characterized in that The step of monitoring the data flow of the business system, determining the business data link associated with the development document, and obtaining the target business data link specifically includes: Using a preset API interface to monitor the data flow of the business system to obtain monitoring data; Encapsulating the monitoring data into a message format, and sending the monitoring data encapsulated into the message format to a message queue of the business system; Consume the messages in the message queue and obtain the message consumption results; A data comparison is performed on the message consumption result and the document parsing result, and a business data link associated with the development document in the data flow is determined according to the data comparison result to obtain the target business data link.

4. The data playback method according to claim 3, It is characterized in that The step of performing data comparison on the message consumption result and the document parsing result, determining the business data link associated with the development document in the data flow according to the data comparison result, and obtaining the target business data link specifically includes: Identify a data structure of the message consumption result; Compare the data structure of the document parsing result with the data structure of the message consumption result to obtain a data structure comparison result; Extracting keywords from the document parsing results to obtain document keywords; Perform keyword extraction on the message consumption result to obtain message keywords; Compare the document keywords with the message keywords to obtain keyword comparison results; Determining the relevance between the message and the development document according to the data structure comparison result and the keyword comparison result; The business data link associated with the development document in the data flow is determined according to the association degree to obtain the target business data link.

5. The data playback method according to claim 1, It is characterized in that The step of using the recording component to perform data section recording on the target service data link, and using the data interceptor to perform data interception on the target interception point during the data recording process to obtain local interception data specifically includes: Determine a service start point and a service end point of the target service data link; Performing data section recording on the target service data link from the service start point until recording to the service end point; During the data recording process, obtaining a data interception rule corresponding to the target interception point; The target interception point is captured using the data interceptor, and context data of the target interception point is intercepted based on the data interception rule to obtain the local interception data.

6. The data playback method according to claim 5, It is characterized in that The data interception rule includes a class name and a context object. The step of using the data interceptor to capture the target interception point and intercepting the context data of the target interception point based on the data interception rule to obtain the local interception data specifically includes: Parsing the data interception rule to obtain the class name and context object corresponding to the target interception point; Using the data interceptor to capture the target interception point based on the class name corresponding to the target interception point; determining a context interception range of the target interception point based on the context object; The context data of the target interception point is intercepted according to the context interception range to obtain the local interception data.

7. The data playback method according to claim 6, It is characterized in that The context object includes a rule processor chain and a rule configuration class, and before the step of obtaining the data interception rule corresponding to the target interception point, it also includes: Create a rule configuration class corresponding to the target interception point and initialize the rule configuration class; Obtain the rule context object corresponding to the target interception point; Creating a rule processor corresponding to the target interception point and instantiating the rule processor; Passing the rule context object to the instantiated rule processor to obtain a context object rule processor; Associating the initialized rule configuration class with the context object rule processor; The associated context object rule processors are sorted according to the timestamp of the target interception point to obtain the rule processor chain.

8. A data playback device, It is characterized in that The data playback device is provided with a data playback platform, the data playback platform includes a recording component and a data interceptor, and the device includes: A business identification module, used to obtain development documents of a business project and identify core business data of the business project from the development documents; A data flow monitoring module is used to monitor the data flow of the business system, determine the business data link associated with the development document, and obtain the target business data link; An interception point identification module, used to determine a target interception point in the target service data link based on the core service data; A data interception module, used to use the recording component to perform data section recording on the target service data link, and use the data interceptor to perform data interception on the target interception point during the data recording process to obtain local interception data; A data storage module, used to mark the local interception data using the target interception point, and store the marked local interception data in a database of a business system; The data playback module is used to receive a data playback instruction, obtain an interception point identifier carried in the data playback instruction, determine the local interception data to be played back according to the interception point identifier, and output the local interception data to be played back.

9. A computer device, It is characterized in that The method comprises a memory and a processor, wherein the memory stores computer-readable instructions, and the processor implements the steps of the data playback method according to any one of claims 1 to 7 when executing the computer-readable instructions.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the steps of the data playback method according to any one of claims 1 to 7 are implemented.

Images