Data processing method and device, electronic equipment and storage medium
By establishing the relationship between data display pages and data, and between tasks and data in the data display system, and by using syntax tree analysis to analyze the target code, the problem of not being able to quickly locate anomalies in existing technologies is solved, thus improving the maintenance efficiency of the data display system.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- NETEASE (HANGZHOU) NETWORK CO LTD
- Filing Date
- 2021-10-20
- Publication Date
- 2026-05-12
AI Technical Summary
The existing data display system cannot quickly and accurately locate abnormal tasks or abnormal data display pages when anomalies occur, resulting in low maintenance efficiency.
By establishing the primary association between the data display page and the data, and the secondary association between the task and the data, the relationship between the data display page and the task is determined. The target code is analyzed using a syntax tree to determine the information set, and the abnormal task or page is quickly and accurately located in case of anomalies.
It enables quick and accurate location of abnormal tasks or data display pages under abnormal conditions, reducing the number of tasks that need to be investigated and improving the maintenance efficiency of the data display system.
Smart Images

Figure CN113961585B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of computer technology, and more specifically to data processing methods, apparatus, electronic devices, and storage media. Background Technology
[0002] Data visualization systems can display data in graphical form on a front-end data display page, thereby achieving the effect of clearly and effectively conveying and communicating information. Typically, the data displayed on the data display page is generated by backend tasks and saved to a database. The data display page can then retrieve data from the database and display it.
[0003] Currently, when an anomaly occurs, it is impossible to quickly and accurately locate the abnormal task or the abnormal data display page, resulting in low efficiency in maintaining the data display system. Summary of the Invention
[0004] This invention provides a data processing method, apparatus, electronic device, and storage medium, which can improve the maintenance efficiency of data display systems.
[0005] This invention provides a data processing method, comprising:
[0006] Determine the information set of the first data accessed by each data display page, and the information set of the second data accessed by each task, where the information sets of the first data and the information sets of the second data have an intersection;
[0007] Based on the information set of the first data, establish the first association relationship between the data display page and the first data;
[0008] Based on the information set of the second data, establish a second association relationship between the task and the second data;
[0009] Based on the first and second association relationships, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0010] The present invention also provides a data processing apparatus, comprising:
[0011] The first determining unit is used to determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, wherein the information set of the first data and the information set of the second data have an intersection.
[0012] The first establishment unit is used to establish a first association relationship between the data display page and the first data based on the information set of the first data.
[0013] The second establishment unit is used to establish a second association relationship between the task and the second data based on the information set of the second data.
[0014] The second determining unit is used to determine the association between the data display page and the task based on the first association and the second association, so as to display the association between the data display page and the task.
[0015] In some embodiments, the second determining unit is specifically used for:
[0016] Based on the information set of the second association relationship and the first data, determine the associated task corresponding to the first data;
[0017] Based on the first association, determine the association between the data display page and the associated tasks.
[0018] In some embodiments, the second determining unit is specifically used for:
[0019] When the associated task does not exist in the preset task set, the preset task set is updated using the associated task.
[0020] Based on the second association relationship, determine the information of the second data accessed by the associated tasks in the preset task set;
[0021] When the information of the second data accessed by the associated task does not exist in the information set of the first data, the information set of the first data is updated using the information of the second data accessed by the associated task.
[0022] In some embodiments, the second determining unit is specifically used for:
[0023] Identify the dependencies between tasks;
[0024] Based on the dependencies between tasks, determine the dependent tasks that related tasks depend on.
[0025] When a dependent task does not exist in the preset task set, the preset task set is updated using the dependent task.
[0026] In some embodiments, the first determining unit is specifically used for:
[0027] Obtain the target code, which includes at least one of the following: page code that constitutes the data display page, and task code that constitutes the task;
[0028] The target code is analyzed and processed to obtain a syntax tree;
[0029] Based on the syntax tree, determine the information set of the target data. The information set of the target data includes at least one of the following: the information set of the first data and the information set of the second data.
[0030] In some embodiments, the syntax tree includes multiple nodes, and the first determining unit is specifically used for:
[0031] Traverse the syntax tree to determine the target node that contains the preset fields;
[0032] The information of the data corresponding to the preset fields in the target node is determined as the information of the target data.
[0033] In some embodiments, the data processing apparatus is further configured to:
[0034] Monitoring data access requests;
[0035] Determine the information of the data access request to access;
[0036] When the information of the data requested by the data access request does not exist in the information set of the target data, the information set of the target data is updated using the information of the data requested by the data access request.
[0037] In some embodiments, a data access request includes at least one of the following: an access request initiated by a data display page, or an access request initiated by a task; the information set of the target data includes at least one of the following: an information set of the first data, or an information set of the second data.
[0038] In some embodiments, the second determining unit is further configured to:
[0039] When the target data display page is abnormal, determine and display the abnormal task corresponding to the target data display page based on the association between the data display page and the task; or,
[0040] When the target task is abnormal, the abnormal data display page corresponding to the target task is determined and displayed based on the relationship between the data display page and the task. The target data display page is any data display page in the data display page, and the target task is any task in the task.
[0041] The present invention also provides an electronic device, including a memory and a processor, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute steps in any of the data processing methods provided by the present invention.
[0042] The present invention also provides a computer-readable storage medium storing a plurality of instructions adapted for loading by a processor to perform steps in any of the data processing methods provided by the present invention.
[0043] This invention can determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, wherein the information sets of the first data and the information sets of the second data have an intersection; based on the information set of the first data, a first association relationship between the data display page and the first data is established; based on the information set of the second data, a second association relationship between the task and the second data is established; based on the first association relationship and the second association relationship, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0044] In this invention, by establishing the association between data display pages and data, and the association between tasks and data within the data display system, the relationship between data display pages and tasks is obtained. This allows for the rapid and accurate location of abnormal tasks or data display pages in the event of anomalies, alerting developers to quickly and accurately pinpoint and maintain the malfunctioning task. This reduces the number of tasks requiring investigation and improves maintenance efficiency. Therefore, this solution enhances the efficiency of data display system maintenance. Attached Figure Description
[0045] To more clearly illustrate the technical solutions in this invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0046] Figure 1 This is a flowchart illustrating a data processing method provided by the present invention;
[0047] Figure 2 This is a flowchart illustrating another data processing method provided by the present invention;
[0048] Figure 3 This is a schematic diagram of a data processing device provided by the present invention;
[0049] Figure 4 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation
[0050] The technical solutions of this invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0051] This invention provides a data processing method, apparatus, electronic device, and storage medium.
[0052] Specifically, the data processing device can be integrated into an electronic device, such as a terminal or server. The terminal can be a mobile phone, tablet, smart Bluetooth device, laptop, or personal computer (PC); the server can be a single server or a server cluster consisting of multiple servers.
[0053] In some embodiments, the data processing apparatus may also be integrated into multiple electronic devices, such as multiple servers, with the data processing method of the present invention being implemented by the multiple servers.
[0054] In some embodiments, the server may also be implemented as a terminal.
[0055] For example, the electronic device can determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, wherein the information sets of the first data and the information sets of the second data have an intersection; based on the information set of the first data, a first association relationship between the data display page and the first data is established; based on the information set of the second data, a second association relationship between the task and the second data is established; based on the first association relationship and the second association relationship, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0056] In this invention, firstly, the association between the data display page and the data, as well as the association between the task and the data, are established. Then, based on these associations, the association between the data display page and the task is established. This allows for the quick and accurate location of the malfunctioning task or data display page in the event of an anomaly. Therefore, this solution can improve the efficiency of data display system maintenance.
[0057] The following sections provide detailed descriptions of each example. It should be noted that the sequence numbers of the following embodiments are not intended to limit the preferred order of the embodiments.
[0058] In this embodiment, a data processing method is provided, such as... Figure 1 As shown, the specific flow of this data processing method can be as follows:
[0059] 110. Determine the information set of the first data accessed by each data display page, and the information set of the second data accessed by each task. The information sets of the first data and the information sets of the second data have an intersection.
[0060] The data display page can be the user interface of the data display system, which may include multiple data display pages. In some embodiments, the data display system can consist of the front-end and back-end of any website, application, mini-program, etc.; for example, the data display page can be a user interface such as a leaderboard or battle record in a video game. In some embodiments, the data display page can change the displayed data information in response to user actions.
[0061] The first data can be data accessed by the data display page, and the amount of this data is not limited. The access methods in this invention can include, but are not limited to, reading, writing, deleting, and modifying. For example, when a user operates the data display page (such as opening the data display page or filtering information on the data display page), the data display page responds to the user's operation by reading data from a database or data storage device (also known as a page query process). In some embodiments, the data in this invention can be stored in any form, including tables (data tables), linked lists, tuples, trees, etc.; for example, it can be stored in a database in the form of a data table, which can be a relational database or a non-relational database.
[0062] The information in the first data can be a unique identifier for the first data, such as the table name or number (table 0x1 to table 0xx) that can distinguish the data table. The information set of the first data can be a collection of information from all data accessed on the data display page, and there are no restrictions on the storage format of this collection.
[0063] Tasks can be the basic working unit of a data visualization system, and can perform a variety of functions, such as calculating world rankings or conducting statistical analysis of individual performance.
[0064] The second data can be data accessed by the task; for example, it can be data accessed by the data display system during task execution. The second data and the first data can be data tables in the same database, or they can be the same data table or different data tables. In some embodiments, the second data generated during task execution can be written into the database, and the data display page can read this second data from the database; that is, the second data is the first data corresponding to the data display page. For example, when executing a task to calculate a world ranking, ranking data is generated and written into the corresponding database. The data display page can read the ranking data from the database, process it, and then display it on the data display page.
[0065] The information in the second data can also be a unique identifier for the second data. When the first data and the second data are in the same data table, the information in the second data is the same as the information in the first data; therefore, the information set of the first data and the information set of the second data have an intersection. Under certain circumstances, the information set of the first data and the information set of the second data can also be the same set.
[0066] The specific implementation of determining the information set of the first data accessed by each data display page and the information set of the second data accessed by each task is not limited. In some embodiments, it may include the following steps:
[0067] i. Obtain the target code. The programming language of the target code is not limited. The target code includes at least one of the following: page code constituting the data display page, and task code constituting the task. In some embodiments, the page code can be the code corresponding to the Structured Query Language (SQL) called during the page query process; the task code can be the code corresponding to the Structured Query Language called during task execution.
[0068] ii. Analyze and process the target code to obtain a syntax tree. A syntax tree is an abstract representation of the target code's syntactic structure, representing the syntax structure of the corresponding programming language in a tree-like form. Each node in the syntax tree represents a structure in the target code. In some embodiments, page code is analyzed and processed to obtain the syntax tree corresponding to the page code. In some embodiments, task code is analyzed and processed to obtain the syntax tree corresponding to the task code.
[0069] In some embodiments, the analysis process may include, but is not limited to, lexical and syntactic analysis of the target code. For example, characters in the target code are read letter by letter and then compared with keywords of a predefined structured query language to generate corresponding tokens. A token can be an indivisible smallest unit. Syntactic analysis can transform the tokens obtained from lexical analysis into a syntax tree structure with grammatical meaning.
[0070] iii. Based on the syntax tree, determine the information set of the target data. The information set of the target data includes at least one of the following: the information set of the first data and the information set of the second data.
[0071] The syntax tree includes multiple nodes. Based on the syntax tree, the information set of the target data is determined, which may include: traversing the syntax tree to determine the target node containing preset fields; the preset fields can be customized according to the actual application, for example, they can be SELECT, UPDATE, etc., and the target node can be any node in the syntax tree.
[0072] The information of the data corresponding to the preset fields in the target node is determined as the information of the target data; for example, the table name of the data table corresponding to fields such as SELECT and UPDATE.
[0073] In some embodiments, the syntax tree is the syntax tree corresponding to the page code, and the information set of the target data is the information set of the first data; the information set of the first data is determined based on the syntax tree corresponding to the page code.
[0074] In some embodiments, the syntax tree is the syntax tree corresponding to the task code, and the information set of the target data is the set of second data information; the information set of the second data is determined based on the syntax tree corresponding to the task code.
[0075] 120. Based on the information set of the first data, establish the first association between the data display page and the first data.
[0076] The first association represents the relationship between the data display page and the first data. The specific form of this first association is not limited; for example, the page identifier of the data display page can be obtained and mapped to the information set of the first data; alternatively, it can be represented in the form of a table, as shown in Table 1 below, where the page identifier can be mapped to the table name:
[0077] Table 1. First Relationship Between Data Display Page and First Data
[0078]
[0079] 130. Based on the information set of the second data, establish a second association between the task and the second data.
[0080] The second association represents the relationship between the task and the second set of data. The specific form of this association is not limited; for example, the task identifier can be obtained and mapped to a set of second data information; alternatively, it can be represented in the form of a table, as shown in Table 2 below, where task identifiers can be mapped to table names.
[0081] Table 2. Second Relationship between Tasks and Secondary Data
[0082]
[0083] 140. Based on the first and second association relationships, determine the association relationship between the data display page and the task so as to display the association relationship between the data display page and the task.
[0084] There are no restrictions on the specific form of the association between the data display page and the task; the page identifier can be matched with the task identifier.
[0085] In some embodiments, determining the association between the data display page and the task based on the first association relationship and the second association relationship may include, but is not limited to, the following steps:
[0086] Based on the second association relationship and the information set of the first data, the associated tasks corresponding to the first data are determined. An associated task refers to a task associated with the first data for each data display page. Based on the first association relationship, the association relationship between the data display page and the associated tasks is determined. In some embodiments, for each data display page, the information set of the first data and the information set of the second data have an intersection. Therefore, for each piece of information in the information set of the first data, the associated task corresponding to the first data is determined based on the second association relationship; then, based on the first association relationship, the association relationship between each data display page and the associated tasks is determined.
[0087] Taking page 1 as an example, assume that the information set of the first data of page 1 includes tables 0x1, 0x4, and 0x7, and the first association is that page 1 corresponds to tables 0x1, 0x4, and 0x7; the information set of the second data of task 1 includes tables 0x1, 0x3, and 0x4; and the information set of the second data of task 2 includes tables 0x2, 0x4, and 0x7. That is, the second association is that task 1 corresponds to tables 0x1, 0x3, and 0x4, and task 2 corresponds to tables 0x2, 0x4, and 0x7. Therefore, table 0x1 in the first data set can be determined to correspond to task 1 based on the second association, thus task 1 is the associated task of page 1; similarly, tables 0x4 and 0x7 in the first data set can be determined to correspond to task 2 based on the second association, thus task 2 is the associated task of page 1. Finally, page 1 is associated with tasks 1 and 2.
[0088] In some embodiments, after determining the associated task corresponding to the first data based on the second association relationship and the information set of the first data for each data display page, the following steps may also be performed:
[0089] When a related task does not exist in the preset task set, the preset task set is updated using the related task. The preset task set before the first update can be an empty set. Each time a new related task is identified, the new related task can be added to the preset task set, thereby updating the preset task set.
[0090] Based on the second association relationship, determine the information of the second data accessed by the associated tasks in the preset task set.
[0091] When the information of the second data accessed by the associated task does not exist in the information set of the first data, the information set of the first data is updated with the information of the second data accessed by the associated task, that is, the information of the second data accessed by the associated task is used as the new information of the first data.
[0092] When the information set of the first data is updated, steps can be executed to determine the associated task corresponding to the first data based on the second relationship and the information set of the first data, until the information set of the first data is no longer updated, or the preset task set is no longer updated; that is, no new associated task or new information about the first data can be determined. The data display page corresponds to the associated tasks in the preset task set.
[0093] In some embodiments, when there are dependencies between tasks, the dependencies between tasks can be determined; based on the dependencies between tasks, the dependent tasks that the associated tasks depend on can be determined; when the dependent tasks do not exist in the preset task set, the preset task set is updated using the dependent tasks, that is, the dependent tasks are added to the preset task set as new associated tasks.
[0094] In some embodiments, when a new query is performed on the data display page, or when the task code changes, the following steps can be performed to update the relationships:
[0095] Monitor data access requests; data access requests include at least one of the following: access requests initiated by the data display page, and access requests initiated by the task.
[0096] Determine the information of the data requested in the data access request; for example, determine the name of the table in the data access request.
[0097] When the information of the data requested for access does not exist in the information set of the target data, the information set of the target data is updated using the information of the data requested for access. The information set of the target data includes at least one of the following: an information set of first data and an information set of second data. In some embodiments, when the information of the data requested for access does not exist in the information set of first data, the information set of first data is updated using the information of the data requested for access. In some embodiments, when the information of the data requested for access does not exist in the information set of second data, the information set of second data is updated using the information of the data requested for access.
[0098] When the information set of the first data or the information set of the second data is updated, steps S110 to S140 of this scheme can be re-executed to update the association between the data display page and the task.
[0099] In some embodiments, displaying the association between the data display page and the task may include:
[0100] When the target data display page malfunctions, the system identifies and displays the corresponding malfunctioning task based on the association between the data display page and the task. For example, it can notify developers that "the data display page is malfunctioning, and the associated task is XX," allowing them to quickly locate and maintain the associated task, reducing the number of tasks that need to be checked and eliminating the need to focus on other tasks. Alternatively,
[0101] When a target task encounters an error, the system determines and displays the corresponding error data display page based on the association between the data display page and the task. The target data display page can be any data display page within the data display page set, and the target task can be any task within the task set. For example, when a user accesses the error data display page, the page might display a message stating, "The associated task has encountered an error; the data on this page may be abnormal." This can alert or warn the user to avoid receiving incorrect data.
[0102] The data processing solution provided by this invention can be applied to various data display scenarios. For example, taking video games as an example, the data display page may include battle records, leaderboards, large-scale competition results, etc. The solution involves determining the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, with the information sets of the first and second data having an intersection. Based on the information set of the first data, a first association relationship is established between the data display page and the first data. Based on the information set of the second data, a second association relationship is established between the task and the second data. Based on the first and second association relationships, the association relationship between the data display page and the task is determined, so as to display the association relationship between the data display page and the task. This can improve the maintenance efficiency of data display pages in video games.
[0103] As can be seen from the above, the method provided by this invention can determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, wherein the information sets of the first data and the information sets of the second data have an intersection; based on the information set of the first data, a first association relationship between the data display page and the first data is established; based on the information set of the second data, a second association relationship between the task and the second data is established; based on the first association relationship and the second association relationship, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0104] In this invention, by establishing the association between data display pages and data, and between tasks and data within the data display system, the relationship between data display pages and tasks is obtained. This allows for the rapid and accurate location of abnormal data display pages when tasks malfunction, thus alerting users and preventing them from receiving incorrect information. Alternatively, when data display pages malfunction, the relationship can be used to quickly and accurately locate abnormal tasks, prompting developers to quickly identify and maintain the problematic tasks. This reduces the number of tasks requiring investigation and improves maintenance efficiency. Therefore, this solution enhances the maintenance efficiency of the data display system.
[0105] The method described in the above embodiments will be further described in detail below.
[0106] like Figure 2 As shown, the specific process of a data processing method is as follows:
[0107] 210. Obtain the page code corresponding to the Structured Query Language called during the page query process; obtain the task code corresponding to the Structured Query Language called during the task execution process.
[0108] 220. Analyze and process the page code to obtain the syntax tree corresponding to the page code; analyze and process the task code to obtain the syntax tree corresponding to the task code.
[0109] 230. Based on the syntax tree corresponding to the page code, determine the information set of the first data; based on the syntax tree corresponding to the task code, determine the information set of the second data; the information sets of the first data and the information sets of the second data have an intersection.
[0110] 240. Based on the information set of the first data, establish the first association between the data display page and the first data;
[0111] 250. Based on the information set of the second data, establish a second association between the task and the second data;
[0112] 260. Based on the first and second association relationships, determine the association relationship between the data display page and the task so as to display the association relationship between the data display page and the task.
[0113] In some embodiments, for each data display page:
[0114] Based on the information set of the second association relationship and the first data, the associated task corresponding to the first data is determined.
[0115] When a related task does not exist in the preset task set, the preset task set is updated using the related task. The preset task set before the first update can be an empty set. Each time a new related task is identified, the new related task can be added to the preset task set, thereby updating the preset task set.
[0116] Determine the dependencies between tasks; based on the dependencies between tasks, determine the dependent tasks that the related tasks depend on; when a dependent task does not exist in the preset task set, update the preset task set using the dependent task, that is, add the dependent task as a new related task to the preset task set.
[0117] Based on the second association relationship, determine the information of the second data accessed by the associated tasks in the preset task set.
[0118] When the information of the second data accessed by the associated task does not exist in the information set of the first data, the information set of the first data is updated with the information of the second data accessed by the associated task, that is, the information of the second data accessed by the associated task is used as the new information of the first data.
[0119] When the information set of the first data is updated, steps can be executed to determine the associated task corresponding to the first data based on the second relationship and the information set of the first data, until the information set of the first data is no longer updated, or the preset task set is no longer updated; that is, no new associated task or new information about the first data can be determined. The data display page corresponds to the associated tasks in the preset task set.
[0120] In some embodiments, when the target data display page is abnormal, the abnormal task corresponding to the target data display page is determined and displayed based on the association between the data display page and the task; for example, developers can be prompted with "The data display page is faulty, the associated task is XX", so that developers can quickly locate the associated task for maintenance, reducing the number of tasks that need to be checked and eliminating the need to focus on other tasks. Alternatively,
[0121] When a target task encounters an error, the system identifies and displays the corresponding error data display page based on the relationship between the data display page and the task. For example, when a user accesses the error data display page, the page might display a message stating, "The associated task has encountered an error; the data on this page may be abnormal." This can alert or warn the user to avoid receiving incorrect data.
[0122] As shown above, in the data visualization system, the relationship between the data visualization page and the data is established by analyzing the structured query language code called during the page query process; the relationship between the task and the data is also established by analyzing the relationship between the task and the data during task execution; then, based on the relationship between the data visualization page and the data, and the relationship between the task and the data, the relationship between the data visualization page and the task is obtained. This allows for the rapid and accurate location of the abnormal data visualization page when a task encounters an anomaly, thus alerting the user and preventing them from receiving incorrect information; alternatively, it allows for the rapid and accurate location of the abnormal task when a data visualization page encounters an anomaly, alerting developers to quickly locate and maintain the abnormal task, reducing the number of tasks requiring troubleshooting and improving maintenance efficiency. Therefore, this solution can improve the maintenance efficiency of the data visualization system.
[0123] To better implement the above methods, the present invention also provides a data processing device, which can be integrated into an electronic device, such as a terminal or a server. The terminal can be a mobile phone, tablet computer, smart Bluetooth device, laptop computer, personal computer, etc.; the server can be a single server or a server cluster composed of multiple servers.
[0124] For example, in this embodiment, the method of the present invention will be described in detail by taking the data processing device specifically integrated into an electronic device as an example.
[0125] For example, such as Figure 3 As shown, the data processing device may include a first determining unit 301, a first establishing unit 302, a second establishing unit 303, and a second determining unit 304, as follows:
[0126] (I) First Determined Unit 301
[0127] The first determining unit 301 is used to determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task, wherein the information set of the first data and the information set of the second data have an intersection.
[0128] (2) First establishment unit 302
[0129] The first establishment unit 302 is used to establish a first association relationship between the data display page and the first data based on the information set of the first data.
[0130] (3) Second establishment unit 303
[0131] The second establishment unit 303 is used to establish a second association relationship between the task and the second data based on the information set of the second data.
[0132] (4) Second determining unit 304
[0133] The second determining unit 304 is used to determine the association between the data display page and the task based on the first association and the second association, so as to display the association between the data display page and the task.
[0134] In some embodiments, the second determining unit 304 is specifically used for:
[0135] Based on the information set of the second association relationship and the first data, determine the associated task corresponding to the first data;
[0136] Based on the first association, determine the association between the data display page and the associated tasks.
[0137] In some embodiments, the second determining unit 304 is specifically used for:
[0138] When the associated task does not exist in the preset task set, the preset task set is updated using the associated task.
[0139] Based on the second association relationship, determine the information of the second data accessed by the associated tasks in the preset task set;
[0140] When the information of the second data accessed by the associated task does not exist in the information set of the first data, the information set of the first data is updated using the information of the second data accessed by the associated task.
[0141] In some embodiments, the second determining unit 304 is specifically used for:
[0142] Identify the dependencies between tasks;
[0143] Based on the dependencies between tasks, determine the dependent tasks that related tasks depend on.
[0144] When a dependent task does not exist in the preset task set, the preset task set is updated using the dependent task.
[0145] In some embodiments, the first determining unit 301 is specifically used for:
[0146] Obtain the target code, which includes at least one of the following: page code that constitutes the data display page, and task code that constitutes the task;
[0147] The target code is analyzed and processed to obtain a syntax tree;
[0148] Based on the syntax tree, determine the information set of the target data. The information set of the target data includes at least one of the following: the information set of the first data and the information set of the second data.
[0149] In some embodiments, the syntax tree includes multiple nodes, and the first determining unit 301 is specifically used for:
[0150] Traverse the syntax tree to determine the target node that contains the preset fields;
[0151] The information of the data corresponding to the preset fields in the target node is determined as the information of the target data.
[0152] In some embodiments, the data processing apparatus is further configured to:
[0153] Monitoring data access requests;
[0154] Determine the information of the data access request to access;
[0155] When the information of the data requested by the data access request does not exist in the information set of the target data, the information set of the target data is updated using the information of the data requested by the data access request.
[0156] In some embodiments, a data access request includes at least one of the following: an access request initiated by a data display page, or an access request initiated by a task; the information set of the target data includes at least one of the following: an information set of the first data, or an information set of the second data.
[0157] In some embodiments, the second determining unit 304 is further configured to:
[0158] When the target data display page is abnormal, determine and display the abnormal task corresponding to the target data display page based on the association between the data display page and the task; or,
[0159] When the target task is abnormal, the abnormal data display page corresponding to the target task is determined and displayed based on the relationship between the data display page and the task. The target data display page is any data display page in the data display page, and the target task is any task in the task.
[0160] In practice, each of the above units can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units, please refer to the previous method embodiments, which will not be repeated here.
[0161] As can be seen from the above, the data processing device in this embodiment can establish the association between data display pages and data, and the association between tasks and data in the data display system, to obtain the association between data display pages and tasks. When an anomaly occurs, this association can be used to quickly and accurately locate the abnormal task or abnormal data display page, prompting developers to quickly locate and maintain the abnormal task, reducing the number of tasks requiring investigation and improving maintenance efficiency. Therefore, this solution can improve the maintenance efficiency of the data display system.
[0162] Accordingly, this application also provides an electronic device, which can be a terminal or a server. The terminal can be a smartphone, tablet computer, laptop computer, touch screen, game console, personal computer, personal digital assistant (PDA) and other terminal devices.
[0163] like Figure 4 As shown, Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device 400 includes a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, and a computer program stored in the memory 402 and executable on the processor. The processor 401 and the memory 402 are electrically connected. Those skilled in the art will understand that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0164] The processor 401 is the control center of the electronic device 400. It connects various parts of the electronic device 400 through various interfaces and lines. By running or loading software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, it performs various functions of the electronic device 400 and processes data, thereby monitoring the electronic device 400 as a whole.
[0165] In this embodiment, the processor 401 in the electronic device 400 loads the instructions corresponding to the processes of one or more applications into the memory 402 according to the following steps, and the processor 401 runs the applications stored in the memory 402 to realize various functions:
[0166] Determine the information set of the first data accessed by each data display page, and the information set of the second data accessed by each task, where the information sets of the first data and the information sets of the second data have an intersection;
[0167] Based on the information set of the first data, establish the first association relationship between the data display page and the first data;
[0168] Based on the information set of the second data, establish a second association relationship between the task and the second data;
[0169] Based on the first and second association relationships, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0170] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.
[0171] Optional, such as Figure 4 As shown, the electronic device 400 also includes: a touch display screen 403, a radio frequency circuit 404, an audio circuit 405, an input unit 406, and a power supply 407. The processor 401 is electrically connected to the touch display screen 403, the radio frequency circuit 404, the audio circuit 405, the input unit 406, and the power supply 407. Those skilled in the art will understand that... Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0172] The touch display screen 403 can be used to display a graphical user interface (GUI) and receive operation commands generated by the user interacting with the GUI. The touch display screen 403 may include a display panel and a touch panel. The display panel can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the electronic device. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Optionally, the display panel can be configured using a liquid crystal display (LCD), organic light-emitting diode (OLED), or other similar technologies. The touch panel can be used to collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel), generate corresponding operation commands, and execute the corresponding program according to the operation commands. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch location and the signal generated by the touch operation, transmitting the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 401. It can also receive and execute commands from the processor 401. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it transmits the information to the processor 401 to determine the type of touch event. Subsequently, the processor 401 provides corresponding visual output on the display panel based on the type of touch event. In this embodiment, the touch panel and the display panel can be integrated into the touch display screen 403 to achieve input and output functions. However, in some embodiments, the touch panel and the touch display screen 403 can be implemented as two independent components to achieve input and output functions. That is, the touch display screen 403 can also be used as part of the input unit 406 to achieve input functions.
[0173] In this embodiment, the processor 401 executes code constituting a data display page to generate a graphical user interface (GUI) on the touch display screen 403. The virtual scene on the GUI includes at least one data display area. The touch display screen 403 is used to present the GUI and receive operation commands generated by the user interacting with the GUI.
[0174] The radio frequency circuit 404 can be used to transmit and receive radio frequency signals to establish wireless communication with network devices or other electronic devices, and to transmit and receive signals with network devices or other electronic devices.
[0175] Audio circuit 405 can be used to provide an audio interface between a user and an electronic device via a speaker and a microphone. Audio circuit 405 can convert received audio data into electrical signals and transmit them to the speaker, where the speaker converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuit 405, converted back into audio data, and then processed by processor 401 before being transmitted via radio frequency circuit 404 to, for example, another electronic device, or output to memory 402 for further processing. Audio circuit 405 may also include an earphone jack to provide communication between peripheral headphones and electronic devices.
[0176] The input unit 406 can be used to receive input numbers, characters, or user characteristic information (such as fingerprints, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.
[0177] Power supply 407 is used to supply power to various components of electronic device 400. Optionally, power supply 407 can be logically connected to processor 401 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. Power supply 407 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0178] although Figure 4 As not shown in the diagram, the electronic device 400 may also include a camera, sensor, wireless fidelity module, Bluetooth module, etc., which will not be described in detail here.
[0179] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0180] As can be seen from the above, the electronic device provided in this embodiment can establish the association between data display pages and data, and the association between tasks and data in the data display system, thereby obtaining the association between data display pages and tasks. When an anomaly occurs, this association can be used to quickly and accurately locate the abnormal task or abnormal data display page, prompting developers to quickly locate and maintain the abnormal task, reducing the number of tasks requiring investigation and improving maintenance efficiency. Therefore, this solution can improve the maintenance efficiency of the data display system.
[0181] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.
[0182] Therefore, embodiments of this application provide a computer-readable storage medium storing a plurality of computer programs that can be loaded by a processor to execute steps in any of the data processing methods provided in embodiments of this application. For example, the computer program can execute the following steps:
[0183] Determine the information set of the first data accessed by each data display page, and the information set of the second data accessed by each task, where the information sets of the first data and the information sets of the second data have an intersection;
[0184] Based on the information set of the first data, establish the first association relationship between the data display page and the first data;
[0185] Based on the information set of the second data, establish a second association relationship between the task and the second data;
[0186] Based on the first and second association relationships, the association relationship between the data display page and the task is determined so as to display the association relationship between the data display page and the task.
[0187] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.
[0188] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0189] Since the computer program stored in the storage medium can execute the steps of any of the data processing methods provided in the embodiments of this application, the beneficial effects that any of the data processing methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.
[0190] The data processing method, apparatus, storage medium, and electronic device provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. A data processing method, characterized in that, include: Determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task. The information set of the first data and the information set of the second data have an intersection. The information set of the first data of the data display page is obtained based on the code of the data display page and / or the data access request during the page query process of the data display page. The information set of the second data accessed by the task is obtained based on the code of the task and / or the data access request during the execution process of the task. The storage format of the first data and the second data includes at least one of data table, linked list, tuple and tree. The information set of the first data includes the unique identifier of the first data and the information set of the second data includes the unique identifier of the second data. Based on the information set of the first data, a first association relationship is established between the data display page and the first data. The first association relationship includes the correspondence between the page identifier of the data display page and the information set of the first data. Based on the information set of the second data, a second association relationship between the task and the second data is established, the second association relationship including the correspondence between the task identifier of the task and the information set of the second data; Based on the information set of the second association relationship and the first data, determine the associated task corresponding to the first data; When the associated task corresponding to the first data does not exist in the preset task set corresponding to the data display page, the associated task is used to update the preset task set corresponding to the data display page. Based on the second association relationship, the information of the second data accessed by the associated task in the preset task set corresponding to the data display page is determined; When the information of the second data accessed by the associated task does not exist in the information set of the first data corresponding to the data display page, the information set of the first data corresponding to the data display page is updated using the information of the second data accessed by the associated task. The step of establishing the first association relationship between the data display page and the first data based on the information set of the first data continues to be executed until the information set of the first data is no longer updated or the preset task set is no longer updated. Based on the latest first association relationship, the association relationship between the data display page and the associated task is determined so as to display the association relationship between the data display page and the task.
2. The data processing method as described in claim 1, characterized in that, After determining the associated task corresponding to the first data based on the information set of the second association relationship and the first data, the method further includes: Determine the dependencies between the tasks; Based on the dependencies between the tasks, determine the dependent tasks that the associated tasks depend on; When the dependent task does not exist in the preset task set, the preset task set is updated using the dependent task.
3. The data processing method as described in claim 1, characterized in that, The determination of the information set of the first data accessed for each data display page and the information set of the second data accessed for each task includes: Obtain the target code, which includes at least one of the following: page code constituting the data display page, and task code constituting the task; The target code is analyzed and processed to obtain a syntax tree; Based on the syntax tree, an information set of the target data is determined, and the information set of the target data includes at least one of the following: the information set of the first data and the information set of the second data.
4. The data processing method as described in claim 3, characterized in that, The syntax tree includes multiple nodes, and the step of determining the information set of the target data based on the syntax tree includes: The syntax tree is traversed to determine the target node in the syntax tree that contains the preset field; The information of the data corresponding to the preset field in the target node is determined as the information of the target data.
5. The data processing method as described in claim 1, characterized in that, The method further includes: Monitoring data access requests; Determine the information of the data accessed in the data access request; When the information of the data requested by the data access request does not exist in the information set of the target data, the information set of the target data is updated using the information of the data requested by the data access request.
6. The data processing method as described in claim 5, characterized in that, The data access request includes at least one of the following: an access request initiated by the data display page, or an access request initiated by the task; the information set of the target data includes at least one of the following: the information set of the first data, or the information set of the second data.
7. The data processing method as described in claim 1, characterized in that, The process of displaying the association between the data display page and the task includes: When the target data display page is abnormal, the abnormal task corresponding to the target data display page is determined and displayed based on the association between the data display page and the task; or, When the target task is abnormal, the abnormal data display page corresponding to the target task is determined and displayed according to the association between the data display page and the task. The target data display page is any one of the data display pages, and the target task is any one of the tasks.
8. A data processing apparatus, characterized in that, include: The first determining unit is used to determine the information set of the first data accessed by each data display page and the information set of the second data accessed by each task. The information set of the first data and the information set of the second data have an intersection. The information set of the first data of the data display page is obtained based on the code of the data display page and / or the data access request during the page query process of the data display page. The information set of the second data accessed by the task is obtained based on the code of the task and / or the data access request during the execution process of the task. The storage format of the first data and the second data includes at least one of data table, linked list, tuple and tree. The information set of the first data includes the unique identifier of the first data and the information set of the second data includes the unique identifier of the second data. The first establishing unit is used to establish a first association relationship between the data display page and the first data based on the information set of the first data. The first association relationship includes the correspondence between the page identifier of the data display page and the information set of the first data. The second establishing unit is used to establish a second association relationship between the task and the second data based on the information set of the second data. The second association relationship includes the correspondence between the task identifier of the task and the information set of the second data. The second determining unit determines the associated task corresponding to the first data based on the second association relationship and the information set of the first data; When the associated task corresponding to the first data does not exist in the preset task set corresponding to the data display page, the associated task is used to update the preset task set corresponding to the data display page. Based on the second association relationship, the information of the second data accessed by the associated task in the preset task set corresponding to the data display page is determined; When the information of the second data accessed by the associated task does not exist in the information set of the first data corresponding to the data display page, the information set of the first data corresponding to the data display page is updated using the information of the second data accessed by the associated task. The step of establishing the first association relationship between the data display page and the first data based on the information set of the first data continues to be executed until the information set of the first data is no longer updated or the preset task set is no longer updated. Based on the latest first association relationship, the association relationship between the data display page and the associated task is determined so as to display the association relationship between the data display page and the task.
9. An electronic device, characterized in that, The method includes a processor and a memory, the memory storing multiple instructions; the processor loads instructions from the memory to perform the steps of the data processing method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a plurality of instructions adapted for loading by a processor to perform the steps of the data processing method according to any one of claims 1 to 7.