A path generation method and device
By generating data links and labeling business attribute tags, the key paths in the business processing process are determined, and the problem of being unable to accurately determine the importance and critical paths of business data in the prior art is solved, and more efficient and accurate data processing is achieved.
Patent Information
- Application Number
- CN202110533959.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-17
- Publication Date
- 2025-04-11
- Estimated Expiration
- 2041-05-17
Smart Images

Figure CN113128914B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data processing, and in particular to a path generation method and device. Background Art
[0002] With the continuous development of business systems in the financial industry, the number of service components in the business systems is large, and the number of services provided is also large.
[0003] When processing business, multiple service components need to cooperate with each other to interact and process business data. During the data interaction and data processing, it is impossible to accurately determine the importance of a certain business data, and it is impossible to determine the critical path in the business processing process. Summary of the invention
[0004] In view of this, an embodiment of the present invention provides a path generation method and device to solve the problem in the prior art that the importance of a certain business data cannot be accurately determined and the critical path in the business processing process cannot be determined.
[0005] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:
[0006] A first aspect of an embodiment of the present invention shows a path generation method, the method comprising:
[0007] Based on the obtained dependency relationship between service components and the internal data processing relationship information of the components, a data link is generated, wherein the data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple;
[0008] Determining a business scenario category and an impact category of the end node based on the business characteristics of the end node;
[0009] Determine the business attribute labels of the original node and the intermediate node respectively according to the business scenario category and the impact category of the terminal node;
[0010] Set the nodes involving multiple business scenario categories and the number of nodes with an impact category of being influential that is greater than or equal to 2 as first key nodes, the nodes are original nodes and intermediate nodes, and the number of the first key nodes is at least one;
[0011] Nodes connected to the first key node are analyzed to determine a key path including the first key node.
[0012] Optionally, determining the business attribute labels of the original node and the intermediate node respectively according to the business scenario category and the impact category of the terminal node includes:
[0013] According to the business scenario category and impact category of the terminal node, and in accordance with the rule of reverse tracing of the data link, determine the business scenario category and impact category undertaken by the intermediate node;
[0014] According to the business scenarios and impact levels undertaken by the intermediate nodes, and in accordance with the rules of reverse tracing of the data link, determine the business scenario category and impact category of the original node;
[0015] The business scenario category and impact category undertaken by each node are marked to obtain the business attribute label.
[0016] Optionally, setting the nodes involving multiple business scenario categories and having an impact category of influential nodes greater than or equal to 2 as the first key nodes includes:
[0017] Calculate the number of nodes with an impact category of having an impact in the business attribute tag of each node and the number of business scenario categories of each node;
[0018] Determine whether there are nodes whose number of the impact categories being impacted is greater than or equal to 2 and whose number of the business scenario categories is multiple;
[0019] If so, the node is set as a first key node, and the number of the first key nodes is at least one.
[0020] Optionally, analyzing the nodes connected to the first key node to determine a key path including the first key node includes:
[0021] Generate an activity on the edge AOE network according to the file transmission time, batch processing time and node between nodes, wherein the file transmission time and batch processing time between nodes are collected when the service component performs data processing;
[0022] Analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node, so as to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node;
[0023] Based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, a critical path is determined, where the critical path includes the first critical node and other critical nodes connected to the first critical node.
[0024] Optionally, also include:
[0025] Get the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
[0026] A second aspect of an embodiment of the present invention shows a path generation device, the device comprising:
[0027] A link generation unit, configured to generate a data link based on the obtained dependency relationship between service components and the internal data processing relationship information of the components, wherein the data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple;
[0028] A first determining unit, configured to determine a service scenario category and an impact category of the terminal node based on a service characteristic of the terminal node;
[0029] A second determining unit, configured to determine the service attribute labels of the original node and the intermediate node respectively according to the service scenario category and the impact category of the terminal node;
[0030] A setting unit, configured to set nodes involving multiple business scenario categories and having an impact category of having an impact greater than or equal to 2 as first key nodes, wherein the nodes are original nodes and intermediate nodes, and the number of the first key nodes is at least one;
[0031] An analyzing unit is used to analyze nodes that are connected to the first key node to determine a key path including the first key node.
[0032] Optionally, the second determination unit is specifically used to: determine the business scenario category and impact category undertaken by the intermediate node according to the business scenario category and impact category of the end node and the rules of reverse tracing of the data link; determine the business scenario category and impact category of the original node according to the business scenario and impact level undertaken by the intermediate node and the rules of reverse tracing of the data link; and mark the business scenario category and impact category undertaken by each node to obtain a business attribute label.
[0033] Optionally, the setting unit is specifically used to: calculate the number of impact categories with influence in the business attribute label of each node, and the number of business scenario categories of each node; determine whether there are nodes in which the number of impact categories with influence is greater than or equal to 2, and the number of business scenario categories is multiple; if so, set the node as a first key node, and the number of the first key nodes is at least one.
[0034] Optionally, the analysis unit is specifically used to: generate an AOE network with activities on the edge according to the file transfer time, batch processing time and nodes between nodes, the file transfer time and batch processing time between nodes are collected when the service component performs data processing; analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node; determine the critical path based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, the critical path including the first critical node and other critical nodes connected to the first critical node.
[0035] Optionally, also include:
[0036] The display unit is used to obtain the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
[0037] Based on the above-mentioned embodiment of the present invention, a path generation method and device are provided. The method includes: based on the obtained dependency relationship between service components and the internal data processing relationship information of the components, a data link is generated, the data link includes an original node, an intermediate node and an end node, and the number of intermediate nodes is multiple; based on the business characteristics of the end node, the business scenario category and the impact category of the end node are determined; according to the business scenario category and the impact category of the end node, the business attribute labels of the original node and the intermediate node are determined; the nodes involving multiple business scenario categories in the node and the number of impact categories of the nodes with an impact greater than or equal to 2 are set as the first key node, the nodes are the original nodes and the intermediate nodes, and the number of the first key nodes is at least one; the nodes that have a connection relationship with the first key node are analyzed to determine the key path containing the first key node. In the embodiment of the present invention, the business scenario category and the impact category of the end node are determined according to the business characteristics of the end node of the data link, and then the business attribute label of each node is determined. Then, the nodes involving multiple business scenario categories in the node and the number of impact categories of the nodes with an impact greater than or equal to 2 are set as the first key node; the nodes that have a connection relationship with the first key node are analyzed to determine the key path containing the first key node. It can accurately determine the importance of a certain business data and can determine the critical path in the business processing process. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0039] Figure 1 A schematic diagram of a flow chart of a path generation method according to an embodiment of the present invention;
[0040] Figure 2 The AOV network diagram corresponding to the data link of a certain service shown in an embodiment of the present invention;
[0041] Figure 3 The AOE network diagram corresponding to the data link of a certain service shown in an embodiment of the present invention;
[0042] Figure 4 A schematic diagram of a flow chart of another path generation method according to an embodiment of the present invention;
[0043] Figure 5 A schematic diagram of the structure of a path generating device according to an embodiment of the present invention;
[0044] Figure 6 The figure is a schematic diagram of the structure of another path generating device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0046] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.
[0047] In the embodiment of the present invention, the business scenario category and impact category of the end node are first determined according to the business characteristics of the end node of the data link, and then the business attribute label of each node is determined. Then, the nodes involving multiple business scenario categories and the number of nodes with an impact category of being influential or greater than 2 are set as the first key node; the nodes connected to the first key node are analyzed to determine the key path containing the first key node. The importance of a certain business data can be accurately determined, and the key path in the business processing process can be determined.
[0048] See also Figure 1 , is a flow chart of a path generation method provided by an embodiment of the present invention, the method comprising:
[0049] Step S101: Generate a data link based on the obtained dependency relationship between service components and the internal data processing relationship information of the components.
[0050] In step S101: the data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple.
[0051] It should be noted that the dependency relationship between service components is used to indicate data exchange between components, specifically including the upstream and downstream file paths, file names, and file transfer node numbers of the service components.
[0052] The internal processing relationship information of the component is used to indicate the batch processing relationship information within the component, specifically including batch processing pre-dependencies, input information and output information.
[0053] In the process of implementing step S101, the dependency relationship between service components and the internal data processing relationship information of the components are obtained, and the dependency relationship between service components and the internal data processing relationship information of the components are sorted; so as to form a data link according to elements such as file path, file name, batch processing pre-dependency, etc.
[0054] It should be noted that the data link includes multiple batch processing jobs and multiple data exchange nodes.
[0055] In the embodiment of the present invention, the data link can be displayed in the form of an AOV network, such as Figure 2 As shown, an example is used to illustrate below.
[0056] Assume that the service components required for a certain business include service component A, service component B, service component C, service component D, service component E, and service component F; each service component includes its own data node and / or job node. Among them, service component A includes data A, service component B includes data B, service component C includes data C1, data C2, data C3 and jobs C1, job C2, job C3, service component D includes data D, service component E includes data E, and service component F includes data F.
[0057] The file path of the dependency relationship between components determines that data C1 comes from service component A, data C2 comes from service component B, jobs C1 and C2 depend on data C1 and data C2 respectively, data D in service component D, data E in service component E, and data F in service component F all come from data C3 in service component C. The batch pre-dependency of the internal processing relationship of the component determines that job C3 depends on job C1 and job C2, and the output information includes the processed output data C3 of job C1 and job C2.
[0058] It should be noted that each data is a node, and each job is also a node.
[0059] Step S102: Based on the business characteristics of the end node, determine the business scenario category and impact category of the end node.
[0060] Since the end node is the final node of the business processing, the end node has clear business characteristics, that is, the business scenario. In the specific implementation of step S102, the business scenario category is determined according to the data exchange process defined from the business perspective and the business function of batch processing in the service component where the end node is located; then it is determined whether the business scenario category is a technical category or a category with unclear business functions. If so, the impact category is determined to be no impact, and if not, the impact category is determined to be impacted.
[0061] It should be noted that impact includes impact on experience and impact on business, while no impact includes slight impact or no impact.
[0062] Business scenario classification includes business scenario primary classification or business scenario secondary classification, among which business scenario secondary classification belongs to primary classification. For example, when the business scenario primary classification is funds and accounts, the business scenario secondary classification corresponding to the funds and accounts includes customer accounts, internal accounts, and accounting information, which can be expressed as funds and accounts (customer accounts, internal accounts, and accounting information). Or it can be a report category (end-of-day report, beginning-of-day report, monthly report, ten-day report, scheduled report, regulatory report, semi-annual report, annual report, income report, profit and loss report, etc.) and an opening category (US dollar settlement of New York Branch).
[0063] Step S103: Determine the business attribute labels of the original node and the intermediate node respectively according to the business scenario category and impact category of the terminal node.
[0064] It should be noted that the process of executing step S103 includes the following steps:
[0065] Step S11: According to the business scenario category and impact category of the terminal node and the rule of reverse tracing of the data link, determine the business scenario category and impact category undertaken by the intermediate node.
[0066] In the process of implementing step S11, the business scenario category and impact category of the data link end node can be clarified according to step S102, so the business scenario category and impact category of the end node are traced back to the intermediate node layer by layer according to the data link. That is to say, the intermediate node connected to the end node, that is, the last layer of intermediate nodes, inherits the business scenario category and impact category of the end node according to the reverse tracing of the data link, and the second-to-last layer of intermediate nodes connected to the last layer of intermediate nodes inherits the business scenario category and impact category of the last layer of intermediate nodes according to the reverse tracing of the data link, and so on, until all intermediate nodes inherit the business scenario category and impact category.
[0067] It should be noted that the rule for reverse tracing of the data link is to trace back layer by layer from the end node to the intermediate node and then to the original node.
[0068] Step S12: According to the business scenarios and impact levels undertaken by the intermediate nodes and in accordance with the rules of data link reverse tracing, the business scenario categories and impact categories of the original nodes are determined.
[0069] In the process of implementing step S12, the business scenario category and impact category of the intermediate node can be clarified according to the above step S11, so the business scenario category and impact category of the intermediate node are traced back layer by layer according to the data link. That is to say, the original node inherits the business scenario category and impact category of the intermediate node by reversely tracing back according to the data link.
[0070] Step S13: Label the business scenario category and impact category undertaken by each node to obtain a business attribute label.
[0071] Step S13: For each node, the inherited business scenario category and impact category are labeled using the business attribute label to obtain the business attribute label corresponding to each node.
[0072] It should be noted that when a node has multiple business scenario categories and impact categories, it is necessary to use business attribute labels to mark each inherited business scenario category and impact category separately, that is, the business attribute label of the node can be expressed as: [service component 1][business scenario category 1][impact category 1]…[service component n][business scenario category n][impact category n].
[0073] In order to better understand the above content, an example is provided below for explanation.
[0074] For example: Figure 2 Data C3, this node can reversely trace back the inherited terminal nodes, that is, the business scenario categories and impact categories of data D, data E and data F.
[0075] Among them, the business scenario category of data D is the second-level classification of business scenarios, and the impact category is influential; the business scenario category of data E is the second-level classification of business scenarios, and the impact category is influential; the business scenario category of data F is the second-level classification of business scenarios, and the impact category is no impact.
[0076] Use business attribute labels to mark the business scenario categories and impact categories of the inherited data D, data E, and data F respectively, and obtain [service component D][business scenario secondary classification D][impactful D][service component E][business scenario secondary classification E][impactful E][service component F][business scenario primary classification F][impactful F].
[0077] Step S104: For each node, determine whether there are nodes in the business attribute label whose impact category is greater than or equal to 2 and there are multiple business scenario categories. If so, execute step S105. If not, directly analyze all nodes to determine the critical path.
[0078] In step S104, the nodes are original nodes and intermediate nodes.
[0079] It should be noted that the process of executing step S104 includes the following steps:
[0080] Step S21: Calculate the number of nodes with an impact category of having an impact in the business attribute tag of each node and the number of business scenario categories of each node.
[0081] In the process of specifically implementing step S21, for each node, the number of influence categories inherited by the node as having influence is counted, and the number of inherited business scenario categories is counted.
[0082] Step S22: Determine whether there are nodes whose impact categories are greater than or equal to 2 and whose business scenario categories are multiple. If a node involves multiple business scenario categories and whose impact categories are greater than or equal to 2, the node can be considered a key node. If not, directly analyze all nodes to determine the key path.
[0083] In the specific implementation of step S22, it is compared whether there are multiple business scenario categories involved in each node, and whether the number of impact categories in each node is greater than or equal to 2. If there are multiple business scenario categories involved in a node, and the number of impact categories is greater than or equal to 2, the node can be considered as a key node. If not, all nodes are directly analyzed to determine the key path.
[0084] Step S105: setting the node as the first key node.
[0085] In the specific implementation of step S105, the nodes involving multiple business scenario categories, that is, the business scenario range is wide, and the number of nodes with an impact category of influential being greater than or equal to 2 are set as the first key nodes.
[0086] Step S106: Analyze the nodes that are connected to the first key node to determine the key path including the first key node.
[0087] In the specific implementation of step S106, an activity-on-edge AOE network is established based on the nodes connected to the first key node and the first key node, and the activity-on-edge AOE network is analyzed to obtain a key path including the first key node.
[0088] In the embodiment of the present invention, the business scenario category and impact category of the end node are first determined according to the business characteristics of the end node of the data link, and then the business attribute label of each node is determined. Then, the nodes involving multiple business scenario categories and the number of nodes with an impact category of being influential or greater than 2 are set as the first key node; the nodes connected to the first key node are analyzed to determine the key path containing the first key node. The importance of a certain business data can be accurately determined, and the key path in the business processing process can be determined.
[0089] Based on the path generation method shown in the above embodiment of the present invention, in the process of executing step S106 to analyze the nodes connected to the first key node and determine the key path including the first key node, the following steps are also included:
[0090] Step S31: Generate an activity-on-edge AOE network based on the file transfer time, batch processing time and nodes between nodes.
[0091] In step S31, the file transfer time and batch processing time between nodes are collected when the service component performs data processing.
[0092] In the process of implementing step S31, when the service component performs data processing, it first collects the time consumption of data exchange and batch processing activities, that is, collects the file transfer time between nodes, and the batch processing time between nodes; and uses the nodes as the vertices of the activity on the edge AOE network, and uses the file transfer time and batch processing time between nodes as the weights on the edges connecting the vertices, to obtain the activity on the edge AOE network corresponding to the business.
[0093] In order to better understand the process of generating AOE network shown above, Figure 2 The data link shown is Figure 3As shown, an example is given.
[0094] For example: Figure 2 The data interaction time between data A of service component A and data C1 of service component C, also called file transfer time, can be expressed as: file transfer time <data A, data C1>; the data interaction time between data B of service component B and data C2 of service component C can be expressed as: file transfer time <data B, data C2>; the data interaction time between data C3 of service component C and data D of service component D, data E of service component E, and data F of service component F, respectively, can be expressed as: file transfer time <data C3, data D>, file transfer time <data C3, data E> >, file transfer time <data C3, data F>; job C3 within service component C depends on job C1, and the prerequisite of job C3 is the processing time of job C1, also known as batch processing time, which can be expressed as: batch processing time <job C1, job C3>; job C3 within service component C depends on job C2, and the prerequisite of job C3 is the processing time of job C2, which can be expressed as: batch processing time <job C2, job C3>; job C3 within service component C processes the output data C3, which can be expressed as: batch processing time <job C3, data C3>.
[0095] Take data A, data B, data C1, data C2, data C3 and job C1, job C2, job C3, data D, data E, data F as vertices of the AOE network and label them in sequence. Take file transfer time <data A, data C1>, file transfer time <data B, data C2>, file transfer time <data C3, data D>, file transfer time <data C3, data E>, file transfer time <data C3, data F>, batch processing time <job C1, job C3>, batch processing time <job C2, job C3>, and batch processing time <job C3, data C3> as the weights of the edges connecting the vertices to obtain the AOE network corresponding to the data link.
[0096] like Figure 3 As shown, event V0 indicates the start, data A indicates event V1, data B indicates event V2, data C1 indicates event V3, data C2 indicates event V4, job C1 indicates event V5, job C2 indicates event V6, job C3 indicates event V7, data C3 indicates event V8, data D indicates event V9, data E indicates event V10, and data F indicates event V11. File transfer time <data A, data C1> indicates the duration of the activity from data A to data C1, and so on, file transfer time <data C3, data F> indicates the duration of the activity from data C3 to data F.
[0097] It should be noted that the AOE network is a directed acyclic graph with weighted edges. Vertices represent events, edges represent activities, and the weights on the edges represent the duration of the activities.
[0098] Step S32: Analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node, so as to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node.
[0099] In the specific implementation of step S32, first, since event V0 indicates the start of an event, the earliest occurrence time of event V0 Ve(0) = 0. According to the AOE network critical path algorithm, the file transfer time or batch processing time of the directed edge and the earliest occurrence time of the previous event are substituted into formula (1) to determine the earliest occurrence time Ve(j) of each remaining event.
[0100] It should be noted that j is the maximum number of AOE network events that is greater than or equal to 1 and less than or equal to 1, and j represents the number of the event that currently needs to be calculated.
[0101] Ve(j)=max(i){Ve(i)+g.GetWeight(i,j)|<Vi,Vj> εE}(1)
[0102] in,<Vi,Vj> is a directed edge in the AOE network. Event Vi is the direct predecessor of event Vj, that is, event Vi is the previous event of event Vj, so i equals j minus 1; Ve(i) represents the earliest occurrence time of Vi, and E represents the Figure 3 The edge set of g.GetWeight(i,j) refers to<Vi,Vj> file transfer time or batch processing time.
[0103] Next, since the latest occurrence time Vl(i) of event Vi is determined without affecting the timeliness of the terminal node, Vl(i) is calculated in the order of reverse topological sorting, starting from Vl(n-1) = Ve(n-1). For example: when it is the maximum number of AOE network events, the latest occurrence time of event Vj Vi(j) = Ve(j). According to the AOE network critical path algorithm, the file transfer time or batch processing time of the directed edge and the latest occurrence time of the next event are substituted into formula (2) to determine the latest occurrence time Vl(i) of each remaining event.
[0104] It should be noted that i represents the number of the event that currently needs to be calculated.
[0105] Vl(i)=min(j){Vl(j)-g.GetWeight(i,j)|<Vi,Vj> εE}(2)
[0106] in,<Vi,Vj> is a directed edge in the AOE network. Event Vj is the direct successor of event Vi. That is, event Vj is the next event of event Vi. Therefore, i is equal to j minus 1. Vl(i) represents the latest occurrence time of Vi. E represents the event that belongs to Figure 3 The edge set of g.GetWeight(i,j) refers to<Vi,Vj> file transfer time or batch processing time.
[0107] Then, due to the activity<Vi,Vj> The earliest start time ee1(i,j) of the activity is the longest path length from time V0 to Vi. Therefore, Ve(j) calculated according to the above formula (1) can be substituted into formula (3) to determine the activity<Vi,Vj> The earliest start time ee1(i,j).
[0108] ee1(i,j)=Ve(i)=Ve(j-1)(3)
[0109] Among them, Ve(i)=Ve(j-1) is the earliest occurrence time of event Vi.
[0110] Finally, according to the AOE network critical path algorithm, the file transfer time or batch processing time of the directed edge and the latest occurrence time Vl(i) calculated by the above formula (2) are substituted into formula (4) to determine the activity<Vi,Vj> The latest start time ee2(i,j).
[0111] ee2(i,j)=Vl(j)-g.GetWeight(i,j)(4)
[0112] Where Vl(j) is the latest event time of event Vj, and g.GetWeight(i,j) is<Vi,Vj> file transfer time or batch processing time.
[0113] Step S33: Determine the critical path based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node.
[0114] In step S33, the key path includes the first key node and other key nodes connected to the first key node.
[0115] In the specific implementation of step S33, determine the activity whose earliest start time ee1(i,j) is equal to the latest start time ee2(i,j).<Vi,Vj> , and the activity<Vi,Vj> The path formed is called the critical path.
[0116] It should be noted that the activities that make up the path<Vi,Vj> The corresponding events refer to the nodes included in the critical path.
[0117] In an embodiment of the present invention, an AOE network with activities on the edge is generated according to the file transfer time, batch processing time and nodes between nodes. The AOE network is analyzed and calculated according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node. Based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, the critical path is determined. The importance of a certain business data can be accurately determined, and the critical path in the business processing process can be determined.
[0118] Based on the path generation method shown in the above embodiment of the present invention, combined with Figure 1 , see Figure 4 , the path generation method further includes:
[0119] Step S107: Obtain the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
[0120] In the specific implementation of step S107, all nodes in the critical path, ie events, are determined; and the business attribute labels corresponding to the first critical node and other critical nodes are obtained, and the business attribute labels corresponding to the first critical node and other critical nodes are displayed for the convenience of technical personnel to view.
[0121] Compared with the path generation method shown in the above invention, after determining that all nodes exist in the critical path, the business attribute labels corresponding to the first critical node and other critical nodes are obtained, and the business attribute labels corresponding to the first critical node and other critical nodes are displayed. It is possible to realize the identification of multiple business scenarios and importance of link nodes. In addition, it is possible to accurately judge the business impact, focus on monitoring, and analyze the operation bottleneck in advance.
[0122] Corresponding to the path generation method shown in the above embodiment of the present invention, the present invention also discloses a path generation device, such as Figure 5 The above is a result schematic diagram of a path generation device shown in an embodiment of the present invention, and the device includes:
[0123] The link generation unit 501 is used to generate a data link based on the obtained dependency relationship between service components and the internal data processing relationship information of the components. The data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple.
[0124] The first determining unit 502 is configured to determine a service scenario category and an impact category of the terminal node based on the service characteristics of the terminal node.
[0125] The second determining unit 503 is configured to determine the service attribute labels of the original node and the intermediate node respectively according to the service scenario category and the impact category of the terminal node.
[0126] The analyzing unit 505 is configured to analyze nodes connected to the first key node to determine a key path including the first key node.
[0127] Optionally, based on the above-mentioned present invention, the path generation device shown is implemented, and the second determination unit 503 is specifically used to: determine the business scenario category and impact category undertaken by the intermediate node according to the business scenario category and impact category of the terminal node and the rule of reverse tracing of the data link; determine the business scenario category and impact category of the original node according to the business scenario and impact level undertaken by the intermediate node and the rule of reverse tracing of the data link; mark the business scenario category and impact category undertaken by each node to obtain a business attribute label.
[0128] Optionally, based on the above-mentioned present invention, the path generation device shown is implemented, and the second determination unit 503 is specifically used to: set the unit 504, specifically used to: calculate the number of nodes with impact categories as influential in the business attribute label of each node, and the number of business scenario categories of each node; determine whether there are nodes whose number of impact categories as influential is greater than or equal to 2, and the number of business scenario categories is multiple; if so, set the node as a first key node, and the number of the first key nodes is at least one.
[0129] Optionally, the analysis unit 505 is specifically used to: generate an AOE network with activities on the edge according to the file transfer time, batch processing time and nodes between nodes, wherein the file transfer time and batch processing time between nodes are collected when the service component performs data processing; analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node; determine the critical path based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, wherein the critical path includes the first critical node and other critical nodes connected to the first critical node.
[0130] It should be noted that the specific principles and execution processes of each unit in the path generation device disclosed in the above embodiment of the present invention are the same as those of the path generation method implemented in the above embodiment of the present invention. Please refer to the corresponding parts of the path generation method disclosed in the above embodiment of the present invention, and no further details will be given here.
[0131] In the embodiment of the present invention, the business scenario category and impact category of the end node are first determined according to the business characteristics of the end node of the data link, and then the business attribute label of each node is determined. Then, the nodes involving multiple business scenario categories and the number of nodes with an impact category of being influential or greater than 2 are set as the first key node; the nodes connected to the first key node are analyzed to determine the key path containing the first key node. The importance of a certain business data can be accurately determined, and the key path in the business processing process can be determined.
[0132] Optionally, based on the path generation device shown in the above embodiment of the present invention, combined with Figure 5 , see Figure 6 The path generating device is further provided with a display unit 506.
[0133] The display unit 506 is used to obtain the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
[0134] Compared with the path generation method shown in the above invention, after determining that all nodes exist in the critical path, the business attribute labels corresponding to the first critical node and other critical nodes are obtained, and the business attribute labels corresponding to the first critical node and other critical nodes are displayed. It is possible to realize the identification of multiple business scenarios and importance of link nodes. In addition, it is possible to accurately judge the business impact, focus on monitoring, and analyze the operation bottleneck in advance.
[0135] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without creative work.
[0136] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0137] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A path generation method, characterized in that: The method comprises: Generate a data link based on the obtained dependency relationship between service components and the internal data processing relationship information of the components, wherein the dependency relationship between the service components is used to indicate the data exchange between the service components, and the dependency relationship between the service components includes the upstream and downstream file paths, file names and file transfer node numbers of the service components; the internal data processing relationship information of the components is used to indicate the batch processing relationship information within the service components, and the internal data of the components includes the batch processing pre-dependency, input information and output information within the components; the data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple; Determine, based on the service characteristics of the terminal node, a service scenario category and an impact category of the terminal node, wherein the impact category includes no impact and impact; Determine the business attribute labels of the original node and the intermediate node respectively according to the business scenario category and the impact category of the terminal node; the business attribute labels include the business scenario category and the impact category; Set the nodes involving multiple business scenario categories and the number of nodes with an impact category of being influential that is greater than or equal to 2 as first key nodes, the nodes are original nodes and intermediate nodes, and the number of the first key nodes is at least one; An activity-on-edge AOE network is established based on nodes connected to the first key node and the first key node, and a key path including the first key node is determined based on the activity-on-edge AOE network.
2. The method according to claim 1, characterized in that Determining the business attribute labels of the original node and the intermediate node according to the business scenario category and the impact category of the terminal node includes: According to the business scenario category and impact category of the terminal node, and in accordance with the rule of reverse tracing of the data link, determine the business scenario category and impact category undertaken by the intermediate node; According to the business scenarios and impact levels undertaken by the intermediate nodes, and in accordance with the rules of reverse tracing of the data link, determine the business scenario category and impact category of the original node; The business scenario category and impact category undertaken by each node are marked to obtain the business attribute label.
3. The method according to claim 1, characterized in that The step of setting the nodes involving multiple business scenario categories and having an impact category of having an impact greater than or equal to 2 as the first key nodes includes: Calculate the number of nodes with an impact category of having an impact in the business attribute tag of each node and the number of business scenario categories of each node; Determine whether there are nodes whose number of the impact categories being impacted is greater than or equal to 2 and whose number of the business scenario categories is multiple; If so, the node is set as a first key node, and the number of the first key nodes is at least one.
4. The method according to claim 1, characterized in that: The step of establishing an activity-on-edge AOE network based on a node connected to the first key node and the first key node, and determining a key path including the first key node based on the activity-on-edge AOE network includes: Generate an activity on the edge AOE network according to the file transmission time, batch processing time and node between nodes, wherein the file transmission time and batch processing time between nodes are collected when the service component performs data processing; Analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node, so as to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node; Based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, a critical path is determined, where the critical path includes the first critical node and other critical nodes connected to the first critical node.
5. The method according to claim 4, characterized in that Also includes: Get the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
6. A path generation device, characterized in that: The device comprises: A link generation unit is used to generate a data link based on the obtained dependency relationship between service components and the internal data processing relationship information of the components, wherein the dependency relationship between the service components is used to indicate the data exchange between the service components, and the dependency relationship between the service components includes the upstream and downstream file paths, file names and file transfer node numbers of the service components; the internal data processing relationship information of the components is used to indicate the batch processing relationship information within the service components, and the internal data of the components includes the batch processing pre-dependency, input information and output information within the components; the data link includes an original node, an intermediate node and an end node, and the number of the intermediate nodes is multiple; A first determining unit, configured to determine a service scenario category and an impact category of the terminal node based on a service characteristic of the terminal node, wherein the impact category includes no impact and impact; A second determining unit is used to determine the business attribute labels of the original node and the intermediate node according to the business scenario category and the impact category of the terminal node; the business attribute label includes the business scenario category and the impact category; A setting unit, configured to set nodes involving multiple business scenario categories and having an impact category of having an impact greater than or equal to 2 as first key nodes, wherein the nodes are original nodes and intermediate nodes, and the number of the first key nodes is at least one; An analysis unit is used to establish an activity-on-edge AOE network based on nodes connected to the first key node and the first key node, and determine a key path including the first key node based on the activity-on-edge AOE network.
7. The device according to claim 6, characterized in that The second determination unit is specifically configured to: determine the business scenario category and impact category undertaken by the intermediate node according to the business scenario category and impact category of the terminal node and the rule of reverse tracing of the data link; determine the business scenario category and impact category of the original node according to the business scenario and impact level undertaken by the intermediate node and the rule of reverse tracing of the data link; The business scenario category and impact category undertaken by each node are marked to obtain the business attribute label.
8. The device according to claim 6, characterized in that The setting unit is specifically used to: calculate the number of nodes with an impact category of having an impact in the business attribute label of each node, and the number of business scenario categories of each node; determine whether there are nodes with a number of impact categories of having an impact of greater than or equal to 2, and a number of business scenario categories of more than one; If so, the node is set as a first key node, and the number of the first key nodes is at least one.
9. The device according to claim 6, characterized in that The analysis unit is specifically used to: generate an AOE network with activities on the edge according to the file transfer time, batch processing time and nodes between nodes, wherein the file transfer time and batch processing time between nodes are collected when the service component performs data processing; analyze and calculate the AOE network according to the AOE network critical path algorithm to obtain the earliest occurrence time and the latest occurrence time of each node, so as to determine the earliest occurrence time and the latest occurrence time of the activity corresponding to each node; Based on the earliest occurrence time and the latest occurrence time of the activity corresponding to each node, a critical path is determined, where the critical path includes the first critical node and other critical nodes connected to the first critical node.
10. The device according to claim 6, characterized in that Also includes: The display unit is used to obtain the business attribute labels corresponding to the first key node and other key nodes, and output them for display.
Citation Information
Patent Citations
Distributed system job scheduling system and method
CN107239335A
Process key operation node identification method and device
CN112036751A