Visualization method and device of big data job link, equipment and storage medium

By generating a visual page of the initial job link in large data batch jobs and real-time updates in response to page update instructions, it solves the problem that it is difficult for workers to intuitively understand the dependencies and operating status of job tasks, and realizes efficient job link visualization and real-time monitoring.

CN119597289APending Publication Date: 2025-03-11INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411831458.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-12
Publication Date
2025-03-11

AI Technical Summary

Technical Problem

In big data batch operations, it is difficult for relevant staff to intuitively understand the dependencies between job tasks and the operating status of job tasks, resulting in a lack of real-time and effectiveness of the visualization of job links.

Method used

By responding to the initialization request of the visual page, the target job task is positioned and task controls are generated, the pre- and post-tasks are determined according to the task dependencies, and the task control is connected by the pointing arrow to generate a visual page of the initial job link. At the same time, in response to the page update instruction, the visual page is updated based on the task dependency.

Benefits of technology

Real-time monitoring of the status of job tasks is achieved, redundant information of visual pages is reduced, page generation efficiency is improved, rendering time and memory resource consumption is reduced, and the stability and reliability of the operating system is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119597289A_ABST
    Figure CN119597289A_ABST
Patent Text Reader

Abstract

The invention discloses a visualization method, device and equipment of a big data job link and a storage medium, and is applied to the technical field of big data, the visualization method of the big data job link comprises the following steps: in response to an initialization request of a visualization page, positioning a target job task in current big data job tasks, generating a task control of the target job task; determining a front task and a rear task of the target job task according to the task dependency relationship of the target job task, and connecting the target job task with the corresponding front task and rear task through a pointing arrow to generate a visual page of an initial job link; and in response to the page updating instruction, updating the visual page of the initial job link based on the task dependency relationship of the job task corresponding to the outermost task control in the visual page. Through the technical scheme, redundant information in the visual page is reduced, and the generation efficiency of the visual page is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of big data technology, and in particular to a visualization method, device, equipment and storage medium for a big data operation link. Background Art

[0002] Big data development usually requires processing massive amounts of data. It is unrealistic to process this data in real time. Therefore, we must process large amounts of data more effectively through batch jobs to improve processing efficiency and performance. However, when running big data batch jobs, due to the need to process large amounts of data and numerous job tasks, relevant staff cannot intuitively understand the dependencies between job tasks and the running status of job tasks. Therefore, the visualization of the job chain is of great significance. Summary of the invention

[0003] The present invention provides a visualization method, device, equipment and storage medium for a big data operation link, which can realize real-time monitoring of the operation status of the operation task and improve the stability and reliability of the operation system.

[0004] According to one aspect of the present invention, a visualization method for a big data operation link is provided, the method comprising:

[0005] In response to the initialization request of the visualization page, locate the target job task in the current big data job task, and generate a task control of the target job task;

[0006] Determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls for the predecessor task and successor task of the target task;

[0007] According to the task dependency relationship of the target job task, the target job task is connected with its corresponding predecessor task and successor task through pointing arrows to generate a visualization page of the initial job link;

[0008] In response to the page update instruction, the visualization page of the initial job link is updated based on the task dependency relationship of the job task corresponding to the outermost task control in the visualization page; wherein the page update instruction includes a page right update instruction and a page left update instruction.

[0009] According to another aspect of the present invention, a visualization device for a big data operation link is provided, the device comprising:

[0010] A target job positioning module is used to locate the target job task in the current big data job task in response to the initialization request of the visualization page, and generate a task control of the target job task;

[0011] A task dependency module, used to determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls for the predecessor task and successor task of the target task;

[0012] An initial page generation module is used to connect the target job task with its corresponding predecessor task and successor task through pointing arrows according to the task dependency relationship of the target job task, so as to generate a visualization page of the initial job link;

[0013] A page update module is used to respond to a page update instruction and update the visualization page of the initial job link based on the task dependency relationship of the job task corresponding to the outermost task control in the visualization page; wherein the page update instruction includes a page right side update instruction and a page left side update instruction.

[0014] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the visualization method of the big data job link described in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the visualization method of a big data job link described in any embodiment of the present invention when executed.

[0019] According to another aspect of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the computer program implements the visualization method of a big data job link described in any embodiment of the present invention.

[0020] The technical solution of the embodiment of the present invention generates a visualization page of the initial job chain based on the task dependencies of the target job tasks, and displays the task dependencies between the three levels of job tasks in the visualization page of the initial job chain. This achieves that during the initialization of the visualization page, only key job tasks are visualized, which reduces redundant information in the visualization page, improves the generation efficiency of the visualization page, and reduces the rendering time of the visualization page, saving memory resources.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flowchart of a visualization method for a big data operation link provided according to the first embodiment of the present invention;

[0024] Figure 2 is a flowchart of a visualization method for a big data operation link provided according to Embodiment 2 of the present invention;

[0025] Figure 3 is a structural schematic diagram of a visualization device for a big data operation link provided according to a third embodiment of the present invention;

[0026] Figure 4 It is a structural schematic diagram of an electronic device for implementing the visualization method of a big data operation link according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] Embodiment 1

[0030] Figure 1 A flowchart of a visualization method for a big data job chain is provided for the first embodiment of the present invention. This embodiment can be applied to the job monitoring of big data batch jobs. The method can be executed by a visualization device for a big data job chain. The visualization device for a big data job chain can be implemented in the form of hardware and / or software. The visualization device for a big data job chain can be configured in various general-purpose computing devices, such as a terminal device equipped with a display. Figure 1 As shown, the method includes:

[0031] S110 , in response to the initialization request of the visualization page, locate the target job task in the current big data job task, and generate a task control of the target job task.

[0032] The initialization request for the visualization page may be a page entry instruction. For example, in a big data operation scenario, the initialization request for the visualization page may be a request for entering the visualization page of the big data operation scenario for the first time.

[0033] The target job task may refer to a job task with abnormal operation, such as a job with delay, stagnation or performance degradation. It should be noted that in the big data job scenario, there may be a very large number of batch job tasks. If all batch job tasks are displayed at the same time, the visualization page will inevitably be filled with batch job tasks at all levels, making it impossible for relevant operation and maintenance or developers to effectively observe key jobs.

[0034] Specifically, according to the initialization request of the visualization page issued by the user on the terminal device, the terminal device can respond to the initialization request of the visualization page, locate the target task in the current big data task, and generate the task control of the target task, laying the foundation for the subsequent generation of the visualization page with the target task. It should be noted that the terminal device stores all the job information of the current big data task.

[0035] S120: Determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls of the predecessor task and successor task of the target task.

[0036] The task dependency relationship may refer to the calling relationship and the called relationship of the job tasks. The predecessor task may refer to the job task that must be completed before the current job task is executed; the successor task may refer to the job task that can be executed only after the current job task is completed.

[0037] Specifically, after determining the target job task, the task dependency of the target job task can be queried to determine the predecessor task and successor task of the target job task, and respectively generate the task controls of the predecessor task and successor task of the target job task. It should be noted that the number of predecessor tasks and successor tasks can be determined according to the task dependency of the job task in the current big data job task.

[0038] S130. According to the task dependency relationship of the target job task, the target job task is connected with its corresponding predecessor task and successor task through pointing arrows to generate a visualization page of the initial job link.

[0039] Among them, the pointing arrow is used to connect the task controls corresponding to two different job tasks, and the direction of the pointing arrow can be used to indicate that the execution of the job task on one side of the arrow depends on the job task on the other side of the arrow.

[0040] In an embodiment of the present invention, a target job task and its corresponding predecessor task and successor task are connected by pointing arrows, the pointing arrow points from the predecessor task of the target job task to the target job task, and the pointing arrow points from the target job task to the successor task of the target job task. It should be noted that all predecessor tasks or successor tasks directly connected to a job task are called jobs of the same level. Therefore, in the visualization page of the initial job link, only three levels of job tasks are displayed at most, and the most critical job information can be displayed with the least amount of information, reducing the rendering time of the page. It should be noted that in the visualization page of the job link, each task control can be named according to the task identifier of the job task corresponding to the task control. Optionally, the task identifier can be adaptively set according to those skilled in the art, such as the task name or directory address of each job task.

[0041] Optionally, after the visualization page of the initial job link is generated, it can be displayed on a display.

[0042] S140 . In response to the page update instruction, the visualization page of the initial job link is updated based on the task dependency relationship of the job tasks corresponding to the outermost task controls in the visualization page.

[0043] The page update instruction is an instruction issued by the user to update the visualization page of the initial operation link.

[0044] It should be noted that the job tasks corresponding to the outermost task controls in the visualization page of the initial job link are the predecessor tasks and successor tasks of the target job task.

[0045] The technical solution of the embodiment of the present invention generates a visualization page of the initial job chain based on the task dependencies of the target job tasks, and displays the task dependencies between the three levels of job tasks in the visualization page of the initial job chain. This achieves that during the initialization of the visualization page, only key job tasks are visualized, which reduces redundant information in the visualization page, improves the generation efficiency of the visualization page, and reduces the rendering time of the visualization page, saving memory resources.

[0046] Embodiment 2

[0047] Figure 2This is a flowchart of a visualization method for a big data job chain provided in the second embodiment of the present invention. This embodiment further refines the above embodiment and provides specific steps for updating the visualization page of the initial job chain in response to a page update instruction based on the task dependencies of the job tasks corresponding to the outermost task controls in the visualization page. It should be noted that for the undetailed parts of the embodiments of the present invention, please refer to the relevant descriptions of other embodiments, which will not be repeated here. Figure 2 As shown, the method includes:

[0048] S210 , in response to the initialization request of the visualization page, locate the target job task in the current big data job task, and generate a task control of the target job task.

[0049] S220: Determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls of the predecessor task and successor task of the target task.

[0050] S230. According to the task dependency relationship of the target job task, the target job task is connected with its corresponding predecessor task and successor task through pointing arrows to generate a visualization page of the initial job link.

[0051] S240: When the page update instruction is a right page update instruction, at least one job task corresponding to the rightmost task control in the visualization page is used as the current job task.

[0052] S250: Determine the post-task corresponding to the current job task according to the task dependency relationship of the current job task, and generate a task control corresponding to the post-task.

[0053] S260: According to the task dependency relationship of the current job task, the subsequent task is connected to the current job task through a pointing arrow, and the visualization page of the initial job link is updated.

[0054] Optionally, in another specific embodiment of the present invention, when the page update instruction is a left page update instruction, at least one job task corresponding to the leftmost task control in the visualization page is used as the current job task; based on the task dependency relationship of the current job task, the predecessor task corresponding to the current job task is determined, and a task control corresponding to the predecessor task is generated; based on the task dependency relationship of the current job task, the predecessor task is connected with the current job task by a pointing arrow, and the visualization page of the initial job link is updated.

[0055] In an embodiment of the present invention, after the visualization page of the initial job link is generated, if the user wants to see more job tasks in the visualization page, the user can operate on the current visualization page and issue a page update instruction. For example, if the user drags the scroll bar of the visualization page to the right, the terminal device will recognize the right page update instruction, and if the user drags the scroll bar of the visualization page to the left, the terminal device will recognize the left page update instruction; after recognizing the right page update instruction, the terminal device will take at least one job task corresponding to the task control of the same level on the rightmost side of the current visualization page as the current job task, and query the task dependency of the current job task, determine the post-task of the current job task, and generate the task control of the post-task at the same time. The task control of the current job task is connected with the task control of the post-task through a pointing arrow, and the arrow indicates the direction from the task control of the current job task to the task control of the post-task. Similarly, after recognizing the left page update instruction, the terminal device will take at least one job task corresponding to the task control of the same level on the leftmost side of the current visualization page as the current job task, and query the task dependency of the current job task, determine the pre-task of the current job task, and generate the task control of the pre-task at the same time. The task control of the current job task is connected to the task control of the predecessor task through a pointing arrow, and the arrow indicates a direction from the task control of the predecessor task to the task control of the current job task.

[0056] Optionally, in another embodiment of the present invention, for a task control in a job link, according to the job status of the job task corresponding to the task control, a job color corresponding to the job status can be configured for the task control.

[0057] The job status may include an execution status, a pending execution status, and an abnormal status.

[0058] Specifically, by obtaining the job status of the job task corresponding to each task control in the current visualization page, the job color corresponding to the job status is configured for the task control. For example, if the job status of the job task is in the execution state, the task control corresponding to the job task is configured to be blue; if the job status of the job task is in the pending state, the task control corresponding to the job task is configured to be yellow; if the job status of the job task is in the abnormal state, the task control corresponding to the job task is configured to be red. Optionally, the mapping relationship between the job status and the job color can be adaptively set according to those skilled in the art.

[0059] By obtaining the job status of the job task and configuring the corresponding job color for the task control, users can easily know the execution status of each job task and quickly find the job task with a running failure, thereby improving the user experience.

[0060] Optionally, in another embodiment of the present invention, a task information pop-up window may be generated for the target control in response to a task information display instruction.

[0061] The task information pop-up window can be used to display the task information of the job task corresponding to the target control, and the target control can be a task control that responds to the task information display instruction. It should be noted that the task information of the job task can include the job start and end time information, the start monitoring time information, the job priority information, the task name, and the system to which the task belongs.

[0062] Specifically, when a user needs to know the task information of a job task corresponding to a task control, he can operate on the current visualization page and issue a task information display instruction. For example, when the user hovers the mouse over the task control for a preset time, the terminal device will recognize the task information display instruction and respond, generating a task information pop-up window corresponding to the task control, which is used to display the task information of the job task corresponding to the task control.

[0063] By responding to page update instructions and task information display instructions issued by users, the scalability of the visual page and good interactivity with users are achieved, which improves the user experience. At the same time, real-time monitoring of the running status and job information of job tasks in the batch job link is achieved, which helps developers understand problems and conduct fault analysis, and improves the stability and reliability of the batch job system.

[0064] The technical solution of the embodiment of the present invention dynamically updates the visualization page of the job chain according to user needs through page update instructions, ensuring that the visualization page of the job chain will only display the job tasks required by the user, avoiding the consumption of unnecessary computer resources, and at the same time improving the efficiency of generating the visualization page of the job chain, and dynamically updating the visualization page in an interactive manner, thereby improving the user experience.

[0065] Embodiment 3

[0066] Figure 3 This is a schematic diagram of the structure of a visualization device for a big data operation link provided by the third embodiment of the present invention. Figure 3 As shown, the device comprises:

[0067] The target job positioning module 310 is used to locate the target job task in the current big data job task in response to the initialization request of the visualization page, and generate a task control of the target job task;

[0068] The task dependency module 320 is used to determine the predecessor task and the successor task of the target task according to the task dependency relationship of the target task, and generate the task controls of the predecessor task and the successor task of the target task;

[0069] The initial page generation module 330 is used to connect the target job task with its corresponding predecessor task and successor task through pointing arrows according to the task dependency relationship of the target job task, so as to generate a visualization page of the initial job link;

[0070] The page update module 340 is used to respond to the page update instruction and update the visualization page of the initial job link based on the task dependency relationship of the job task corresponding to the outermost task control in the visualization page; wherein the page update instruction includes the page right side update instruction and the page left side update instruction.

[0071] The technical solution of the embodiment of the present invention generates a visualization page of the initial job chain based on the task dependencies of the target job tasks, and displays the task dependencies between the three levels of job tasks in the visualization page of the initial job chain. This achieves that during the initialization of the visualization page, only key job tasks are visualized, which reduces redundant information in the visualization page, improves the generation efficiency of the visualization page, and reduces the rendering time of the visualization page, saving memory resources.

[0072] Optionally, the page update module 340 can be specifically used for: when the page update instruction is a right-side page update instruction, taking at least one job task corresponding to the rightmost task control in the visualization page as the current job task; determining the post-task corresponding to the current job task according to the task dependency relationship of the current job task, and generating a task control corresponding to the post-task; according to the task dependency relationship of the current job task, connecting the post-task with the current job task by a pointing arrow, and updating the visualization page of the initial job link.

[0073] Optionally, the page update module 340 can also be specifically used for: when the page update instruction is a left page update instruction, at least one job task corresponding to the leftmost task control in the visualization page is used as the current job task; according to the task dependency relationship of the current job task, the predecessor task corresponding to the current job task is determined, and a task control corresponding to the predecessor task is generated; according to the task dependency relationship of the current job task, the predecessor task is connected with the current job task by a pointing arrow, and the visualization page of the initial job link is updated.

[0074] Optionally, the indicating direction of the pointing arrow can be used to indicate that the execution of a job task on one side of the arrow depends on the job task on the other side of the arrow.

[0075] Optionally, the device further comprises:

[0076] The color configuration module is used to configure the job color corresponding to the job status of the task control in the job link according to the job status of the job task corresponding to the task control; wherein the job status includes execution status, pending execution status and abnormal status.

[0077] Optionally, the device further comprises:

[0078] An information display module is used to generate a task information pop-up window for a target control in response to a task information display instruction; the task information pop-up window is used to display the task information of the job task corresponding to the target control, and the target control is a task control that responds to the task information display instruction.

[0079] The visualization device for a big data operation link provided in an embodiment of the present invention can execute the visualization method for a big data operation link provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0080] Embodiment 4

[0081] Figure 4 A schematic diagram of an electronic device 410 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0082] like Figure 4As shown, the electronic device 410 includes at least one processor 411, and a memory connected to the at least one processor 411 in communication, such as a read-only memory (ROM) 412, a random access memory (RAM) 413, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 411 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 412 or the computer program loaded from the storage unit 418 to the random access memory (RAM) 413. In the RAM 413, various programs and data required for the operation of the electronic device 410 can also be stored. The processor 411, the ROM 412, and the RAM 413 are connected to each other via a bus 414. An input / output (I / O) interface 415 is also connected to the bus 414.

[0083] Multiple components in the electronic device 410 are connected to the I / O interface 415, including: an input unit 416, such as a keyboard, a mouse, etc.; an output unit 417, such as various types of displays, speakers, etc.; a storage unit 418, such as a disk, an optical disk, etc.; and a communication unit 419, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 419 allows the electronic device 410 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0084] Processor 411 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of processor 411 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. Processor 411 executes the various methods and processes described above, such as a visualization method for a big data job link.

[0085] In some embodiments, the visualization method of the big data operation link may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 418. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 410 via the ROM 412 and / or the communication unit 419. When the computer program is loaded into the RAM 413 and executed by the processor 411, one or more steps of the visualization method of the big data operation link described above may be performed. Alternatively, in other embodiments, the processor 411 may be configured to perform the visualization method of the big data operation link by any other appropriate means (e.g., by means of firmware).

[0086] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0087] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0088] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0089] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0090] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0091] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0092] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0093] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A visualization method for a big data operation chain, characterized in that: include: In response to the initialization request of the visualization page, locate the target job task in the current big data job task, and generate a task control of the target job task; Determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls for the predecessor task and successor task of the target task; According to the task dependency relationship of the target job task, the target job task is connected with its corresponding predecessor task and successor task through pointing arrows to generate a visualization page of the initial job link; wherein the pointing arrows are used to connect task controls corresponding to two different job tasks; In response to the page update instruction, the visualization page of the initial job link is updated based on the task dependency relationship of the job task corresponding to the outermost task control in the visualization page; wherein the page update instruction includes a page right update instruction and a page left update instruction.

2. The method according to claim 1, characterized in that In response to the page update instruction, based on the task dependency relationship of the job tasks corresponding to the outermost task controls in the visualization page, the visualization page of the initial job link is updated, including: In the case where the page update instruction is a right page update instruction, at least one job task corresponding to the rightmost task control in the visualization page is used as the current job task; According to the task dependency of the current job task, determine the post-task corresponding to the current job task, and generate the task control corresponding to the post-task; According to the task dependency of the current job task, the subsequent task is connected to the current job task through a pointing arrow, and the visualization page of the initial job link is updated.

3. The method according to claim 1, characterized in that In response to the page update instruction, based on the task dependency relationship of the job tasks corresponding to the outermost task controls in the visualization page, the visualization page of the initial job link is updated, including: In the case where the page update instruction is a left page update instruction, at least one job task corresponding to the leftmost task control in the visualization page is used as the current job task; According to the task dependency of the current job task, determine the predecessor task corresponding to the current job task, and generate the task control corresponding to the predecessor task; According to the task dependency of the current job task, the predecessor task is connected with the current job task through a pointing arrow, and the visualization page of the initial job link is updated.

4. The method according to any one of claims 1 to 3, characterized in that: The indicating direction of the pointing arrow is used to indicate that the execution of the work task on one side of the arrow depends on the work task on the other side of the arrow.

5. The method according to claim 1, characterized in that Also includes: For a task control in a job link, a job color corresponding to the job status is configured for the task control according to the job status of the job task corresponding to the task control; wherein the job status includes an execution status, a pending execution status, and an abnormal status.

6. The method according to claim 1, characterized in that Also includes: In response to the task information display instruction, generating a task information pop-up window for the target control; The task information pop-up window is used to display the task information of the operation task corresponding to the target control, and the target control is a task control that responds to the task information display instruction.

7. A visualization device for a big data operation chain, characterized in that: include: A target job positioning module is used to locate the target job task in the current big data job task in response to the initialization request of the visualization page, and generate a task control of the target job task; A task dependency module, used to determine the predecessor task and successor task of the target task according to the task dependency relationship of the target task, and generate task controls for the predecessor task and successor task of the target task; An initial page generation module is used to connect the target job task with its corresponding predecessor task and successor task through pointing arrows according to the task dependency relationship of the target job task, so as to generate a visualization page of the initial job link; A page update module is used to respond to a page update instruction and update the visualization page of the initial job link based on the task dependency relationship of the job task corresponding to the outermost task control in the visualization page; wherein the page update instruction includes a page right side update instruction and a page left side update instruction.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the visualization method for a big data job link according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the visualization method for a big data job link according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that It includes a computer program, which, when executed by a processor, implements the visualization method of the big data operation link described in any one of claims 1 to 6.