Visual display device and method based on big data containerized dispatching center system

Abstract

The invention provides a visual display device and method based on a big data containerized dispatching center system. The visual display device comprises a workflow creation module which creates at least one workflow according to the business demands, manually drags each module operation to the workflow in a big data processing process, and customizes the dependence relation between each module operation in the workflow; a positioning module which is used for positioning the required content according to the input search content; a filtering module which performs content filtering according to the positioned content; a display module which displays the positioned content and the filtered content to a user in real time; and a highlighting module which highlights all workflow contents and upstream and downstream dependency relationships thereof in the directed acyclic graph panoramic display system, highlights all dependency relationships related to the contents when the mouse is arranged on the displayed contents, and pops up detailed information of the current contents. According to the visual display device, clear, concise and telescopic panoramic display in a big data containerized dispatching center system is realized, and the dependency relationship responsible for operation in the workflow is described.

Description

technical field [0001] The present invention relates to the communication field, in particular to a visual display device and method based on a large data containerized dispatching center system. Background technique [0002] Directed acyclic graph (Direct Acyclic Graph) supports asynchronous concurrency, and can form a topological tree structure, which can greatly improve scalability. Directed acyclic graphs are widely used in the display of complex data relationship graphs. [0003] The workflow of the Apache Oozie big data scheduling framework is a collection of actions (Hadoop map / reduce jobs, pig jobs, etc.), controlled by a control dependency DAG (Direct Acyclic Graph), but the interface has no user interaction, and the job depends on Relationship building is not flexible enough. [0004] Airflow is a platform for arranging, scheduling, and monitoring workflows. Airflow arranges workflows into DAGs composed of tasks. The scheduler executes tasks in a set of running p...

AI Technical Summary

Problems solved by technology

However, when there are too many jobs in the workflow and the nesting relationship between jobs and job items is too complicated, the display of dependencies between jobs and job items will become unfriendly, without a clear, concise and scalable panoramic display

[0006] Based on this, the existing visual interface of the big data dispatching center system mainly has the following shortcomings: the interactive experience of the existing visual interface of the big data dispatching center system is not good; the lack of a clear, concise and scalable panoramic display is dependent on the responsible tasks in the workflow relationship; and there is no panoramic display of all workflows and all jobs at the system level across workflows

Images