Unified Service Process for Multi-Source Data Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data distribution processes require multiple service threads to be configured simultaneously, leading to resource wastage and performance issues at the data source end.
Innovation Solution
A data distribution process configuration method and apparatus that displays a workbench with node plug-ins and a canvas, allowing users to drag and connect plug-ins to configure a service process, obtaining configuration information for data distribution from a data source to a receiving end, utilizing plug-in sets like data integration, message queue, database, filter script, and algorithm plug-ins.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple service processes are configured to synchronize data from multiple different data sources, then data distribution capability is improved, but resource consumption increases and data source end performance is greatly affected
Solution Approach 1:
The patent merges multiple service processes into a single service process that can handle multiple data sources. The workbench allows users to configure multiple node plug-ins (data source nodes, processing nodes, data receiving end nodes) within one service process, eliminating the need for separate service processes for each data source. This consolidation reduces resource consumption while maintaining the ability to distribute data from multiple sources.
Solution Approach 2:
The single service process is designed with universal functionality to handle multiple data sources through configurable node plug-ins. The workbench provides a unified interface where users can add, configure, and manage different types of nodes (MySQL, TIDB, HBase, message queues, filter scripts, algorithms) within one service process, making the system multi-functional without requiring multiple specialized processes.
2Adaptability or versatility
If multiple service processes are configured simultaneously, then data distribution from multiple sources is achieved, but device complexity increases
Solution Approach 1:
The patent combines multiple service processes into a single unified service process managed through a workbench interface. Users can configure multiple data sources, processing steps, and receiving ends within one service process using node plug-ins, significantly reducing the complexity of managing multiple separate service processes while maintaining multi-source data distribution capability.
Solution Approach 2:
The workbench serves as an intermediary interface between the user and the service process configuration. It provides a visual, drag-and-drop interface for adding and configuring node plug-ins, simplifying the complexity of configuring multi-source data distribution. The workbench abstracts the underlying complexity and presents a user-friendly interface for managing service processes.
3Adaptability or versatility
If multiple service threads process data simultaneously, then data distribution coverage is improved, but resource wastage occurs
Solution Approach 1:
The patent merges multiple service threads into a single service process that can handle multiple data sources and receiving ends. The workbench allows configuration of multiple node plug-ins within one service process, enabling the single process to perform work that previously required multiple separate service threads, thus reducing resource wastage while maintaining broad data distribution coverage.
Solution Approach 2:
The single service process is designed with universal capabilities to distribute data to multiple receiving ends through configurable node plug-ins. The workbench enables users to define multiple data receiving end nodes (message queues, databases, files) within one service process, allowing the system to achieve broad distribution coverage without the resource overhead of multiple dedicated service threads.
Data Source
AI summary
The present disclosure relates data distribution process configuration methods and apparatuses, electronic devices and storage media. The method includes: in response to detecting a trigger operation that represents creating a service process of a data distribution service, displaying a workbench of the service process; the workbench includes an area for displaying node plug-ins and an area for displaying a canvas; in response to detecting a trigger operation that represents dragging a node plug-in to the canvas, obtaining node plug-ins of the service process; in response to detecting a trigger operation that represents connecting the node plug-ins, obtaining configuration information of the service process, the configuration information represents a data distribution process from a data source end to a data receiving end. In the embodiment, the device data at the data source end can be distributed to various receiving ends according to the configuration information, and the rule setting can be completed without the user focuses on the specific implementation logic.