A data source connection status monitoring device and method

A technology of connection status and monitoring device, applied in hardware monitoring, multi-programming device, structured data retrieval, etc., can solve the problems of system memory and CPU resource waste, difficulty in realizing real-time performance and resource consumption, system resource consumption, etc. , to avoid waste of system resources, realize real-time and resource consumption, and avoid excessive resource consumption.

Active Publication Date: 2022-04-08
WUHAN DAMENG DATABASE
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has higher refresh efficiency, but it will put a lot of pressure on the system
[0007] It can be seen from this that it is difficult to achieve a balance between real-time performance and resource consumption in either the linear polling method or the concurrent method; in addition, the traditional monitoring technology needs to continuously monitor the connection status of a large number of different types of data sources, which cannot be based on The actual situation is adjusted, resulting in unnecessary consumption of system resources, resulting in waste of system memory and CPU resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data source connection status monitoring device and method
  • A data source connection status monitoring device and method
  • A data source connection status monitoring device and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] In order to solve the problems that the traditional monitoring technology needs to continuously test the connection of all data sources, which cannot be adjusted according to the actual situation, and it is difficult to achieve a balance between real-time performance and resource consumption, the embodiment of the present invention provides a data source connection state monitoring devices such as figure 1 As shown, it mainly includes two components, the data source status listener and the data source status manager.

[0056] The data source status listener is used to monitor the connection requests and refresh requests of multiple data source status monitoring clients, and schedule the work of the data source status manager according to the request, which is equivalent to the relationship between the data source status manager and the data source status manager. The source state monitors the transit structure between clients.

[0057] The data source state manager mai...

Embodiment 2

[0115] On the basis of the above-mentioned embodiment 1, the embodiment of the present invention also provides a data source connection state monitoring method, which is completed by using the data source connection state monitoring device described in embodiment 1, as figure 2 As shown, it mainly includes the following steps:

[0116] In step 10, the data source state manager creates a state refresh task for each type of data source in the ETL system, which is responsible for refreshing the connection state of the data source, and puts it into a delay queue for execution.

[0117] combine figure 1 In the shown device, the data source status listener will monitor the connection requests of each data source status monitoring client in real time: whenever a data source status monitoring client sends a connection request, it will add 1 to the counter and send a message to all data source status monitoring clients. The start-stop device in the data source state manager sends a "...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data source connection state monitoring device and method, the device includes a data source state listener and a data source state manager, the data source state manager includes a data source state warehouse, a start-stop device and a refresh module; the data source state There are multiple state stores in the warehouse, and each state store stores the connection state of a type of data source; the start-stop device creates a state refresh task for each type of data source and puts it into the delay queue; the refresh module controls each state in the queue The refresh task periodically refreshes the data source connection status and updates it in the corresponding status memory; when the listener listens to the refresh request from the data source status monitoring client, it forwards the data source connection status returned by the data source status warehouse to the data source Status monitoring client. This solution realizes the monitoring of the connection status of multiple data sources on the premise of reducing the consumption of system resources as much as possible, and realizes the balance between real-time performance and resource consumption.

Description

【Technical field】 [0001] The invention relates to the technical field of data monitoring, in particular to a data source connection state monitoring device and method. 【Background technique】 [0002] The data exchange system (hereinafter referred to as ETL) is a data processing system with the functions of data extraction (Extract), cleaning transformation (Transform) and data loading (Load). The data source object is the data exchange system when the data is read or written. External data that needs to be connected. The connection information of these data sources is stored in the form of metadata for the system to access at any time. In the data exchange system, users need to be able to easily check whether part or all of the data sources can be connected normally, or cause failures that cannot be connected in order to troubleshoot. Therefore, there needs to be a functional module in the system to monitor the connection status of the data source objects. Record and mainta...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/30G06F16/21G06F16/25G06F9/48
Inventor 黄海明高东升胡高坤
Owner WUHAN DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap