A data source configuration management method and device, electronic equipment and storage medium

Abstract

The data source configuration management method, device, electronic equipment and storage medium in the embodiment of the application, the method obtains database type information of a to-be-processed data source, determines a data component template of the to-be-processed data source based on the database type information, configures data connection of the to-be-processed data source according to the data component template, generates a data source configuration file, performs connectivity test based on the data source configuration file, and obtains a connectivity test result. The method determines the configuration template of the data source according to the database to which the data source belongs and the data component in the database, can manage and plan the configuration of the data source in detail, effectively solves the problem that the configuration of each data source is not detailed enough when the configuration is managed and designed, connectivity test is set, the problem of data source configuration error can be effectively eliminated, the data source configuration file can be corrected in time, and the problem of low data source connection management efficiency is solved.

Description

Technical Field

[0001] This application relates to the field of database data source management, and in particular to a data source configuration management method, apparatus, electronic device, and storage medium. Background Technology

[0002] A data middle platform system is an engineering project for digitizing an enterprise. Through digital transformation, an enterprise establishes a digital middle platform system. Based on the enterprise's unique business model and organizational structure, and supported by tangible products and implementation methodologies, it builds a mechanism that continuously serves the business with data. The data middle platform integrates and aggregates data from multiple data sources.

[0003] However, in the actual data platform management process, the data source configuration is complex, unclear, and chaotic. This highlights the importance of data source management. Related technologies only design for the general implementation of data sources, and this patent does not provide enough detail for data source management. It does not specifically manage and design the detailed configuration of each data source, and the data source cannot be effectively checked after configuration, which easily leads to data source connection interruption and low data source connection management efficiency. Summary of the Invention

[0004] The purpose of this invention is to provide a data source configuration management method, device, electronic device, and storage medium to solve the problems of insufficient detail in the existing management and design of configurations for various data sources and low efficiency in data source connection management.

[0005] This invention provides a data source configuration management method, which includes: obtaining database type information of the data source to be processed; determining a data component template of the data source to be processed based on the database type information; configuring data connection of the data source to be processed according to the data component template and generating a data source configuration file; performing a connectivity test on the data source to be processed based on the data source configuration file and obtaining a connectivity test result for configuring and managing the data source to be processed.

[0006] In one embodiment of the present invention, performing connectivity testing on the data source to be processed based on the data source configuration file includes: if the data source to be processed passes the connectivity test, saving the data source configuration file to a preset configuration file storage partition, and uploading the connection parameters in the configuration file to a connection parameter management terminal. The connection parameters include connection configuration parameters, connection key parameters, and connection dependency parameters. The connection parameter management terminal is used for permission management and parameter modification of the connection parameters of the data source to be processed.

[0007] In one embodiment of the present invention, performing a connectivity test on the data source configuration file includes: if the data source to be processed fails the connectivity test, marking the data source configuration file as pending editing, so as to modify the configuration of the data source configuration file that failed the connectivity test.

[0008] In one embodiment of the present invention, after uploading the connection parameters in the configuration file to the connection parameter management terminal, the data source configuration management method further includes: marking the data source to be processed that has passed the connectivity test as pending review, and reviewing the data source to be processed; if the data source to be processed passes the review, then connecting the data source to be processed and marking it as in use; if the data source to be processed fails the review, then marking the data source to be processed as pending editing.

[0009] In one embodiment of the present invention, after saving the data source configuration file to a preset configuration file storage partition and uploading the connection parameters in the configuration file to a connection parameter management terminal, the data source configuration management method further includes: setting a timed test task for the data source configuration file, performing connectivity tests on the data source configuration file according to a preset test cycle; if the connectivity test fails, terminating the connection of the data source to be processed and issuing a warning.

[0010] In one embodiment of the present invention, before setting a timed test task for the data source configuration file, the data source configuration management method further includes: obtaining the address information, username information and password of the data source to be processed; generating a configuration information file based on the address information, username information and password of the data source to be processed, and storing the configuration information file in a preset configuration information database so as to extract the configuration information of the data source to be processed.

[0011] In one embodiment of the present invention, before obtaining the database type information of the data source to be processed, the data source configuration management method further includes: classifying the data source to be processed according to the database type and generating a first classification file; classifying the data source to be processed according to the data component type of each database type in the first classification file and generating a second classification file in the first classification file; classifying the data source to be processed according to the data service type in the second classification file and generating a third classification file in the second classification file, so as to classify and store the data source to be processed.

[0012] This invention also provides a data source configuration management device, comprising: a data source component determination module, used to obtain database type information of the data source to be processed; determine a data component template of the data source to be processed based on the database type information; a configuration file generation module, used to configure data connection of the data source to be processed according to the data component template and generate a data source configuration file; and a connectivity testing module, used to perform connectivity testing on the data source to be processed based on the data source configuration file and obtain connectivity test results for configuration management of the data source to be processed.

[0013] This invention also provides an electronic device, including: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the electronic device implements the data source configuration management method as described in any of the above embodiments.

[0014] This invention also provides a computer-readable storage medium storing computer-readable instructions, which, when executed by a computer's processor, cause the computer to perform the data source configuration management method as described in any of the above embodiments.

[0015] The data source configuration management method, apparatus, electronic device, and storage medium in this embodiment of the invention obtain database type information of the data source to be processed, determine the data component template of the data source to be processed based on the database type information, configure the data connection of the data source to be processed according to the data component template, generate a data source configuration file, and perform a connectivity test based on the data source configuration file to obtain the connectivity test results. This method determines the configuration template of the data source according to the database to which the data source belongs and the data components within the database, which can perform detailed configuration management and planning of the data source, effectively solving the problem of insufficient detail in the management and design of the configuration of each data source. Secondly, the connectivity test can effectively prevent the problem of data source configuration errors, facilitate timely correction of the data source configuration file, and solve the problem of low efficiency in data source connection management.

[0016] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0018] Figure 1 This is a schematic diagram illustrating an exemplary system architecture as shown in an exemplary embodiment of this application;

[0019] Figure 2 This is a flowchart illustrating a data source configuration management method in an exemplary embodiment of this application;

[0020] Figure 3 This is a block diagram illustrating a specific data source configuration management method in an exemplary embodiment of this application;

[0021] Figure 4 This is a hierarchical diagram illustrating a specific data source classification, as shown in an exemplary embodiment of this application.

[0022] Figure 5 This is a flowchart illustrating a specific data source configuration management method in an exemplary embodiment of this application;

[0023] Figure 6 This is a schematic diagram of a data source configuration management device shown in an exemplary embodiment of this application;

[0024] Figure 7 This is a schematic diagram of the structure of a computer system for an electronic device, as illustrated in an exemplary embodiment of this application. Detailed Implementation

[0025] The embodiments of the present invention will be described below with reference to the accompanying drawings and specific examples. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention and not for limiting the scope of protection of the present invention.

[0026] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of the present invention. Therefore, the illustrations only show the components related to the present invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0027] In the following description, numerous details are explored to provide a more thorough explanation of embodiments of the invention. However, it will be apparent to those skilled in the art that embodiments of the invention may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring embodiments of the invention.

[0028] The term "and / or" used in this application describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the related objects before and after it are in an "or" relationship.

[0029] First, it should be noted that a middle platform system is an engineering project for digitizing an enterprise. Through digital transformation, an enterprise establishes a digital middle platform system. Based on the enterprise's unique business model and organizational structure, and supported by tangible products and implementation methodologies, it builds a mechanism that continuously serves the business with data.

[0030] A data source is the origin of data; it is the device or raw medium that provides the required data. The data source stores all the information needed to establish a database connection, and the corresponding database connection can be found by providing the correct data source name.

[0031] A database is a repository for organizing, storing, and managing data according to a data structure. It is a large collection of organized, shareable, and uniformly managed data that is stored long-term in a computer.

[0032] This application also provides the following benefits: Firstly, it labels data sources based on connectivity test results to promptly correct and modify configuration files that fail connectivity tests, improving data source management efficiency. Secondly, it audits data source configurations after completion to improve the accuracy and fault tolerance of connectivity tests. It also includes periodic connectivity tests on data sources that pass connectivity tests, real-time monitoring of data source connection configurations to ensure data connection continuity and timely detection of configuration errors. Furthermore, it centrally stores data source configuration information to improve the efficiency of configuration information retrieval. Finally, it categorizes data sources into three levels to ensure refined data source management and enhance the systematic nature of data source management.

[0033] Figure 1 This is a schematic diagram illustrating an exemplary system architecture as shown in an exemplary embodiment of this application.

[0034] Reference Figure 1As shown, the system architecture may include a data source 101 to be processed and a computer device 102. The computer device 102 can be at least one of a microcomputer, an embedded computer, or a network computer. After obtaining the database type information of the data source 101, relevant technicians can determine the data component template of the data source 101 in the computer device 102 based on the database type information, configure the data connection of the data source 101 according to the data component template, generate a data source configuration file, and then perform a connectivity test on the data source 101 based on the data source configuration file to obtain the connectivity test results for configuration management of the data source.

[0035] In illustrative terms, after obtaining the database type information of the data source 101 to be processed, the computer device 101 determines the data component template of the data source 101 based on the database type information, configures the data connection of the data source 101 according to the data component template, generates a data source configuration file, and performs a connectivity test based on the data source configuration file to obtain the connectivity test results. This method determines the configuration template of the data source according to the database to which the data source belongs and the data components within the database, which can perform detailed configuration management and planning of the data source, effectively solving the problem of insufficient detail in the management and design of the configuration of each data source. Secondly, setting up a connectivity test can effectively prevent the problem of data source configuration errors, facilitate timely correction of the data source configuration file, and solve the problem of low efficiency in data source connection management.

[0036] Figure 2 This is a flowchart illustrating an exemplary embodiment of the present application of a data source configuration management method, which can... Figure 1 This process is executed within the network architecture of the data source 101 and computer device 102 shown in the diagram. (Refer to...) Figure 2 As shown, the flowchart of this data source configuration management method includes at least steps S210 to S240, which are described in detail below:

[0037] In step S210, the database type information of the data source to be processed is obtained.

[0038] In one embodiment of this application, before obtaining the database type information of the data source to be processed, the method further includes classifying the data source to be processed according to the database type and generating a first classification file; classifying the data source to be processed according to the data component type of each database type in the first classification file and generating a second classification file in the first classification file; and classifying the data source to be processed according to the data service type in the second classification file and generating a third classification file in the second classification file, thereby classifying and storing the data source to be processed for management. This three-level classification of the data source ensures refined management of the data source and improves the systematic nature of data source management.

[0039] In one embodiment of this application, the above-mentioned database type classification may be data sources based on JDBC connections supported by the Druid database connection pool, data sources in data storage components of big data platforms that do not support JDBC connections, data sources of message middleware components, and other data sources, including data file management systems such as FTP, FTPPS, and HDFS.

[0040] In one embodiment of this application, the above-mentioned data component types include, but are not limited to, data component categories such as MySQL, H2, Kafka, and HDFS, and the above-mentioned data service types include, but are not limited to, vehicle series dimension data sources, dealer dimension data sources, CAN signal data sources, and CAN signal data detail data.

[0041] It should be noted that the above classification examples are merely illustrative examples, and the specific classification items can be adjusted according to the actual needs of data source management. There is no limitation on the specific items of data source classification.

[0042] In step S220, the data component template of the data source to be processed is determined based on the database type information.

[0043] In one embodiment of this application, the aforementioned data component, namely the data control component, can also be referred to as a data display component or a data browsing component. Their main function is to work in conjunction with the data access component, allowing users to browse, edit, and perform other operations on the data. In an embodiment of this application, the data component template is stored in a second category file of the data source category file, and is used to configure the connection parameters of the data source component to be processed.

[0044] In step S230, the data connection configuration of the data source to be processed is performed according to the data component template, and a data source configuration file is generated.

[0045] In one embodiment of this application, the connection configuration parameters, key file, and dependencies of the data source component to be processed are uploaded to the data component template to generate a data configuration file. Here, dependency, also known as data dependency, is a mathematical concept that refers to the relationship between data, manifested by the equality or non-equality of attribute values ​​in a relation. Data dependency is an abstraction of the interrelationships between attributes in the real world and belongs to the inherent properties of data. In computer science, data dependency refers to a state where the program structure causes data to reference previously processed data.

[0046] In one embodiment of this application, data encryption is required during data connection configuration based on data transmission. This data encryption method includes, but is not limited to, symmetric key encryption and asymmetric key encryption. It should be noted that this is merely an illustrative example of data connection transmission encryption and does not specifically limit the method of data encryption.

[0047] In step S240, a connectivity test is performed on the data source to be processed based on the data source configuration file to obtain the connectivity test results, which are then used for configuration management of the data source to be processed.

[0048] In one embodiment of this application, if the data source to be processed passes the connectivity test, the data source configuration file is saved to a preset configuration file storage partition, and the connection parameters in the configuration file are uploaded to the connection parameter management terminal. The connection parameters include connection configuration parameters, connection key parameters, and connection dependency parameters. The connection parameter management terminal is used to manage permissions and modify parameters of the connection parameters of the data source to be processed.

[0049] In one embodiment of this application, if the data source to be processed fails the connectivity test, the data source configuration file is marked as pending editing so that the configuration of the data source configuration file that failed the connectivity test can be modified.

[0050] In one embodiment of this application, the data source is tagged according to the connectivity test results so that the configuration file that fails the data source connectivity test can be corrected and modified in a timely manner, thereby improving the efficiency of data source management.

[0051] In one embodiment of this application, after uploading the connection parameters in the configuration file to the connection parameter management terminal, the method further includes marking the data sources to be processed that have passed the connectivity test as pending review, and reviewing the data sources to be processed.

[0052] In one embodiment of this application, if the data source to be processed passes the review, the data source is connected and marked as being in use; if the data source to be processed fails the review, the data source is marked as being to be edited. Reviewing the data source after configuration improves the accuracy of data source connectivity testing and increases fault tolerance.

[0053] In one embodiment of this application, after saving the data source configuration file to a preset configuration file storage partition and uploading the connection parameters in the configuration file to the connection parameter management terminal, the method further includes setting a scheduled test task for the data source configuration file. This task performs connectivity tests on the data source configuration file according to a preset test cycle. If the connectivity test fails, the pending data source connection is terminated, and a warning is issued. Periodic connectivity tests are performed on data sources that pass the connectivity test, and the data source connection configuration is monitored in real time to ensure the continuity of the data connection and the timely detection of configuration errors.

[0054] In one embodiment of this application, the aforementioned preset configuration file storage partition is located at the middleware system level and is used to store and manage the configuration files of the data sources to be processed, facilitating access and allocation of the data sources. The aforementioned warnings can be issued in text form, voice prompts, or visual warnings. Warning methods include, but are not limited to, pop-up notifications, scrolling bullet comments, voice broadcasts, and audio-visual warnings to alert data sources that have failed the connectivity test.

[0055] In one embodiment of this application, before setting the scheduled test task for the data source configuration file, the method further includes obtaining the address information, username information, and password of the data source to be processed, generating a configuration information file based on the address information, username information, and password of the data source to be processed, and storing the configuration information file in a preset configuration information database for extraction of configuration information from the data source to be processed. Centralized storage of data source configuration information improves the efficiency of configuration information retrieval.

[0056] In one specific embodiment of this application, after the data source to be processed is added, the operation on the data source can be selected. Specifically, this includes selecting an already enabled data source, disabling an already enabled data source, and editing a timer. If the data source has been connected and used for data transmission, a message will be displayed indicating that the data source cannot be disabled.

[0057] In one embodiment of this application, if the data source is displayed as editable when the data source is selected, the data source can be edited, specifically including modifying the data source's configuration file and configuration parameters; if the data source is disabled when the data source is selected, the data source can be edited and the data source connection can be started, and the data source in the disabled state can also be configured with a connectivity test timer. After configuring the connectivity test timer, the data source can be tested for connectivity at regular intervals within the timer.

[0058] Please see Figure 3 , Figure 3 This is a block diagram illustrating a specific data source configuration management method in an exemplary embodiment of this application.

[0059] like Figure 3 As shown, in a specific embodiment of this application, s1 is the data source category selection, which selects the data source configuration to be processed under the corresponding three-level category. The category of the data source to be processed is selected through tree classification, and a new configuration is added. The new configuration specifically includes creating a three-level separated business name and configuring the data source under the business.

[0060] In one specific embodiment of this application, s2 is to configure the data source connection parameters, which specifically includes configuring the connection parameters of the data source component to be processed according to the connection parameter template of the secondary classification data component. The connection parameters can be saved independently and persistently stored in the database by the system so as to retrieve and view the data source connection parameters.

[0061] In one specific embodiment of this application, S3 is to configure the data source connection configuration file, key file and dependencies. Specifically, this includes uploading the connection configuration file, key file and dependencies of the data source component to be processed to the connection parameter template of the secondary classification data component. The configuration file, key file and dependencies can be saved and persistently stored in the file system. The key file mentioned above is consistent with the key file in the above embodiment.

[0062] In one specific embodiment of this application, S4 is to perform a connectivity test before submitting the data source. Before submitting the data source after configuration, a connectivity test needs to be performed on the data source. Data sources that fail the test cannot be submitted, but can be saved.

[0063] In one specific embodiment of this application, after the data source connectivity test is passed, it needs to be reviewed by the user administrator. The data source that passes the review can be configured and used in the data extraction task.

[0064] It should be noted that if the data source status is "in use", data sources with connectivity issues can be saved, but cannot be submitted to the user administrator for review.

[0065] In one specific embodiment of this application, S5 is to configure a connectivity test scheduled task. For submitted data sources, a data source connectivity test scheduled task can be configured. Data tasks that fail connectivity tests are changed from "in use" to "connection error".

[0066] Please see Figure 4 , Figure 4 This is a hierarchical diagram illustrating a specific data source classification, as shown in an exemplary embodiment of this application. For example... Figure 4As shown, the three-level classification management of data sources includes the following four categories in the first level: The first category consists of data sources based on JDBC connections supported by the Druid database connection pool, including data sources such as MySQL, Oracle, and Impala; the second category consists of data sources in the data storage components of the big data platform that do not support JDBC connections, including data sources such as HBase, Elasticsearch, and H2; the third category consists of data sources from message middleware components, including data sources such as Kafka, Pulsar, and MQTT; and the fourth category consists of other data sources, including data file management systems such as FTP, FTPPS, and HDFS. The second level classification categorizes data sources by various data components, such as MySQL, H2, Kafka, and HDFS. The third level classification, under the second level, categorizes data sources based on the same data component used for different business purposes, such as vehicle series-level data sources, dealer-level data sources, CAN signal data sources, and CAN signal data detail data.

[0067] Please see Figure 5 , Figure 5 This is a flowchart illustrating a specific data source configuration management method in an exemplary embodiment of this application.

[0068] like Figure 5 As shown in a specific embodiment of this application, it is first necessary to select a data source, select a first-level category, such as a JDBC data source, then select a second-level category, such as an MSyql data source component, and then select a third-level category, such as a vehicle series dimension data source.

[0069] In one specific embodiment of this application, different management operations are then performed according to the data source operation method. If a new data source is added, the template is first configured according to the data source configuration information template, and the data source configuration information is imported according to the selected data source type, such as the MySQL data source connection information template; and the configuration is performed according to the data source configuration file template, including importing the data source configuration file template according to the selected data source type, such as the MySQL data source connection information template.

[0070] In one specific embodiment of this application, the data source configuration information template and the data source configuration file template are dynamically loaded according to the selected secondary category data source to configure the data source. After the configuration is completed, it can be saved and edited. In the editing state, a connectivity test can be performed. If the test is successful, the data source status is in the pending review state. If the test fails, the data source status is in the editing state. The data source in the pending review state is reviewed by the administrator. If the review is passed, the data source is in the disabled state. If the review fails, the data source is in the editing state.

[0071] Among them, in the edit state, after configuring the connectivity test timer, the data source can be tested for connectivity at regular intervals using the timer.

[0072] In one specific embodiment of this application, if the operation on the data source is to select a data source, then an enabled data source is selected, and a disable operation and timer editing can be performed. If the data source is already in use, a message indicating that it cannot be disabled is displayed. If the data source is displayed in an edit state, then the data source can be edited. If the data source is in a disabled state, then the data source can be edited, and a data source connection can be started. After configuring a connectivity test timer, a timed connectivity test can be performed on the data source within the timer.

[0073] The data source configuration management method, apparatus, electronic device, and storage medium in this embodiment of the invention obtain database type information of the data source to be processed, determine the data component template of the data source to be processed based on the database type information, configure the data connection of the data source to be processed according to the data component template, generate a data source configuration file, and perform a connectivity test based on the data source configuration file to obtain the connectivity test results. This method determines the configuration template of the data source according to the database to which the data source belongs and the data components within the database, which can perform detailed configuration management and planning of the data source, effectively solving the problem of insufficient detail in the management and design of the configuration of each data source. Secondly, the connectivity test can effectively prevent the problem of data source configuration errors and facilitate timely data... The source configuration file was modified to resolve the issue of low efficiency in data source connection management. Secondly, data sources were tagged based on connectivity test results to allow for timely correction and modification of configuration files that failed connectivity tests, improving data source management efficiency. Thirdly, data source configuration was reviewed after completion to improve the accuracy of connectivity tests and increase fault tolerance. This included periodic connectivity tests on data sources that passed tests, real-time monitoring of data source connection configurations to ensure data connection continuity and timely detection of configuration errors. Furthermore, data source configuration information was centrally stored to improve the efficiency of configuration information retrieval. Finally, data sources were categorized into three levels to ensure refined data source management and enhance the systematic nature of data source management.

[0074] The following describes an apparatus embodiment of this application, which can be used to execute the data source configuration management method in the above embodiments of this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the data source configuration management method described above.

[0075] Figure 6 This is a schematic diagram illustrating a data source configuration management device according to an exemplary embodiment of this application. This device can be applied to… Figure 2 The implementation environment shown is not limited to this embodiment. This device can also be applied to other exemplary implementation environments and specifically configured in other devices.

[0076] like Figure 6 As shown, the exemplary data source configuration management device includes: a data source component determination module 601, a configuration file generation module 602, and a connectivity testing module 603.

[0077] The data source component determination module 601 is used to obtain the database type information of the data source to be processed; determine the data component template of the data source to be processed based on the database type information; the configuration file generation module 602 is used to configure the data connection of the data source to be processed according to the data component template and generate the data source configuration file; the connectivity test module 603 is used to perform connectivity tests on the data source to be processed based on the data source configuration file, obtain the connectivity test results, and configure and manage the data source to be processed.

[0078] Embodiments of this application also provide an electronic device, including: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the electronic device enables the data source configuration management method provided in the above embodiments.

[0079] Figure 7 This is a schematic diagram illustrating the structure of a computer system for an electronic device, as shown in an exemplary embodiment of this application. It should be noted that... Figure 7 The computer system 700 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0080] like Figure 7 As shown, the computer system 700 includes a Central Processing Unit (CPU) 701, which can perform various appropriate actions and processes, such as executing the methods described in the above embodiments, based on programs stored in Read-Only Memory (ROM) 702 or programs loaded from storage into Random Access Memory (RAM) 703. The RAM 703 also stores various programs and data required for system operation. The CPU 701, ROM 702, and RAM 703 are interconnected via a bus. An Input / Output (I / O) interface 705 is also connected to the bus 704.

[0081] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, mouse, etc.; an output section 707 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN (Local Area Network) card, modem, etc. The communication section performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface 705 as needed. A removable medium 711, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 710 as needed so that computer programs read from it can be installed into the storage section 708 as needed.

[0082] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program including a computer program for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 709, and / or installed from removable medium 711. When the computer program is executed by central processing unit (CPU) 701, it performs various functions defined in the system of this application.

[0083] It should be noted that the computer-readable medium shown in the embodiments of this application can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying a computer-readable computer program. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0084] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. Each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0085] In the corresponding figures of the above embodiments, connecting lines can represent the connection relationship between various components, indicating more constitutive signal paths and / or one or more ends of some lines having arrows to indicate the main information flow direction. Connecting lines are an identifier and are not a limitation on the scheme itself, but rather the use of these lines in combination with one or more exemplary embodiments helps to more easily connect circuits or logic units. Any signal represented (determined by design requirements or preferences) can actually include one or more signals that can be transmitted in any direction and can be implemented in any suitable type of signal scheme.

[0086] The units described in the embodiments of this application can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the specific unit itself.

[0087] Another aspect of this application provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the method described above. This computer-readable storage medium may be included in the electronic device described in the above embodiments, or it may exist independently and not assembled into the electronic device.

[0088] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0089] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this application.

[0090] It should be noted that this application can be used in a wide range of general-purpose or special-purpose computing system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc.

[0091] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.

[0092] It should be understood that the above content is only a preferred exemplary embodiment of this application and is not intended to limit the implementation of this application. Those skilled in the art can easily make corresponding modifications or alterations based on the main concept and spirit of this application. Therefore, the scope of protection of this application should be the scope of protection claimed in the claims.

Claims

1. A data source configuration management method, characterized in that, The data source configuration management method includes: Based on the database type, the data source to be processed is first classified, and a first-classification file is generated; In the first classification file, the data source to be processed is classified in the second category according to the data component type of each database type, and a second classification file is generated in the first classification file. The data component template is stored in the second classification file. In the second classification file, the data sources to be processed are classified into a third category according to the type of data service, and a third classification file is generated in the second classification file to classify, store and manage the data sources to be processed. Obtain the database type information of the data source to be processed; Based on the database type information, determine the data component template of the data source to be processed; Configure the data connection for the data source to be processed according to the data component template, and generate a data source configuration file; A connectivity test is performed on the data source to be processed based on the data source configuration file to obtain the connectivity test result, which is then used for configuration management of the data source to be processed. If the data source to be processed passes the connectivity test, the data source configuration file is saved to a preset configuration file storage partition, and the connection parameters in the configuration file are uploaded to the connection parameter management terminal. The connection parameters include connection configuration parameters, connection key parameters, and connection dependency parameters. The connection parameter management terminal is used for permission management and parameter modification of the connection parameters of the data source to be processed.

2. The data source configuration management method according to claim 1, characterized in that, Performing connectivity testing on the data source configuration file includes: If the data source to be processed fails the connectivity test, the data source configuration file is marked as pending editing so that the configuration file of the data source that failed the connectivity test can be modified.

3. The data source configuration management method according to claim 1, characterized in that, After uploading the connection parameters in the configuration file to the connection parameter management terminal, the data source configuration management method further includes: The data sources to be processed that have passed the connectivity test are marked as pending review, and the data sources to be processed are then reviewed. If the data source to be processed is approved, then connect to the data source to be processed and mark it as being in use; If the data source to be processed fails the review, the data source to be processed will be marked as pending editing.

4. The data source configuration management method according to claim 1, characterized in that, After saving the data source configuration file to a preset configuration file storage partition and uploading the connection parameters in the configuration file to the connection parameter management terminal, the data source configuration management method further includes: Set up a scheduled test task for the data source configuration file, and perform connectivity tests on the data source configuration file according to the preset test cycle; If the connectivity test fails, the connection to the data source to be processed will be terminated and a warning will be issued.

5. The data source configuration management method according to claim 4, characterized in that, Before setting up a scheduled test task for the data source configuration file, the data source configuration management method also includes: Obtain the address, username, and password of the data source to be processed; A configuration information file is generated based on the address information, username information, and password of the data source to be processed, and the configuration information file is stored in a preset configuration information database so that the configuration information of the data source to be processed can be extracted.

6. A data source configuration management device, characterized in that, include: The data source component determination module is used to perform a first classification based on the database type of the data source to be processed and generate a first classification file; In the first classification file, the data source to be processed is classified in the second category according to the data component type of each database type, and a second classification file is generated in the first classification file. The data component template is stored in the second classification file. In the second classification file, the data sources to be processed are classified into a third category according to the data service type, and a third classification file is generated in the second classification file to classify, store and manage the data sources to be processed; and the database type information of the data sources to be processed is obtained. Based on the database type information, determine the data component template of the data source to be processed; The configuration file generation module is used to configure the data connection of the data source to be processed according to the data component template and generate the data source configuration file; The connectivity testing module is used to perform connectivity tests on the data source to be processed based on the data source configuration file, and obtain the connectivity test results for configuration management of the data source to be processed. If the data source to be processed passes the connectivity test, the data source configuration file is saved to a preset configuration file storage partition, and the connection parameters in the configuration file are uploaded to the connection parameter management terminal. The connection parameters include connection configuration parameters, connection key parameters, and connection dependency parameters. The connection parameter management terminal is used for permission management and parameter modification of the connection parameters of the data source to be processed.

7. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs, which, when executed by one or more processors, cause the electronic device to implement the data source configuration management method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, It stores computer-readable instructions, which, when executed by the computer's processor, cause the computer to perform the data source configuration management method according to any one of claims 1 to 5.

Images