A data monitoring method and system for a third-party data information platform

Abstract

The present invention discloses a data monitoring method and system for a three-party data information platform, the method comprising: receiving a data retrieval request from a user end, determining technical indicators according to the data retrieval request, determining the data information to be retrieved based on the technical indicators, obtaining the target data stream corresponding to the data information to be retrieved from the database management end, respectively obtaining the configuration files of the user end, the database management end and the transit server, selecting the target data model according to the configuration file, performing data transmission of the target data stream using the target data model, and performing transmission monitoring and data inspection on the target data stream through each receiving node. By selecting a data model to store the enterprise's data to be retrieved and converting it into a fixed format, the problem of data disorder or data loss during data transmission can be effectively prevented, thereby improving stability and practicality. The work pressure of operation and maintenance personnel is reduced, and their experience and monitoring efficiency are improved.

Description

Technical Field

[0001] The present invention relates to the field of data information processing technology, and in particular to a data monitoring method and system for a third-party data information platform. Background Art

[0002] As various industries gain a deeper understanding of big data, its strategic significance and importance are increasingly evident. The success of this strategy depends heavily on product stability. As product diversification becomes increasingly evident, traditional database monitoring systems are unable to promptly detect potential issues during system operation, potentially leading to data disorganization and loss during database transmission, impacting businesses. Furthermore, the complexity and diversity of data increases the workload for operations and maintenance personnel, resulting in incomplete and inefficient monitoring. Summary of the Invention

[0003] In response to the problems shown above, the present invention provides a data monitoring method and system for a third-party data information platform to solve the problems mentioned in the background technology. Traditional database monitoring will not be able to detect potential problems in the system operation process in a timely manner, and it is easy to cause data disorder and data loss during the transmission process of database data, which will have an impact on the enterprise. In addition, the complexity and diversity of data increase the workload of operation and maintenance personnel, resulting in incomplete monitoring and low efficiency.

[0004] A data monitoring method for a third-party data information platform includes the following steps:

[0005] Receiving a data retrieval request from a user terminal, and determining technical indicators according to the data retrieval request;

[0006] Determine the data information to be retrieved based on the technical indicators, and obtain the target data stream corresponding to the data information to be retrieved from the database management end;

[0007] Respectively obtaining configuration files of the user terminal, the database management terminal, and the transit server, and selecting a target data model according to the configuration files;

[0008] The target data model is used to perform data transmission of the target data stream, and each receiving node performs transmission monitoring and data inspection on the target data stream.

[0009] Preferably, the receiving of a data retrieval request from a user terminal and determining a technical indicator according to the data retrieval request includes:

[0010] Determining the required services of the user terminal according to the data retrieval request;

[0011] Obtaining corresponding preset business rules based on the demand business;

[0012] Acquire multiple business indicators through the preset business rules, perform functional analysis on each business indicator, and obtain analysis results;

[0013] Determine the technical indicators corresponding to the data retrieval request based on the analysis results.

[0014] Preferably, determining the data information to be retrieved based on the technical indicators and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal includes:

[0015] Determine the statistical business type corresponding to each technical indicator, and select the target statistical business type of the same type as the data retrieval business type;

[0016] Extracting multiple keyword information of the retrieved data service type;

[0017] Acquiring data information corresponding to the keyword information in the database management terminal as the data information to be retrieved;

[0018] A resource link of the data information to be retrieved is obtained, and a target data stream corresponding to the data information to be retrieved is retrieved from the database management terminal through the resource link.

[0019] Preferably, after obtaining the data information corresponding to the keyword information as the data information to be retrieved in the database management terminal, the method further includes:

[0020] Extract the attribute characteristics of each technical indicator and build a correlation model between technical indicators based on the correlation between each attribute characteristics;

[0021] Retrieving a plurality of first retrieved data corresponding to each technical indicator in the database management terminal using each technical indicator as a keyword;

[0022] Using the association model to perform association determination on the plurality of first retrieved data of each technical indicator, and determining the second retrieved data of each technical indicator according to the determination result;

[0023] Determine the correspondence between the second retrieved data of each technical indicator and the data information to be retrieved, and determine whether the data information to be retrieved is accurate based on the correspondence. If so, no subsequent operation is required. If not, issue a prompt indicating that the data information to be retrieved is inaccurate.

[0024] Preferably, respectively obtaining configuration files of the user terminal, the database management terminal, and the transit server, and selecting a target data model according to the configuration files includes:

[0025] Selecting a plurality of first data models that are compatible with the user terminal, the database management terminal, and the transit server from a preset data model library according to their respective configuration files and device types;

[0026] Determining the storage data format corresponding to each first data model respectively;

[0027] Evaluate the decoding complexity of the storage data format corresponding to each first data model on the user terminal, the database management terminal, and the transit server respectively;

[0028] A second data model with the smallest decoding complexity on the user terminal, the database management terminal, and the transit server is selected as the target data model.

[0029] Preferably, the data transmission work of the target data stream using the target data model and the transmission monitoring and data inspection of the target data stream by each receiving node include:

[0030] Using the data model to format and package the target data stream, and obtain the processed target data stream;

[0031] generating a data stream transmission instruction according to the processed target data stream;

[0032] Determining the flow order of the target data stream processing nodes according to the data stream transmission instruction and the predetermined transmission order of the target data stream;

[0033] Connecting the sending node of the database management terminal and the receiving nodes of the user terminal and the transit server according to the flow sequence and generating a data flow transmission channel among the three;

[0034] Uploading the processed target data stream to the preset transfer server and the user terminal according to the predetermined transmission order;

[0035] The receiving nodes of the user terminal and the relay server respectively detect the transmission efficiency in real time during the transmission process, check the integrity of the target data stream after the transmission is completed, and confirm the completion of the transmission after the check passes.

[0036] Preferably, the receiving nodes of the user terminal and the relay server respectively check the integrity of the target data stream after the transmission is completed, specifically:

[0037] Determine multiple items to be monitored and the indicator value of each item to be monitored based on the structural composition of the target data stream;

[0038] Build monitoring models for the user end and transit server based on preset data integrity check rules;

[0039] Respectively obtaining the receiving node information of the user terminal and the transit server and writing the information into the monitoring model to obtain the respective data monitoring models of the two;

[0040] Use multiple monitored items as model input values, and use the indicator value of each monitored item as the model output value to train the data monitoring models of the user end and the transfer server, and obtain the trained data monitoring model;

[0041] The integrity of the target data stream is checked using the trained data monitoring models of the user end and the relay server respectively, and data incompleteness reminders are selectively issued based on the inspection results.

[0042] Preferably, the method further comprises:

[0043] Obtaining multiple erroneous monitoring data or incomplete monitoring data in the target data stream;

[0044] detecting a distribution of erroneous data in the erroneous monitoring data or a distribution of poor-quality data in the incomplete monitoring data;

[0045] generating a correction solution according to the erroneous data distribution or the poor-quality data distribution;

[0046] Correct and repair erroneous data distribution or poor-quality data through the correction scheme to obtain a corrected target data stream;

[0047] The corrected target data stream is continuously transmitted according to the predetermined transmission order.

[0048] Preferably, before determining the data information to be retrieved based on the technical indicators and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal, the method further includes:

[0049] Sending an identity authentication request to the user terminal, and receiving identity information fed back by the user terminal based on the identity authentication request;

[0050] converting the identity information into a data sequence;

[0051] Extracting sequence data between two adjacent sequence points in the data sequence, extracting an identity identifier based on the sequence data between the two adjacent sequence points, and obtaining a plurality of identity identifiers;

[0052] Perform permission matching on multiple identity identifiers and obtain matching results;

[0053] Determine the executable permissions and non-executable permissions of the user terminal based on the matching results, and determine whether there is data retrieval permission in the executable permissions. If so, confirm that the user terminal meets the data retrieval requirements. Otherwise, confirm that the user terminal does not meet the data retrieval requirements and send a reminder that data retrieval cannot be performed.

[0054] A data monitoring system for a third-party data information platform, the system comprising:

[0055] A determination module, configured to receive a data retrieval request from a user terminal and determine technical indicators based on the data retrieval request;

[0056] A retrieval module is used to determine the data information to be retrieved based on the technical indicators and obtain the target data stream corresponding to the data information to be retrieved from the database management end;

[0057] A selection module, configured to obtain configuration files of the user terminal, the database management terminal, and the transit server respectively, and select a target data model according to the configuration files;

[0058] The monitoring module is used to perform data transmission of the target data stream using the target data model, and perform transmission monitoring and data inspection on the target data stream through each receiving node.

[0059] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0060] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The accompanying drawings are used to provide further understanding of the present invention and constitute a part of the specification. They are used to explain the present invention together with the embodiments of the present invention and do not constitute a limitation of the present invention.

[0062] Figure 1 This is a workflow diagram of a data monitoring method for a third-party data information platform provided by the present invention;

[0063] Figure 2 Another workflow diagram of the data monitoring method of a third-party data information platform provided by the present invention;

[0064] Figure 3 Another workflow diagram of a data monitoring method for a third-party data information platform provided by the present invention;

[0065] Figure 4 This is a structural diagram of a data monitoring system for a third-party data information platform provided by the present invention. DETAILED DESCRIPTION

[0066] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0067] At present, as the understanding of big data in various industries continues to deepen, the strategic significance and importance of big data are also constantly being demonstrated, and the completion of the strategy is largely dependent on the stability of the product. As the diversification of products gradually emerges, traditional database monitoring will not be able to timely detect potential problems in the system operation process, which may easily cause data disorder and data loss during the transmission of database data, bringing impact to the enterprise. In addition, the complexity and diversity of data increase the workload of operation and maintenance personnel, resulting in incomplete monitoring and low efficiency. In order to solve the above problems, this embodiment discloses a data monitoring method for a three-party data information platform.

[0068] A data monitoring method for a third-party data information platform, such as Figure 1 As shown, the following steps are included:

[0069] Step S101: receiving a data retrieval request from a user terminal, and determining technical indicators according to the data retrieval request;

[0070] Step S102: determining the data information to be retrieved based on the technical indicators, and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal;

[0071] Step S103: respectively obtaining configuration files of the user terminal, the database management terminal, and the transit server, and selecting a target data model according to the configuration files;

[0072] Step S104: using the target data model to perform data transmission of the target data stream, and performing transmission monitoring and data inspection on the target data stream through each receiving node.

[0073] In this embodiment, the data retrieval request is represented by an online data retrieval request instruction issued by the user end, which can be obtained through computer notification;

[0074] In this embodiment, the target data stream is represented as the network data stream of the data to be retrieved;

[0075] In this embodiment, the configuration file is represented by the hardware configuration files of the user terminal, the database management terminal, and the transit server respectively;

[0076] In this embodiment, the target data model is represented as a network model for transmitting and inspecting the target data flow.

[0077] The working principle of the above technical solution is: receiving a data retrieval request issued by the user end, determining technical indicators according to the data retrieval request, determining the data information to be retrieved based on the technical indicators, obtaining the target data stream corresponding to the data information to be retrieved from the database management end, obtaining the configuration files of the user end, the database management end and the transit server respectively, selecting the target data model according to the configuration file, using the target data model to perform data transmission of the target data stream, and performing transmission monitoring and data inspection on the target data stream through each receiving node.

[0078] The beneficial effects of the above technical solution are: by selecting a data model to store the company's data to be retrieved and converting it into a fixed format, it can effectively prevent data disorder or data loss during data transmission, improve stability and practicality, and lay a solid data reference foundation for subsequent corporate decision-making. Furthermore, by using intermediate servers and user terminals to monitor and check data when receiving data, the root cause of the data problem can be comprehensively determined and then selectively repaired to the root cause of the problem, reducing the work pressure of operation and maintenance personnel, improving their experience and monitoring efficiency, and solving the problem in the existing technology that traditional database monitoring will not be able to timely detect potential problems in the system operation process, which is easy to cause data disorder and data loss in the database data during transmission, which has an impact on the enterprise. In addition, the complexity and diversity of the data increase the workload of operation and maintenance personnel, resulting in incomplete monitoring and low efficiency.

[0079] In one embodiment, receiving a data retrieval request from a user terminal and determining a technical indicator based on the data retrieval request includes:

[0080] Determining the required services of the user terminal according to the data retrieval request;

[0081] Obtaining corresponding preset business rules based on the demand business;

[0082] Acquire multiple business indicators through the preset business rules, perform functional analysis on each business indicator, and obtain analysis results;

[0083] Determine the technical indicators corresponding to the data retrieval request based on the analysis results.

[0084] The beneficial effect of the above technical solution is that by determining the required business of the user end and then determining the technical indicators, the technical indicators can be quickly and accurately obtained from the perspective of the user's business needs, thereby improving practicality and work efficiency.

[0085] In one embodiment, Figure 2 As shown, the method of determining the data information to be retrieved based on the technical indicators and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal includes:

[0086] Step S201: Determine the statistical service type corresponding to each technical indicator, and select the target statistical service type of the same type as the retrieved data service type;

[0087] Step S202: extract multiple keyword information of the retrieved data service type;

[0088] Step S203: acquiring data information corresponding to the keyword information in the database management terminal as the data information to be retrieved;

[0089] Step S204: obtaining a resource link of the data information to be retrieved, and retrieving a target data stream corresponding to the data information to be retrieved from the database management terminal through the resource link.

[0090] The beneficial effect of the above technical solution is that by determining the data information to be retrieved according to the type of data clerk, the approximate data information required by the client can be quickly retrieved, thereby laying a reference condition for subsequent data stream retrieval and further improving work efficiency.

[0091] In one embodiment, after obtaining data information corresponding to the keyword information as the data information to be retrieved in the database management terminal, the method further includes:

[0092] Extract the attribute characteristics of each technical indicator and build a correlation model between technical indicators based on the correlation between each attribute characteristics;

[0093] Retrieving a plurality of first retrieved data corresponding to each technical indicator in the database management terminal using each technical indicator as a keyword;

[0094] Using the association model to perform association determination on the plurality of first retrieved data of each technical indicator, and determining the second retrieved data of each technical indicator according to the determination result;

[0095] Determine the correspondence between the second retrieved data of each technical indicator and the data information to be retrieved, and determine whether the data information to be retrieved is accurate based on the correspondence. If so, no subsequent operation is required. If not, issue a prompt indicating that the data information to be retrieved is inaccurate.

[0096] The beneficial effects of the above technical solution are: by conducting in-depth analysis of technical indicators and obtaining the retrieval data in the current demand business, and then checking the data information to be retrieved, it can be effectively evaluated whether the information to be retrieved determined by the system meets the actual requirements, thereby improving the accuracy of subsequent retrieved data and the user experience, and further improving practicality.

[0097] In one embodiment, Figure 3 As shown, respectively obtaining configuration files of the user terminal, the database management terminal, and the transit server, and selecting a target data model according to the configuration files includes:

[0098] Step S301: selecting a plurality of first data models compatible with the user terminal, the database management terminal, and the transit server from a preset data model library according to their respective configuration files and device types;

[0099] Step S302: Determine the storage data format corresponding to each first data model respectively;

[0100] Step S303: Evaluate the decoding complexity of the storage data format corresponding to each first data model on the user terminal, the database management terminal, and the transit server respectively;

[0101] Step S304: Selecting the second data model with the minimum decoding complexity on the user terminal, the database management terminal, and the transit server as the target data model;

[0102] In this embodiment, the above decoding complexity is expressed as the decoding efficiency of the user terminal and the transit server for the target data stream in the storage data format.

[0103] The beneficial effect of the above technical solution is that a data model that can be quickly transmitted and retrieved on the three terminals can be selected, further improving work efficiency and practicality.

[0104] In one embodiment, the data transmission of the target data stream using the target data model and the transmission monitoring and data inspection of the target data stream by each receiving node include:

[0105] Using the data model to format and package the target data stream, and obtain the processed target data stream;

[0106] generating a data stream transmission instruction according to the processed target data stream;

[0107] Determining the flow order of the target data stream processing nodes according to the data stream transmission instruction and the predetermined transmission order of the target data stream;

[0108] Connecting the sending node of the database management terminal and the receiving nodes of the user terminal and the transit server according to the flow sequence and generating a data flow transmission channel among the three;

[0109] Uploading the processed target data stream to the preset transfer server and the user terminal according to the predetermined transmission order;

[0110] The receiving nodes of the user terminal and the relay server respectively detect the transmission efficiency in real time during the transmission process, check the integrity of the target data stream after the transmission is completed, and confirm the completion of the transmission after the check passes.

[0111] The beneficial effects of the above technical solution are: it can ensure the orderly flow of the target data stream while also monitoring it, thereby improving stability and monitoring efficiency.

[0112] In one embodiment, the receiving nodes of the user terminal and the relay server respectively check the integrity of the target data stream after the transmission is completed, specifically:

[0113] Determine multiple items to be monitored and the indicator value of each item to be monitored based on the structural composition of the target data stream;

[0114] Build monitoring models for the user end and transit server based on preset data integrity check rules;

[0115] Respectively obtaining the receiving node information of the user terminal and the transit server and writing the information into the monitoring model to obtain the respective data monitoring models of the two;

[0116] Use multiple monitored items as model input values, and use the indicator value of each monitored item as the model output value to train the data monitoring models of the user end and the transfer server, and obtain the trained data monitoring model;

[0117] The integrity of the target data stream is checked using the trained data monitoring models of the user end and the relay server respectively, and data incompleteness reminders are selectively issued based on the inspection results.

[0118] The beneficial effects of the above technical solution are: by constructing a data monitoring model, the user terminal and the transit server can intelligently check the integrity and error data of the received target data stream, further improving practicality, while also avoiding the impact of erroneous data and missing data on customer decision-making, further improving the user experience.

[0119] In one embodiment, the method further comprises:

[0120] Obtaining multiple erroneous monitoring data or incomplete monitoring data in the target data stream;

[0121] detecting a distribution of erroneous data in the erroneous monitoring data or a distribution of poor-quality data in the incomplete monitoring data;

[0122] generating a correction solution according to the erroneous data distribution or the poor-quality data distribution;

[0123] Correct and repair erroneous data distribution or poor-quality data through the correction scheme to obtain a corrected target data stream;

[0124] The corrected target data stream is continuously transmitted according to the predetermined transmission order.

[0125] The beneficial effect of the above technical solution is that by adaptively correcting poor quality data or erroneous data, the target data stream can ensure data quality and stability during transmission, further improving data transmission efficiency and stability.

[0126] In one embodiment, before determining the data information to be retrieved based on the technical indicator and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal, the method further includes:

[0127] Sending an identity authentication request to the user terminal, and receiving identity information fed back by the user terminal based on the identity authentication request;

[0128] converting the identity information into a data sequence;

[0129] Extracting sequence data between two adjacent sequence points in the data sequence, extracting an identity identifier based on the sequence data between the two adjacent sequence points, and obtaining a plurality of identity identifiers;

[0130] Perform permission matching on multiple identity identifiers and obtain matching results;

[0131] Determine the executable permissions and non-executable permissions of the user terminal based on the matching results, and determine whether there is data retrieval permission in the executable permissions. If so, confirm that the user terminal meets the data retrieval requirements. Otherwise, confirm that the user terminal does not meet the data retrieval requirements and send a reminder that data retrieval cannot be performed.

[0132] In this embodiment, the data sequence is represented as a data expression sequence of each information item of the identity information;

[0133] In this embodiment, the identity identifier is represented by the identity identifier of the user end in each sequence data;

[0134] In this embodiment, authority matching refers to determining which available authorities exist on the user side according to user information.

[0135] The beneficial effects of the above technical solution are: by authenticating the user end, it can be guaranteed that it has the authority to retrieve data, thereby ensuring the privacy and security of the data flow. Furthermore, by quickly determining user permissions through identity matching, identity authentication and authority evaluation can be quickly performed, thereby improving work efficiency.

[0136] This embodiment also discloses a data monitoring system for a third-party data information platform, such as Figure 4 As shown, the system includes:

[0137] Determination module 401, configured to receive a data retrieval request from a user terminal and determine a technical indicator according to the data retrieval request;

[0138] The retrieval module 402 is configured to determine the data information to be retrieved based on the technical indicators and obtain the target data stream corresponding to the data information to be retrieved from the database management terminal;

[0139] A selection module 403 is configured to obtain configuration files of the user terminal, the database management terminal, and the transit server, respectively, and select a target data model according to the configuration files;

[0140] The monitoring module 404 is configured to perform data transmission of the target data stream using the target data model, and perform transmission monitoring and data inspection on the target data stream through each receiving node.

[0141] The working principle and beneficial effects of the above technical solution have been described in the method claims and will not be repeated here.

[0142] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow from the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0143] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data monitoring method for a third-party data information platform, characterized in that: The following steps are involved: Receiving a data retrieval request from a user terminal, and determining a technical indicator according to the data retrieval request; Determine the data information to be retrieved based on the technical indicators, and obtain the target data stream corresponding to the data information to be retrieved from the database management end; The configuration files of the user terminal, the database management terminal and the relay server are obtained respectively, and the target data model is selected according to the configuration files; wherein, a plurality of first data models compatible with the user terminal, the database management terminal and the relay server are selected from a preset data model library according to the respective configuration files and device types of the user terminal, the database management terminal and the relay server; the storage data format corresponding to each first data model is determined respectively; the decoding complexity of the storage data format corresponding to each first data model on the user terminal, the database management terminal and the relay server is evaluated respectively; and the second data model with the minimum decoding complexity on the user terminal, the database management terminal and the relay server is selected as the target data model; The target data model is used to perform data transmission of the target data stream, and the target data stream is monitored and data checked through each receiving node; wherein, the target data stream is formatted and packaged using the target data model to obtain the processed target data stream; a data stream transmission instruction is generated according to the processed target data stream; the flow sequence of the target data stream processing nodes is determined according to the data stream transmission instruction and the predetermined transmission sequence of the target data stream; the sending node of the database management end and the respective receiving nodes of the user end and the relay server are connected according to the flow sequence and a data stream transmission channel for the three is generated; the processed target data stream is uploaded to the preset relay server and user end through the data stream transmission channel according to the predetermined transmission sequence; the respective receiving nodes of the user end and the relay server detect the transmission efficiency in real time during the transmission process, check the integrity of the target data stream after the transmission is completed, and confirm the completion of the transmission after the inspection passes.

2. The data monitoring method of the third-party data information platform according to claim 1 is characterized in that: The receiving a data retrieval request from a user terminal and determining a technical indicator according to the data retrieval request includes: Determine the service demanded by the user terminal according to the data retrieval request; Based on the demand business, obtain the corresponding preset business rules; Acquire multiple business indicators through the preset business rules, perform functional analysis on each business indicator, and obtain analysis results; Determine the technical indicators corresponding to the data retrieval request according to the analysis results.

3. The data monitoring method of the third-party data information platform according to claim 1 is characterized in that: The step of determining the data information to be retrieved based on the technical indicator and obtaining the target data stream corresponding to the data information to be retrieved from the database management terminal includes: Determine the statistical business type corresponding to each technical indicator, and select the target statistical business type of the same type as the data retrieval business type; Extracting multiple keyword information of the retrieved data service type; Acquiring data information corresponding to the keyword information in the database management terminal as the data information to be retrieved; A resource link of the data information to be retrieved is obtained, and a target data stream corresponding to the data information to be retrieved is retrieved from the database management terminal through the resource link.

4. The data monitoring method of the third-party data information platform according to claim 3 is characterized in that: After obtaining the data information corresponding to the keyword information as the data information to be retrieved in the database management terminal, the method further includes: Extract the attribute characteristics of each technical indicator, and build the correlation model between technical indicators based on the correlation of each attribute characteristic; Using each technical indicator as a keyword, retrieve multiple pieces of first retrieved data corresponding to each technical indicator in the database management terminal; Using the association model to perform association determination on multiple pieces of first retrieved data for each technical indicator, and determining second retrieved data for each technical indicator according to the determination result; Determine the correspondence between the second retrieved data of each technical indicator and the data information to be retrieved, and determine whether the data information to be retrieved is accurate based on the correspondence. If so, no subsequent operation is required. If not, issue a prompt that the data information to be retrieved is inaccurate.

5. The data monitoring method of the third-party data information platform according to claim 1 is characterized in that: The receiving nodes of the client and the relay server check the integrity of the target data stream after the transmission is completed. Specifically: Determine multiple items to be monitored and the indicator value of each item to be monitored according to the structural composition of the target data stream; Construct monitoring models for the user end and transit server based on preset data integrity check rules; Respectively obtain the receiving node information of the user end and the transit server and write them into the monitoring model to obtain the data monitoring models of the two respectively; Using multiple items to be monitored as model input values ​​and using the index value of each item to be monitored as the model output value to train the data monitoring models of the user end and the transfer server, and obtaining the trained data monitoring model; The integrity of the target data stream is checked using the trained data monitoring models of the user end and the relay server, and a reminder of incomplete data is selectively issued based on the inspection results.

6. The data monitoring method of the third-party data information platform according to claim 1 is characterized in that: The method further comprises: Acquire multiple erroneous monitoring data or incomplete monitoring data in the target data stream; Detecting the distribution of erroneous data in the erroneous monitoring data or the distribution of poor-quality data in the incomplete monitoring data; generating a correction scheme according to the erroneous data distribution or the poor quality data distribution; Correct and repair the erroneous data distribution or the poor-quality data through the correction scheme to obtain the corrected target data stream; The corrected target data stream is continuously transmitted according to a predetermined transmission sequence.

7. The data monitoring method of the third-party data information platform according to claim 1 is characterized in that: Before determining the data information to be retrieved based on the technical indicator and obtaining the target data stream corresponding to the data information to be retrieved from the database management end, the method further includes: Sending an identity authentication request to the user terminal, and receiving identity information fed back by the user terminal based on the identity authentication request; converting the identity information into a data sequence; Extracting sequence data between two adjacent sequence points in the data sequence, extracting an identity identifier according to the sequence data between the two adjacent sequence points, and obtaining a plurality of identity identifiers; Perform permission matching on multiple identity tags and obtain matching results; Determine the executable permissions and non-executable permissions of the user terminal based on the matching results, and determine whether there is data retrieval permission in the executable permissions. If so, confirm that the user terminal meets the data retrieval requirements. Otherwise, confirm that the user terminal does not meet the data retrieval requirements and send a reminder that data retrieval cannot be performed.

8. A data monitoring system for a third-party data information platform, characterized in that: The system includes: A determination module, used to receive a data retrieval request from a user terminal, and determine a technical indicator according to the data retrieval request; A retrieval module, used to determine the data information to be retrieved based on the technical indicators, and obtain the target data stream corresponding to the data information to be retrieved from the database management end; A selection module is used to obtain the configuration files of the user terminal, the database management terminal and the relay server respectively, and select a target data model according to the configuration files; wherein, a plurality of first data models compatible with the user terminal, the database management terminal and the relay server are selected from a preset data model library according to the respective configuration files and device types of the user terminal, the database management terminal and the relay server; a storage data format corresponding to each first data model is determined respectively; a decoding complexity of the storage data format corresponding to each first data model on the user terminal, the database management terminal and the relay server is evaluated respectively; and a second data model with the smallest decoding complexity on the user terminal, the database management terminal and the relay server is selected as the target data model; A monitoring module is used to use the target data model to perform data transmission of the target data stream, and to perform transmission monitoring and data inspection on the target data stream through each receiving node; wherein, the target data stream is formatted and packaged using the target data model to obtain the processed target data stream; a data stream transmission instruction is generated according to the processed target data stream; the flow sequence of the target data stream processing nodes is determined according to the data stream transmission instruction and the predetermined transmission sequence of the target data stream; the sending node of the database management end and the respective receiving nodes of the user end and the relay server are connected according to the flow sequence and a data stream transmission channel for the three is generated; the processed target data stream is uploaded to the preset relay server and user end through the data stream transmission channel according to the predetermined transmission sequence; the respective receiving nodes of the user end and the relay server detect the transmission efficiency in real time during the transmission process, check the integrity of the target data stream after the transmission is completed, and confirm the transmission completion after the inspection passes.

Images