Data acquisition and exchange method and electronic equipment
By generating a catalog of collected resources and tasks through a data acquisition and exchange platform, transmitting them in encrypted form, and utilizing an SQLite database and national cryptographic algorithms, the challenges of diverse and complex data acquisition in existing technologies have been solved, thus ensuring data quality and security.
Patent Information
- Application Number
- CN202410930267.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-07-11
AI Technical Summary
Existing data acquisition systems struggle to efficiently and accurately capture and integrate diverse and complex data from massive, heterogeneous data sources, and they also struggle to guarantee data security and compliance.
The system acquires the indicators to be collected through a data acquisition and exchange platform, generates a collection resource catalog and tasks, performs encrypted data transmission, determines whether the data meets the submission requirements based on feedback logs, and uses an SQLite database and national cryptographic algorithms to ensure data consistency and security.
It has met diverse and complex data collection needs, ensured data quality and security, and improved the efficiency and reliability of data exchange.
Smart Images

Figure CN119003631A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data exchange, and in particular to a data acquisition and exchange method and electronic equipment. Background Art
[0002] With the deepening and refinement of enterprise hierarchical management in modern society, the supervision and management of subordinate enterprises by superior units are becoming increasingly strict, and the demand for data collection has also shown a diversified and high-frequency trend. In this context, in order to achieve accurate decision-making and effective management, business departments at all levels require the types and scope of data to be collected to expand continuously, and its complexity and diversity have reached an unprecedented level. Therefore, it is particularly important and urgent to design and implement data collection methods that can meet the diverse and complex data collection needs and ensure data quality. Summary of the invention
[0003] In view of this, an object of the present invention is to provide a data acquisition and exchange method and an electronic device to meet the diverse and complex data acquisition requirements and ensure data quality.
[0004] In the first aspect, an embodiment of the present invention provides a data acquisition and exchange method, which is applied to a data acquisition and exchange platform, and a first business end, a data acquisition and exchange platform, and a second business end are communicatively connected in sequence, and the method includes: obtaining the indicator items to be collected sent by the first business end; generating a collection resource directory and a collection task based on the indicator items to be collected, and sending the collection resource directory and the collection task to the second business end, so that the second business end can determine the indicator data corresponding to the indicator items to be collected; receiving the indicator data sent by the second business end, and sending the indicator data to the first business end, so that the first business end can determine whether the indicator data meets the pre-set submission requirements based on the indicator data; receiving the feedback log sent by the first business end, and sending the feedback log to the second business end, so that the second business end can determine whether the indicator data meets the submission requirements based on the feedback log.
[0005] In a preferred embodiment of the present invention, before receiving the indicator data sent by the second service end, the method further includes: receiving a key sent by the first service end to encrypt the indicator data based on the key.
[0006] In a preferred embodiment of the present invention, the above-mentioned data acquisition and exchange platform includes: a configuration database unit, and a collection resource directory unit, a data indicator definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit, and a data transmission unit that are respectively communicated with the configuration database unit; the configuration database unit is used to maintain the collection resource directory template of the collection resource directory unit; the collection resource directory unit is used to store the collection resource directory template; the data indicator definition unit is used to specify the indicator content of the indicator item to be collected; the collection task unit is used to save the indicator data; the log management unit is used to forward the feedback log; the encryption and decryption software package unit is used to encrypt the indicator data sent by the second business end; and the data transmission unit is used to transmit data.
[0007] In a second aspect, an embodiment of the present invention provides a data acquisition and exchange method, which is applied to a second business end, and a first business end, a data acquisition and exchange platform, and a second business end are communicatively connected in sequence, and the method includes: obtaining a collection resource directory and a collection task sent by the data acquisition and exchange platform; collecting indicator items based on the collection resource directory and the collection task to obtain indicator data; sending the indicator data to the data acquisition and exchange platform, so that the data acquisition and exchange platform sends the indicator data to the first business end; receiving a feedback log sent by the data acquisition and exchange platform, and determining whether the indicator data meets the pre-set submission requirements based on the feedback log; if the indicator data does not meet the pre-set submission requirements, modifying the indicator data based on the feedback log; and sending the modified indicator data to the data acquisition and exchange platform.
[0008] In a preferred embodiment of the present invention, the above-mentioned acquisition of indicator items based on the acquisition resource directory and the acquisition task to obtain indicator data includes: acquiring initial indicator data based on the acquisition resource directory; converting the format of the initial indicator data to obtain a database file and unformatted data; submitting the database file and unformatted data to the acquisition task to obtain the indicator data.
[0009] In a preferred embodiment of the present invention, after the indicator items are collected based on the collection resource directory and the collection tasks to obtain the indicator data, the method also includes: performing format verification on the indicator data based on the data collection and exchange platform to obtain a verification result; if the verification result is that the verification is passed, the indicator data is sent to the data collection and exchange platform.
[0010] In the third aspect, an embodiment of the present invention provides a data collection and exchange method, which is applied to a first business end, and the first business end, a data collection and exchange platform, and a second business end are communicated and connected in sequence, and the method includes: sending indicator items to be collected to the data collection and exchange platform, so that the data collection and exchange platform generates a collection resource directory and collection tasks based on the indicator items to be collected; receiving indicator data sent by the data collection and exchange platform; determining whether the indicator data meets pre-set submission requirements; if the indicator data meets the pre-set submission requirements, the indicator data and the indicator items to be collected are stored correspondingly; and sending a feedback log indicating that the indicator data meets the submission requirements to the data collection and exchange platform.
[0011] In a preferred embodiment of the present invention, the above method also includes: if the indicator data does not meet the preset submission requirements, determining the error items in the indicator data based on the submission requirements; and sending the feedback log containing the error items to the data acquisition and exchange platform.
[0012] In a preferred embodiment of the present invention, after sending the indicator items to be collected to the data collection and exchange platform, the method also includes: sending a key to the data collection and exchange platform; after receiving the indicator data sent by the data collection and exchange platform, the method also includes: decrypting the indicator data based on the key.
[0013] In a fourth aspect, an embodiment of the present invention further provides an electronic device, comprising a processor and a memory, wherein the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the data acquisition and exchange method of the first aspect, the data acquisition and exchange method of the second aspect, and the data acquisition and exchange method of the third aspect.
[0014] The embodiments of the present invention bring the following beneficial effects:
[0015] The embodiment of the present invention provides a data collection and exchange method and electronic device, which are applied to a data collection and exchange platform, wherein a first business terminal, a data collection and exchange platform, and a second business terminal are sequentially connected in communication, and the index items to be collected sent by the first business terminal are obtained, and a collection resource directory and a collection task are generated based on the index items to be collected, and the collection resource directory and the collection task are sent to the second business terminal, so that the second business terminal can determine the index data corresponding to the index items to be collected, and then receive the index data sent by the second business terminal, and send the index data to the first business terminal, so that the first business terminal can determine whether the index data meets the pre-set submission requirements based on the index data, and finally receive the feedback log sent by the first business terminal, and send the feedback log to the second business terminal, so that the second business terminal can determine whether the index data meets the submission requirements based on the feedback log. In this way, the diversified and complex data collection needs are met, and the data quality is guaranteed.
[0016] Other features and advantages of the present disclosure will be set forth in the following description, or some features and advantages may be inferred or unambiguously determined from the description, or may be learned by implementing the above-mentioned technology of the present disclosure.
[0017] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0019] Figure 1a A flow chart of a data acquisition and exchange method applied to a data acquisition and exchange platform provided by an embodiment of the present invention;
[0020] Figure 1b A structural diagram of a data acquisition and exchange platform provided by an embodiment of the present invention;
[0021] Figure 2 A flow chart of a data collection and exchange method applied to a data collection and exchange platform of a second service end provided by an embodiment of the present invention;
[0022] Figure 3 A flow chart of a data collection and exchange method applied to a data collection and exchange platform of a first service end provided by an embodiment of the present invention;
[0023] Figure 4 A schematic diagram of the structure of a data acquisition and exchange device on a data acquisition and exchange platform provided by an embodiment of the present invention;
[0024] Figure 5 A schematic diagram of the structure of a data acquisition and exchange device applied to a second service end provided by an embodiment of the present invention;
[0025] Figure 6 A schematic diagram of the structure of a data acquisition and exchange device applied to a first service end provided by an embodiment of the present invention;
[0026] Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0027] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0028] With the deepening and refinement of enterprise hierarchical management in modern society, the supervision and management of subordinate enterprises by superior units are becoming increasingly strict, and the demand for data collection has also shown a trend of diversification and high frequency. In this context, in order to achieve accurate decision-making and effective management, business departments at all levels require the types and scope of data to be collected to expand continuously, and its complexity and diversity have reached an unprecedented level.
[0029] Specifically, it not only involves various types of structured data, such as formatted information such as financial statements and production statistics, but also covers a large amount of unformatted data, such as employee feedback, customer evaluations, market research reports, images, audio, video and other types of information resources. These unformatted data have different forms and no fixed pattern to follow, which increases the difficulty of data processing and analysis.
[0030] The current data collection system is facing severe challenges. On the one hand, how to efficiently and accurately capture and integrate the required data from massive and heterogeneous data sources to ensure the comprehensiveness and quasi-real-time nature of the data; on the other hand, how to adapt to the ever-changing data collection needs, flexibly process data in various formats, and achieve seamless connection and deep integration between different types of data, these are the problems that the existing data collection system needs to solve urgently. At the same time, how to ensure the security and compliance of data while meeting the efficiency of data collection is also a key point that enterprises must pay attention to in the process of building and optimizing data collection systems. Therefore, it is particularly important and urgent to design and implement a new data collection system that can cope with the above challenges, meet the diverse and complex data collection needs, and ensure data quality and security.
[0031] Specifically, with the rapid development of information technology, data exchange has become an important part of collaborative work and resource sharing in various industries. Traditional data exchange solutions can be mainly divided into two categories: file exchange and database exchange. However, both of these solutions have certain limitations.
[0032] The first common data exchange method is file-based exchange, such as transferring files in the form of CSV, XML, JSON, etc. through FTP, email attachments, network sharing, etc. Although file exchange is simple and easy, its disadvantage is the lack of a strict data format verification mechanism. During the data transmission process, the file may not be correctly parsed and used by the receiving end due to format errors, missing or damaged data. Especially when interacting across systems and platforms, due to problems such as inconsistent format standards and inconsistent version updates, the consistency and accuracy of the data is difficult to be effectively guaranteed.
[0033] The second type of data exchange is to directly migrate or synchronize data between different database systems. This method is efficient and orderly for processing structured data, but because most traditional database systems are mainly designed to process structured data, their storage and exchange functions are relatively weak for unstructured or unformatted data, such as text, pictures, audio, video, etc. This means that when exchanging data directly between databases, it is often difficult to effectively support the transmission and integration of unformatted data.
[0034] Based on this, a data collection and exchange method and electronic device provided by an embodiment of the present invention can obtain the indicator items to be collected sent by the first business end, generate a collection resource directory and a collection task based on the indicator items to be collected, and send the collection resource directory and the collection task to the second business end, so that the second business end can determine the indicator data corresponding to the indicator items to be collected, and then receive the indicator data sent by the second business end, and send the indicator data to the first business end, so that the first business end can determine whether the indicator data meets the pre-set submission requirements based on the indicator data, and finally receive the feedback log sent by the first business end, and send the feedback log to the second business end, so that the second business end can determine whether the indicator data meets the submission requirements based on the feedback log. In this way, the diversified and complex data collection needs are met, the data quality is guaranteed, and the indicator data can be efficiently stored and accessed through customized submission requirements.
[0035] To facilitate understanding of this embodiment, a data acquisition and exchange method disclosed in an embodiment of the present invention is first introduced in detail.
[0036] Example 1
[0037] An embodiment of the present invention provides a data acquisition and exchange method, which is applied to a data acquisition and exchange platform, wherein a first service end, a data acquisition and exchange platform, and a second service end are sequentially connected in communication. Figure 1a The present invention provides a flowchart of a data acquisition and exchange method applied to a data acquisition and exchange platform. Figure 1a As shown, the data acquisition and exchange method may include the following steps:
[0038] Step S101, obtaining the indicator items to be collected sent by the first service end.
[0039] Among them, the first business end can be a superior enterprise, the second business end can be a subordinate enterprise, the indicator items to be collected can be data that the first business end needs the second business end to submit, and the first business end can regularly send the indicator items to be collected to the data collection and exchange platform.
[0040] Furthermore, after obtaining the indicator items to be collected, the collection and exchange platform can perform data compression on the indicator items to be collected to reduce the bandwidth occupation and storage space requirements when the indicator items to be collected are sent to the second service end. For example, data compression can be performed by Huffman coding, Lempel-Ziv-Welch compression algorithm, etc.
[0041] When data is transmitted, the intelligent routing algorithm can automatically select the optimal data transmission path based on network conditions and data volume.
[0042] Step S102: Generate a collection resource directory and a collection task based on the indicator items to be collected, and send the collection resource directory and the collection task to the second business end.
[0043] It is specifically used by the second business end to determine the indicator data corresponding to the indicator item to be collected.
[0044] Among them, the collection resource directory may include: collection table name, collection frequency, collection cycle, collection scope, collection description, and related information for reporting indicator data for the second business end.
[0045] Among them, different indicators to be collected can pre-set different collection requirements, such as collection frequency, collection cycle, collection scope, collection instructions and other information, and generate a corresponding collection resource directory based on the collection requirements. The collection task can be set accordingly according to the collection resource directory.
[0046] Step S103, receiving the indicator data sent by the second service end, and sending the indicator data to the first service end.
[0047] It is specifically used for the first business end to determine whether the indicator data meets the preset submission requirements based on the indicator data.
[0048] The indicator data is the initial indicator data obtained after the second business end collects data based on the collection task and the collection directory, and the data is obtained after the format of the initial indicator data is converted and submitted to the collection task.
[0049] Furthermore, in order to ensure the security of the indicator data, before receiving the indicator data sent by the second business end, the method also includes: receiving a key sent by the first business end to encrypt the indicator data based on the key.
[0050] Among them, when the second business end sends the indicator data to the data collection and exchange platform, the format check of the indicator data will be triggered. The indicator data will be sent to the data collection and exchange platform only when the check result of the format check is that the check passes. When the check result of the format check is that the check fails, the error cause will be prompted. The second business end can modify the indicator data according to the error cause and submit it again.
[0051] Step S104: receiving the feedback log sent by the first service end, and sending the feedback log to the second service end.
[0052] It is specifically used by the second business end to determine whether the indicator data meets the submission requirements based on the feedback log.
[0053] Among them, the feedback log can be a feedback error log or a feedback success log. The feedback error log can include: the row number, column number, error cause, modification suggestions, etc. of the erroneous indicator data, and the feedback success log can include the number and success mark of the current collection task.
[0054] The first service end may send a feedback log based on whether the indicator data meets the preset submission requirements. If the indicator data does not meet the submission requirements, a feedback error log is sent, and if the indicator data meets the submission requirements, a feedback success log is sent.
[0055] Furthermore, the method may also include: recording the account information corresponding to the second business end, and the feedback error log corresponding to the account information sent by the first business end; extracting the error cause in the feedback error log; modifying the error cause, the collection resource directory and collection task corresponding to the error cause, and the second business end according to the feedback error log, and mapping and saving the modified correct indicator data; when the error information in the feedback error log of the account information is extracted again, the number of errors is accumulated; when the number of errors accumulates to a preset number of times, after receiving the indicator data sent by the second business end, the position corresponding to the error cause is checked based on the modified correct indicator data, and if an error still occurs, it is fed back to the second business end in real time for reference, reducing the complexity of the work of the first client and improving the efficiency of data exchange. Of course, when the error information in the feedback error log of the account information is extracted again, the number of consecutive errors can also be accumulated, and when the number of consecutive errors accumulates to a preset number of times, the subsequent steps are performed.
[0056] In the embodiment of the present application, a data acquisition and exchange platform is also provided. Figure 1b A structural diagram of a data acquisition and exchange platform provided by an embodiment of the present invention, such as Figure 1bAs shown, the data acquisition and exchange platform may include: a configuration database unit 10, and a collection resource directory unit 20, a data indicator definition unit 30, a collection task unit 40, a log management unit 50, an encryption and decryption software package unit 60, and a data transmission unit 70 which are respectively communicated with the configuration database unit 10.
[0057] Specifically, the configuration database unit 10 is used to maintain the collection resource directory template of the collection resource directory unit 20 .
[0058] Among them, the collection resource directory template can be pre-set according to the possible requirements of the indicators to be collected, so that the data collection and exchange platform can quickly obtain the corresponding collection resource directory after receiving the indicators to be collected.
[0059] Specifically, the acquisition resource directory unit 20 is used to store an acquisition resource directory template.
[0060] Among them, after receiving the collection index items, the data collection exchange platform can provide a corresponding collection resource directory based on the correspondence between the index items to be collected and the collection resource directory template.
[0061] Specifically, the data indicator definition unit 30 is used to define the indicator content of the indicator item to be collected.
[0062] The indicator content may include: indicator number, indicator name, data type, data length, indicator description, whether it is required, and other indicator details.
[0063] Specifically, the collection task unit 40 is used to save the indicator data.
[0064] Specifically, the log management unit 50 is used to forward the feedback log.
[0065] Among them, the feedback log can be a feedback error log or a feedback success log. The feedback error log can include: the row number, column number, error cause, modification suggestions, etc. of the erroneous indicator data, and the feedback success log can include the number and success mark of the current collection task.
[0066] Specifically, the encryption and decryption software package unit 60 is used to encrypt the indicator data sent by the second service end.
[0067] The encryption and decryption software package unit 60 may have a key from the first business end. After the second business end submits the indicator data to the collection task unit 40, the encryption and decryption software package will encrypt the indicator data based on the key.
[0068] Specifically, the data transmission unit 70 is used for performing data transmission.
[0069] The data transmission unit 70 may transmit the collection index items, collection resource directory, collection tasks, feedback logs, etc. involved in the data exchange process.
[0070] In practical applications, the data acquisition and exchange platform can make full use of the characteristics of SQLite database + file, achieving the goal of avoiding the problem of file exchange format verification and solving the difficulty of unformatted data exchange between databases; SQLite database file + file can be used as a carrier for data exchange, and through standardized data encapsulation and preprocessing, the consistency and integrity of data at the first business end and the second business end are ensured. During the transmission process, the reliability and security of data exchange are enhanced by encryption using national secret algorithms. At the same time, through customized data read and write interfaces and conversion rules, efficient storage and access to unformatted data can be achieved inside the SQLite database file, thus effectively making up for the shortcomings of the original file exchange and exchange between databases.
[0071] The data collection and exchange method provided by the embodiment of the present invention can obtain the indicator items to be collected sent by the first business end, generate a collection resource directory and a collection task based on the indicator items to be collected, and send the collection resource directory and the collection task to the second business end, so that the second business end can determine the indicator data corresponding to the indicator items to be collected, and then receive the indicator data sent by the second business end, and send the indicator data to the first business end, so that the first business end can determine whether the indicator data meets the pre-set submission requirements based on the indicator data, and finally receive the feedback log sent by the first business end, and send the feedback log to the second business end, so that the second business end can determine whether the indicator data meets the submission requirements based on the feedback log. In this way, the diversified and complex data collection needs are met, and the data quality is guaranteed.
[0072] Example 2
[0073] The embodiment of the present invention provides a data acquisition and exchange method, which is applied to a second business terminal, wherein a first business terminal, a data acquisition and exchange platform and a second business terminal are sequentially connected in communication. Figure 2 Flow chart of a data collection and exchange method applied to a second service end provided by an embodiment of the present invention. Figure 2 As shown, the data acquisition and exchange method may include the following steps:
[0074] Step S201, obtaining the collection resource directory and collection tasks sent by the data collection exchange platform.
[0075] The data collection and exchange platform will periodically receive the indicators to be collected sent by the first business end, and then generate a collection resource directory and corresponding collection tasks based on the indicators to be collected.
[0076] Among them, the collection resource directory may include: collection table name, collection frequency, collection cycle, collection scope, collection description, and related information for reporting indicator data for the second business end.
[0077] Among them, different indicators to be collected can pre-set different collection requirements, such as collection frequency, collection cycle, collection scope, collection instructions and other information, and generate a corresponding collection resource directory based on the collection requirements. The collection task can be set accordingly according to the collection resource directory.
[0078] Step S202: collecting indicator items based on the collection resource directory and the collection tasks to obtain indicator data.
[0079] Specifically, collecting indicator items based on the collection resource directory and the collection task to obtain indicator data may include: collecting indicator items based on the collection resource directory to obtain initial indicator data; converting the format of the initial indicator data to obtain a database file and unformatted data; submitting the database file and unformatted data to the collection task to obtain the indicator data.
[0080] Among them, the second business end prepares the corresponding initial indicator data according to the resource directory and the collection task, converts the format of the initial indicator data to obtain a database file and unformatted data, the database file is a sqlite db file, and submits the database file and unformatted data to the collection task to form indicator data.
[0081] Furthermore, after collecting indicator items based on the collection resource directory and collection tasks to obtain indicator data, the method also includes: performing format verification on the indicator data based on the data collection and exchange platform to obtain a verification result; if the verification result is passed, the indicator data is sent to the data collection and exchange platform.
[0082] Among them, when the second business end sends the indicator data to the data collection and exchange platform, the format verification of the indicator data will be triggered. If the verification result is verification failure, the error cause will be prompted. The second business end can modify the indicator data according to the error cause, and then send the modified indicator data to the data collection and exchange platform again until the verification result is verification passed.
[0083] Step S203, sending the indicator data to the data collection and exchange platform.
[0084] It is specifically used for the data collection and exchange platform to send the indicator data to the first business end.
[0085] Step S204: receiving the feedback log sent by the data collection and exchange platform, and determining whether the indicator data meets the preset submission requirements based on the feedback log.
[0086] The feedback log may be a feedback error log or a feedback success log. If the indicator data does not meet the submission requirements, the feedback error log is sent, that is, if the feedback log received by the second service end is a feedback error log, the indicator data does not meet the submission requirements. If the indicator data meets the submission requirements, the feedback success log is sent, that is, if the feedback log received by the second service end is a feedback success log, the indicator data meets the submission requirements.
[0087] Step S205: if the indicator data does not meet the preset submission requirements, the indicator data is modified based on the feedback log.
[0088] Wherein, when the indicator data does not meet the preset submission requirements, the feedback log is a feedback error log. The feedback error log may include: the row number, column number, error cause, modification suggestions, etc. of the erroneous indicator data.
[0089] Step S206, sending the modified indicator data to the data collection and exchange platform.
[0090] The data collection and exchange method provided by the embodiment of the present invention can obtain the collection resource directory and collection tasks sent by the data collection and exchange platform, collect index items based on the collection resource directory and collection tasks to obtain index data, and then send the index data to the data collection and exchange platform, so that the data collection and exchange platform can send the index data to the first business end, receive the feedback log sent by the data collection and exchange platform, and determine whether the index data meets the pre-set submission requirements based on the feedback log. If the index data does not meet the pre-set submission requirements, modify the index data based on the feedback log; and send the modified index data to the data collection and exchange platform. In this way, the diversified and complex data collection needs are met, and the data quality is guaranteed.
[0091] Example 3
[0092] An embodiment of the present invention provides a data acquisition and exchange method, which is applied to a first service end, wherein the first service end, a data acquisition and exchange platform, and a second service end are sequentially connected in communication. Figure 3 The present invention provides a flowchart of a data collection and exchange method applied to a first service end. Figure 3 As shown, the data acquisition and exchange method may include the following steps:
[0093] Step S301, sending the indicator items to be collected to the data collection and exchange platform.
[0094] It is specifically used for the data collection and exchange platform to generate collection resource directories and collection tasks based on the indicators to be collected.
[0095] The index items to be collected may be sent to the collection and exchange platform regularly. The index items to be collected may be data that the first service end needs the second service end to submit.
[0096] Among them, after sending the indicator items to be collected to the data collection and exchange platform, the method also includes: sending a key to the data collection and exchange platform; after receiving the indicator data sent by the data collection and exchange platform, the method also includes: decrypting the indicator data based on the key.
[0097] Step S302, receiving indicator data sent by the data collection and exchange platform.
[0098] Step S303, determining whether the indicator data meets the preset submission requirements.
[0099] The first business end includes a first business system, and the first business system can determine whether the indicator data meets the preset submission requirements.
[0100] Step S304: If the indicator data meets the preset submission requirements, the indicator data and the indicator items to be collected are stored in correspondence.
[0101] When the indicator data is stored, it is specifically stored in the database of the first business system itself.
[0102] Furthermore, if the indicator data does not meet the preset submission requirements, the error items in the indicator data are determined based on the submission requirements; and the feedback log containing the error items is sent to the data collection and exchange platform.
[0103] Among them, the feedback log containing error items is the feedback error log, and the error items may include: the row number, column number, error cause, modification suggestions, etc. of the erroneous indicator data. The data collection and exchange platform receives the feedback log and sends the feedback log to the second business end, and the second business end modifies the indicator data based on the feedback log.
[0104] Step S305: Send a feedback log indicating that the indicator data meets the submission requirements to the data collection and exchange platform.
[0105] The feedback log indicating that the indicator data meets the submission requirements is the above-mentioned successful feedback log, and the successful feedback log may include the number and success mark of the current collection task.
[0106] The data collection and exchange method provided by the embodiment of the present invention can send the index items to be collected to the data collection and exchange platform, so that the data collection and exchange platform can generate a collection resource directory and a collection task based on the index items to be collected, and then receive the index data sent by the data collection and exchange platform to determine whether the index data meets the pre-set submission requirements. If the index data meets the pre-set submission requirements, the index data and the index items to be collected are stored correspondingly, and finally a feedback log indicating that the index data meets the submission requirements is sent to the data collection and exchange platform. In this way, the diversified and complex data collection needs are met, and the data quality is guaranteed.
[0107] Example 4
[0108] Corresponding to the above method embodiment, the embodiment of the present invention provides a data acquisition and exchange device, which is applied to a data acquisition and exchange platform, wherein a first service end, a data acquisition and exchange platform and a second service end are sequentially connected in communication. Figure 4 A schematic diagram of the structure of a data acquisition and exchange device applied to a data acquisition and exchange platform provided by an embodiment of the present invention is shown in FIG. Figure 4 As shown, the data acquisition and exchange device may include:
[0109] The to-be-collected indicator item acquisition module 401 is used to acquire the to-be-collected indicator items sent by the first service end.
[0110] The directory and task forwarding module 402 is used to generate a collection resource directory and a collection task based on the indicator items to be collected, and send the collection resource directory and the collection task to the second business end so that the second business end can determine the indicator data corresponding to the indicator items to be collected.
[0111] The indicator data forwarding module 403 is used to receive the indicator data sent by the second business end, and send the indicator data to the first business end, so that the first business end can determine whether the indicator data meets the preset submission requirements based on the indicator data.
[0112] The feedback log forwarding module 404 is used to receive the feedback log sent by the first business end, and send the feedback log to the second business end, so that the second business end can determine whether the indicator data meets the submission requirements based on the feedback log.
[0113] The data acquisition exchange device provided by the embodiment of the present invention can obtain the indicator items to be collected sent by the first business end, generate a collection resource directory and a collection task based on the indicator items to be collected, and send the collection resource directory and the collection task to the second business end, so that the second business end can determine the indicator data corresponding to the indicator items to be collected, and then receive the indicator data sent by the second business end, and send the indicator data to the first business end, so that the first business end can determine whether the indicator data meets the pre-set submission requirements based on the indicator data, and finally receive the feedback log sent by the first business end, and send the feedback log to the second business end, so that the second business end can determine whether the indicator data meets the submission requirements based on the feedback log. In this way, the diversified and complex data acquisition needs are met, and the data quality is guaranteed.
[0114] In some embodiments, the indicator data forwarding module is further used to receive a key sent by the first service end to encrypt the indicator data based on the key.
[0115] In some embodiments, the data acquisition and exchange platform includes: a configuration database unit, and a collection resource directory unit, a data indicator definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit, and a data transmission unit that are respectively communicatively connected to the configuration database unit; the configuration database unit is used to maintain the collection resource directory template of the collection resource directory unit; the collection resource directory unit is used to store the collection resource directory template; the data indicator definition unit is used to specify the indicator content of the indicator item to be collected; the collection task unit is used to save the indicator data; the log management unit is used to forward the feedback log; the encryption and decryption software package unit is used to encrypt the indicator data sent by the second business end; and the data transmission unit is used to transmit data.
[0116] The device provided in the embodiment of the invention has the same implementation principle and technical effects as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.
[0117] Example 5
[0118] Corresponding to the above method embodiment, the embodiment of the present invention provides a data acquisition and exchange device, which is applied to the second business end, the first business end, the data acquisition and exchange platform and the second business end are sequentially connected in communication, Figure 5 A schematic diagram of a data acquisition and exchange device applied to a second service end provided by an embodiment of the present invention is shown in FIG. Figure 5 As shown, the data acquisition and exchange device may include:
[0119] The directory and task acquisition module 501 is used to acquire the collection resource directory and collection tasks sent by the data collection exchange platform.
[0120] The indicator data acquisition module 502 is used to collect indicator items based on the collection resource directory and the collection tasks to obtain indicator data.
[0121] The first indicator data sending module 503 is used to send the indicator data to the data collection and exchange platform, so that the data collection and exchange platform sends the indicator data to the first business end.
[0122] The feedback log receiving module 504 is used to receive the feedback log sent by the data collection and exchange platform, and determine whether the indicator data meets the preset submission requirements based on the feedback log.
[0123] The indicator data modification module 505 is used to modify the indicator data based on the feedback log if the indicator data does not meet the preset submission requirements.
[0124] The second indicator data sending module 506 is used to send the modified indicator data to the data collection and exchange platform.
[0125] The data acquisition and exchange device provided in the embodiment of the present invention can obtain the acquisition resource directory and acquisition tasks sent by the data acquisition and exchange platform, collect index items based on the acquisition resource directory and acquisition tasks to obtain index data, and then send the index data to the data acquisition and exchange platform, so that the data acquisition and exchange platform can send the index data to the first business end, receive the feedback log sent by the data acquisition and exchange platform, determine whether the index data meets the pre-set submission requirements based on the feedback log, and if the index data does not meet the pre-set submission requirements, modify the index data based on the feedback log; and send the modified index data to the data acquisition and exchange platform. In this way, the diversified and complex data acquisition needs are met, and the data quality is guaranteed.
[0126] In some embodiments, the indicator data acquisition module is also used to collect indicator items based on the collection resource directory to obtain initial indicator data; convert the format of the initial indicator data to obtain a database file and unformatted data; submit the database file and unformatted data to the collection task to obtain indicator data.
[0127] In some embodiments, the indicator data acquisition module is also used to perform format verification on the indicator data based on the data acquisition and exchange platform to obtain a verification result; if the verification result is that the verification passes, the indicator data is sent to the data acquisition and exchange platform.
[0128] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.
[0129] Example 6
[0130] Corresponding to the above method embodiment, the embodiment of the present invention provides a data acquisition and exchange device, which is applied to a first business end, wherein the first business end, a data acquisition and exchange platform and a second business end are sequentially connected in communication. Figure 6 A structural diagram of a data acquisition and exchange device applied to a first service end provided by an embodiment of the present invention, such as Figure 6 As shown, the data acquisition and exchange device may include:
[0131] The to-be-collected indicator sending module 601 is used to send the to-be-collected indicator items to the data collection and exchange platform, so that the data collection and exchange platform can generate a collection resource directory and a collection task based on the to-be-collected indicator items.
[0132] The indicator data receiving module 602 is used to receive the indicator data sent by the data collection and exchange platform.
[0133] The indicator data judgment module 603 is used to determine whether the indicator data meets the preset submission requirements.
[0134] The indicator data storage module 604 is used to store the indicator data and the indicator items to be collected in correspondence if the indicator data meets the preset submission requirements.
[0135] The feedback log sending module 605 is used to send the feedback log indicating that the indicator data meets the submission requirements to the data collection and exchange platform.
[0136] The data acquisition and exchange device provided by the embodiment of the present invention can send the index items to be collected to the data acquisition and exchange platform, so that the data acquisition and exchange platform can generate the collection resource directory and collection tasks based on the index items to be collected, and then receive the index data sent by the data acquisition and exchange platform, determine whether the index data meets the pre-set submission requirements, and if the index data meets the pre-set submission requirements, store the index data and the index items to be collected correspondingly, and finally send the feedback log indicating that the index data meets the submission requirements to the data acquisition and exchange platform. In this way, the diversified and complex data collection needs are met, and the data quality is guaranteed.
[0137] In some embodiments, the indicator data judgment module is also used to determine error items in the indicator data based on the submission requirements if the indicator data does not meet the preset submission requirements; and send the feedback log containing the error items to the data collection and exchange platform.
[0138] In some embodiments, the module for sending indicators to be collected is also used to send a key to the data collection and exchange platform; and decrypt the indicator data based on the key.
[0139] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.
[0140] Example 7
[0141] The embodiment of the present invention also provides an electronic device for executing the above data acquisition and exchange method; see Figure 7 A structural schematic diagram of an electronic device is shown, which includes a memory 700 and a processor 701, wherein the memory 700 is used to store one or more computer instructions, and the one or more computer instructions are executed by the processor 701 to implement the above-mentioned data acquisition and exchange method.
[0142] Further, Figure 7 The electronic device shown further includes a bus 702 and a communication interface 703 , and the processor 701 , the communication interface 703 and the memory 700 are connected via the bus 702 .
[0143] The memory 700 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 703 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 702 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0144] The processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 701. The above processor 701 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present invention can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 700, and the processor 701 reads the information in the memory 700 and completes the steps of the method of the above embodiment in combination with its hardware.
[0145] An embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the above-mentioned data acquisition and exchange method. The specific implementation can be found in the method embodiment, which will not be repeated here.
[0146] The computer program product for performing the data acquisition and exchange method provided in the embodiment of the present invention includes a computer-readable storage medium storing a non-volatile program code executable by a processor. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be referred to the method embodiment, which will not be repeated here.
[0147] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0148] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.
[0149] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0150] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0151] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0152] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.
Claims
1. A data collection and exchange method, It is characterized in that Applied to a data acquisition and exchange platform, a first business terminal, the data acquisition and exchange platform, and a second business terminal are sequentially connected in communication, and the method includes: Obtaining the indicator items to be collected sent by the first business end; Generate a collection resource directory and a collection task based on the indicator item to be collected, and send the collection resource directory and the collection task to the second service end so that the second service end can determine the indicator data corresponding to the indicator item to be collected; receiving the indicator data sent by the second service end, and sending the indicator data to the first service end, so that the first service end determines whether the indicator data meets a preset submission requirement based on the indicator data; Receive the feedback log sent by the first business end, and send the feedback log to the second business end, so that the second business end determines whether the indicator data meets the submission requirement based on the feedback log.
2. The method according to claim 1, It is characterized in that Before receiving the indicator data sent by the second service end, the method further includes: Receive a key sent by the first service end to encrypt the indicator data based on the key.
3. The method according to claim 1 or 2, It is characterized in that The data collection and exchange platform includes: a configuration database unit, and a collection resource directory unit, a data indicator definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit, and a data transmission unit which are respectively connected to the configuration database unit in communication; The configuration database unit is used to maintain the acquisition resource directory template of the acquisition resource directory unit; the acquisition resource directory unit is used to store the acquisition resource directory template; the data indicator definition unit is used to specify the indicator content of the indicator item to be collected; the acquisition task unit is used to save the indicator data; the log management unit is used to forward the feedback log; the encryption and decryption software package unit is used to encrypt the indicator data sent by the second business end; the data transmission unit is used to transmit data.
4. A data collection and exchange method, It is characterized in that Applied to the second business terminal, the first business terminal, the data acquisition and exchange platform and the second business terminal are sequentially connected in communication, and the method includes: Obtaining the collection resource directory and collection tasks sent by the data collection exchange platform; Collecting indicator items based on the collection resource directory and the collection task to obtain indicator data; Sending the indicator data to the data acquisition and exchange platform, so that the data acquisition and exchange platform sends the indicator data to the first service end; Receiving the feedback log sent by the data collection and exchange platform, and determining whether the indicator data meets the preset submission requirements based on the feedback log; If the indicator data does not meet the preset submission requirements, modify the indicator data based on the feedback log; The modified indicator data is sent to the data acquisition and exchange platform.
5. The method according to claim 4, It is characterized in that The step of collecting indicator items based on the collection resource directory and the collection task to obtain indicator data includes: Collecting indicator items based on the collection resource directory to obtain initial indicator data; Converting the initial indicator data into a database file and non-formatted data; Submit the database file and the unformatted data to the collection task to obtain the indicator data.
6. The method according to claim 4, It is characterized in that After acquiring indicator data by acquiring indicator items based on the acquisition resource directory and the acquisition task, the method further includes: Performing format verification on the indicator data based on the data collection and exchange platform to obtain a verification result; If the verification result is that the verification is passed, the indicator data is sent to the data acquisition and exchange platform.
7. A data collection and exchange method, It is characterized in that Applied to a first business terminal, the first business terminal, a data acquisition and exchange platform, and a second business terminal are sequentially connected in communication, and the method includes: Sending the index items to be collected to the data collection and exchange platform, so that the data collection and exchange platform can generate a collection resource directory and a collection task based on the index items to be collected; Receiving the index data sent by the data acquisition and exchange platform; Determining whether the indicator data meets the preset submission requirements; If the indicator data meets the preset submission requirements, the indicator data and the indicator items to be collected are stored correspondingly; Sending a feedback log indicating that the indicator data meets the submission requirements to the data collection and exchange platform.
8. The method according to claim 7, It is characterized in that The method further comprises: If the indicator data does not meet the preset submission requirements, determining error items in the indicator data based on the submission requirements; The feedback log containing the error item is sent to the data acquisition and exchange platform.
9. The method according to claim 7, It is characterized in that After sending the indicator items to be collected to the data collection and exchange platform, the method further includes: Sending a key to the data acquisition and exchange platform; After receiving the indicator data sent by the data acquisition and exchange platform, the method further includes: The indicator data is decrypted based on the key.
10. An electronic device, It is characterized in that It includes a processor and a memory, the memory stores computer-executable instructions that can be executed by the processor, and the processor executes the computer-executable instructions to implement the data acquisition and exchange method described in any one of claims 1 to 3, and the data acquisition and exchange method described in any one of claims 4 to 6, and the data acquisition and exchange method described in any one of claims 7 to 9.
Citation Information
Patent Citations
County-level meteorological comprehensive observation business integration system
CN107423313A
Information processing method and access processing device
CN107800667A
Method and device for monitoring service system, cloud platform system and server
CN111459782A
Multi-specialty configurable acquisition method and device for acquisition and control platform
CN114492554A
Equipment management method, device and system
CN114785705A
