Data collection exchange method and electronic device

Abstract

The application provides a data collection exchange method and electronic equipment, relates to the technical field of data exchange, is applied to a data collection exchange platform, a first service end, the data collection exchange platform and a second service end are sequentially connected in communication, and the method comprises the following steps: acquiring an index item to be collected sent by the first service end; generating a collection resource directory and a collection task based on the index item to be collected, and sending the collection resource directory and the collection task to the second service end; receiving index data sent by the second service end, and sending the index data to the first service end, so that the first service end determines whether the index data meets preset submission requirements based on the index data; receiving feedback logs sent by the first service end, and sending the feedback logs to the second service end, so that the second service end determines whether the index data meets the submission requirements based on the feedback logs. In the mode, diversified and complex data collection requirements are met, and the data quality is ensured.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data exchange, and in particular to a data collection exchange method and an electronic device. BACKGROUND

[0002] With the deepening and refinement of enterprise hierarchical management in modern society, the supervision and management of the superior unit on the subordinate enterprise is increasingly rigorous, and the demand for data collection also presents a trend of diversification and high frequency. Under this background, in order to achieve accurate decision-making and effective management, the types and scope of data required to be collected by various business departments are continuously expanding, and the complexity and diversity have reached an unprecedented level. Therefore, it is particularly important and urgent to design and implement a data collection method that can meet the diversified and complex data collection requirements and ensure data quality. SUMMARY

[0003] Therefore, the purpose of the present application is to provide a data collection exchange method and an electronic device to meet the diversified and complex data collection requirements and ensure data quality.

[0004] In a first aspect, an embodiment of the present application provides a data collection exchange method applied to a data collection exchange platform, a first business end, a data collection exchange platform and a second business end are sequentially connected in communication, and the method comprises: acquiring an index item to be collected sent by the first business end; generating a collection resource directory and a collection task based on the index item to be collected, and sending the collection resource directory and the collection task to the second business end, so that the second business end determines the index data corresponding to the index item to be collected; receiving the index data sent by the second business end, and sending the index data to the first business end, so that the first business end determines whether the index data meets the pre-set submission requirement based on the index data; receiving the feedback log sent by the first business end, and sending the feedback log to the second business end, so that the second business end determines whether the index data meets the submission requirement based on the feedback log.

[0005] In a preferred embodiment of the present application, before the above-mentioned receiving the index data sent by the second business end, the method further comprises: receiving the key sent by the first business end, so as to encrypt the index data based on the key.

[0006] In the preferred embodiment of the present application, the data collection exchange platform comprises a configuration database unit, and a collection resource directory unit, a data index definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit, and a data transmission unit in communication connection with the configuration database unit respectively; the configuration database unit is used for maintaining a collection resource directory template of the collection resource directory unit; the collection resource directory unit is used for storing the collection resource directory template; the data index definition unit is used for defining the index content of the index item to be collected; the collection task unit is used for saving the index data; the log management unit is used for forwarding the feedback log; the encryption and decryption software package unit is used for encrypting the index data sent by the second service end; and the data transmission unit is used for data transmission.

[0007] In the second aspect, the embodiments of the present application provide a data collection exchange method applied to a second service end, a first service end, a data collection exchange platform, and the second service end in communication connection in sequence, the method comprising: acquiring a collection resource directory and a collection task sent by the data collection exchange platform; collecting an index item based on the collection resource directory and the collection task to obtain index data; sending the index data to the data collection exchange platform, so that the data collection exchange platform sends the index data to the first service end; receiving a feedback log sent by the data collection exchange platform, and determining whether the index data meets a pre-set submission requirement based on the feedback log; if the index data does not meet the pre-set submission requirement, modifying the index data based on the feedback log; and sending the modified index data to the data collection exchange platform.

[0008] In the preferred embodiment of the present application, the collecting an index item based on the collection resource directory and the collection task to obtain index data comprises: collecting an index item based on the collection resource directory to obtain initial index data; performing format conversion on the initial index data to obtain a database file and non-formatted data; and submitting the database file and the non-formatted data to the collection task to obtain the index data.

[0009] In the preferred embodiment of the present application, after the collecting an index item based on the collection resource directory and the collection task to obtain index data, the method further comprises: performing format verification on the index data based on the data collection exchange platform to obtain a verification result; and if the verification result is a verification pass, sending the index data to the data collection exchange platform.

[0010] In a third aspect, an embodiment of the present application provides a data collection exchange method applied to a first service end, the first service end, a data collection exchange platform and a second service end being sequentially connected in communication, the method comprising: sending a to-be-collected index item to the data collection exchange platform, so that the data collection exchange platform generates a collection resource directory and a collection task based on the to-be-collected index item; receiving index data sent by the data collection exchange platform; determining whether the index data meets a preset submission requirement; if the index data meets the preset submission requirement, corresponding storage is performed on the index data and the to-be-collected index item; and sending a feedback log representing that the index data meets the submission requirement to the data collection exchange platform.

[0011] In a preferred embodiment of the present application, the method further comprises: if the index data does not meet the preset submission requirement, determining an error item in the index data based on the submission requirement; and sending a feedback log containing the error item to the data collection exchange platform.

[0012] In a preferred embodiment of the present application, after the sending of the to-be-collected index item to the data collection exchange platform, the method further comprises: sending a key to the data collection exchange platform; and after the receiving of the index data sent by the data collection exchange platform, the method further comprises: decrypting the index data based on the key.

[0013] In a fourth aspect, an embodiment of the present application further provides an electronic device comprising a processor and a memory, the memory storing computer executable instructions capable of being executed by the processor, and the processor executes the computer executable instructions to implement the data collection exchange method of the first aspect, the data collection exchange method of the second aspect and the data collection exchange method of the third aspect.

[0014] The embodiments of the present application have the following beneficial effects:

[0015] The embodiments of the present application provide a data collection exchange method and an electronic device, which are applied to a data collection exchange platform, a first service end, the data collection exchange platform and a second service end being sequentially connected in communication, by acquiring a to-be-collected index item sent by the first service end, generating a collection resource directory and a collection task based on the to-be-collected index item, and sending the collection resource directory and the collection task to the second service end, so that the second service end determines index data corresponding to the to-be-collected index item, then receiving the index data sent by the second service end, and sending the index data to the first service end, so that the first service end determines whether the index data meets a preset submission requirement based on the index data, finally receiving a feedback log sent by the first service end, and sending the feedback log to the second service end, so that the second service end determines whether the index data meets the submission requirement based on the feedback log. In this way, diversified and complex data collection requirements are met, and data quality is ensured.

[0016] Other features and advantages of the present disclosure will be set forth in the descriptions that follow, and in part will be apparent from the description, or can be learned by practice of the present disclosure as hereinafter more fully described, or can be learned by production of the present disclosure.

[0017] In order to make the above objectives, features and advantages of the present disclosure more obvious and comprehensible, the following preferred embodiments are specifically described below, and the accompanying drawings are referred to for a detailed description. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the specific embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings needed to be used in the specific embodiments or the prior art description. Obviously, the drawings described below are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0019] Figure 1a A flowchart of a data acquisition and exchange method applied to a data acquisition and exchange platform provided by an embodiment of the present application;

[0020] Figure 1b A structural diagram of a data acquisition and exchange platform provided by an embodiment of the present application;

[0021] Figure 2 A flowchart of a data acquisition and exchange method applied to a data acquisition and exchange platform provided by an embodiment of the present application;

[0022] Figure 3 A flowchart of a data acquisition and exchange method applied to a data acquisition and exchange platform provided by an embodiment of the present application;

[0023] Figure 4 A structural diagram of a data acquisition and exchange device of a data acquisition and exchange platform provided by an embodiment of the present application;

[0024] Figure 5 A structural diagram of a data acquisition and exchange device applied to a second service end provided by an embodiment of the present application;

[0025] Figure 6 A structural diagram of a data acquisition and exchange device applied to a first service end provided by an embodiment of the present application;

[0026] Figure 7 A structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the present application will be described clearly and completely below with reference to the drawings. Obviously, the described embodiments are some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection scope of the present application.

[0028] With the deepening and refinement of enterprise hierarchical management in modern society, the supervision and management of the superior unit on the subordinate enterprise are increasingly rigorous, and the demand for data collection also presents a trend of diversification and high frequency. Under this background, in order to realize accurate decision-making and effective management, the types and scope of data required to be collected by business departments at all levels are expanding, and the complexity and diversity have reached an unprecedented level.

[0029] Specifically, it not only involves various structured data such as financial statements, production statistical data and other formatted information, but also covers a large amount of unformatted data such as employee feedback, customer evaluation, market research report, image, audio, video and other types of information resources. These unformatted data are different in form and have no fixed mode to follow, which increases the difficulty of data processing and analysis.

[0030] The existing data collection system is facing severe challenges. On the one hand, how to efficiently and accurately extract and integrate the required data from massive and heterogeneous data sources to ensure the comprehensiveness and quasi-real-time of the data; on the other hand, how to adapt to the changing data collection needs, flexibly process data of various formats, and realize seamless connection and deep integration between different types of data, these are the problems that the existing data collection system must solve. At the same time, how to meet the data collection efficiency while ensuring the security and compliance of the data is also the focus that enterprises must pay attention to in the process of building and optimizing the data collection system. Therefore, it is particularly important and urgent to design and implement a new type of data collection system that can meet the above challenges, meet the diversified and complex data collection needs, and ensure the quality and security of the data.

[0031] Specifically, with the rapid development of information technology, data exchange has become an important link for cooperation and resource sharing in various industries. Traditional data exchange schemes can be mainly summarized into two categories: file exchange and exchange between databases. However, both of these two schemes have certain limitations.

[0032] The first common data exchange mode is file-based exchange, such as transmitting files in the form of CSV, XML, JSON, etc. through FTP, email attachments, network sharing, etc. Although file exchange is simple and easy to implement, it has the disadvantage of lacking strict data format checking mechanism. During data transmission, the file may be unable to be correctly parsed and utilized by the receiving end due to format errors, data missing or damage, especially when cross-system and cross-platform interaction, due to the problems of inconsistent format standards and inconsistent version updates, the consistency and accuracy of data are difficult to be effectively guaranteed.

[0033] The second data exchange mode is to directly migrate or synchronize data between different database systems. This mode is efficient and orderly for structured data processing, but most traditional database systems are mainly designed for processing structured data, and their storage and exchange functions are relatively weak for unstructured or non-formatted data such as text, pictures, audio, video, etc. This means that when exchanging directly between databases, it is often difficult to effectively support the transmission and integration of non-formatted data.

[0034] Based on this, the data collection exchange method and electronic device provided by the embodiment of the application can acquire the to-be-collected index item sent by the first service end, generate a collection resource directory and a collection task based on the to-be-collected index item, and send the collection resource directory and the collection task to the second service end, so that the second service end determines the index data corresponding to the to-be-collected index item, receives the index data sent by the second service end, and sends the index data to the first service end, so that the first service end determines whether the index data meets the pre-set submission requirement based on the index data, and finally receives the feedback log sent by the first service end, and sends the feedback log to the second service end, so that the second service end determines whether the index data meets the submission requirement based on the feedback log. In this way, the diversified and complex data collection requirements are met, the data quality is guaranteed, and through the customized submission requirement, the index data can be efficiently stored and accessed.

[0035] To facilitate the understanding of the present embodiment, first, a data collection exchange method disclosed by the embodiment of the application is introduced in detail.

[0036] Embodiment 1

[0037] The embodiment of the application provides a data collection exchange method applied to a data collection exchange platform, a first service end, a data collection exchange platform and a second service end are sequentially connected in communication, Figure 1a The flowchart of the data collection exchange method applied to the data collection exchange platform provided by the embodiment of the application is shown in FIG. 1. Figure 1a As shown in the figure, the data collection exchange method can include the following steps:

[0038] Step S101, obtaining the to-be-collected index item sent by the first business end.

[0039] The first business end can be a superior enterprise, and the second business end can be a subordinate enterprise. The to-be-collected index item can be data required by the first business end to be submitted by the second business end. The first business end can periodically send the to-be-collected index item to the data collection exchange platform.

[0040] Further, after obtaining the to-be-collected index item, the collection exchange platform can perform data compression on the to-be-collected index item to reduce bandwidth occupation and storage space requirements when the to-be-collected index item is sent to the second business end in the future. For example, data compression can be performed by means of Huffman coding, Lempel-Ziv-Welch compression algorithm, etc.

[0041] When data transmission is performed, an intelligent routing algorithm can be used to automatically select the optimal data transmission path according to network conditions and data volume.

[0042] Step S102, generating a collection resource directory and a collection task based on the to-be-collected index item, and sending the collection resource directory and the collection task to the second business end.

[0043] Specifically, the second business end determines the index data corresponding to the to-be-collected index item.

[0044] The collection resource directory can include a collection table name, a collection frequency, a collection period, a collection range, a collection description, and information related to reporting index data by the second business end.

[0045] Different to-be-collected index items can be pre-set with different collection requirements, such as collection frequency, collection period, collection range, collection description, etc. The corresponding collection resource directory is generated based on the collection requirements, and the collection task can be set according to the collection resource directory.

[0046] Step S103, receiving the index data sent by the second business end, and sending the index data to the first business end.

[0047] Specifically, the first business end determines whether the index data meets the pre-set submission requirements based on the index data.

[0048] The index data is obtained by the second business end based on the collection task and the collection directory, and is obtained by performing format conversion on the initial index data obtained by data collection and submitting the initial index data to the collection task.

[0049] Further, in order to ensure the security of the index data, before receiving the index data sent by the second business end, the method further comprises receiving a key sent by the first business end, and encrypting the index data based on the key.

[0050] Wherein, when the second service end sends the index data to the data collection exchange platform, the format verification of the index data is triggered, in the case that the verification result of the format verification is verification passed, the index data is sent to the data collection exchange platform, in the case that the verification result of the format verification is verification failed, the error reason is prompted, the second service end can modify the index data according to the error reason to submit again.

[0051] Step S104, receiving the feedback log sent by the first service end, and sending the feedback log to the second service end.

[0052] Specifically used for the second service end to determine whether the index data meets the submission requirement based on the feedback log.

[0053] Wherein, the feedback log can be a feedback error log or a feedback success log, the feedback error log can include: line number, column number, error reason, modification suggestion and the like of the error index data, and the feedback success log can include the number and success identifier of the current collection task.

[0054] Wherein, the first service end can send the feedback log according to whether the index data meets the pre-set submission requirement. In the case that the index data does not meet the submission requirement, the feedback error log is sent, and in the case that the index data meets the submission requirement, the feedback success log is sent.

[0055] Further, the method can further include: recording the account information corresponding to the second service end, and the feedback error log corresponding to the account information sent by the first service end; extracting the error reason in the feedback error log; mapping and saving the error reason, the collection resource directory corresponding to the error reason, the collection task, and the modified correct index data after the second service end modifies according to the feedback error log; when the error information in the feedback error log of the account information is extracted again, the error number is accumulated; when the error number accumulates to a preset number, after receiving the index data sent by the second service end, the position corresponding to the error reason is checked based on the modified correct index data, if the error still occurs, it is fed back to the second service end in real time for reference, which reduces the work complexity of the first client and improves the efficiency of data exchange. Of course, when the error information in the feedback error log of the account information is extracted again, the continuous error number can also be accumulated, and when the continuous error number accumulates to a preset number, the subsequent steps are performed.

[0056] In the embodiment of the application, a data collection exchange platform is also provided, Figure 1b The structure diagram of the data collection exchange platform provided by the embodiment of the application is as follows, Figure 1bAs shown, the data collection exchange platform can include a configuration database unit 10, and a collection resource directory unit 20, a data index definition unit 30, a collection task unit 40, a log management unit 50, an encryption and decryption software package unit 60, and a data transmission unit 70 in communication connection with the configuration database unit 10, respectively.

[0057] Specifically, the configuration database unit 10 is configured to maintain a collection resource directory template of the collection resource directory unit 20.

[0058] The collection resource directory template can be pre-set according to the possible requirements of the to-be-collected index items, so as to quickly obtain the corresponding collection resource directory after the data collection exchange platform receives the to-be-collected index.

[0059] Specifically, the collection resource directory unit 20 is configured to store the collection resource directory template.

[0060] The corresponding collection resource directory can be provided based on the correspondence between the to-be-collected index items and the collection resource directory template after the data collection exchange platform receives the collection index items.

[0061] Specifically, the data index definition unit 30 is configured to define the index content of the to-be-collected index items.

[0062] The index content can include index detailed information such as index number, index name, data type, data length, index description, and whether it is required to fill in.

[0063] Specifically, the collection task unit 40 is configured to save the index data.

[0064] Specifically, the log management unit 50 is configured to forward the feedback log.

[0065] The feedback log can be a feedback error log or a feedback success log. The feedback error log can include the line number, column number, error reason, and modification suggestion of the error index data. The feedback success log can include the number and success identifier of the current collection task.

[0066] Specifically, the encryption and decryption software package unit 60 is configured to encrypt the index data sent by the second business end.

[0067] The encryption and decryption software package unit 60 can have a key from the first business end. After the second business end submits the index data to the collection task unit 40, the encryption and decryption software package will encrypt the index data based on the key.

[0068] Specifically, the data transmission unit 70 is configured to perform data transmission.

[0069] The data transmission unit 70 can transmit the collection index item, the collection resource directory, the collection task, the feedback log and the like involved in the data exchange process.

[0070] In actual application, the data collection exchange platform can make full use of the characteristics of the SQLite database + file, realize the target of avoiding file exchange format checking problems and solving the difficulty of non-formatted data exchange between databases, take the SQLite database file + file as a carrier for data exchange, ensure the consistency and integrity of data at the first business end and the second business end through standardized data encapsulation and preprocessing, and strengthen the reliability and security of data exchange by using the national encryption algorithm in the transmission process. Meanwhile, through the customized data read-write interface and conversion rules, the non-formatted data can be efficiently stored and accessed in the SQLite database file, thereby effectively making up for the shortcomings of the original file exchange and database exchange.

[0071] The data collection exchange method provided by the embodiment of the application can acquire the to-be-collected index item sent by the first business end, generate the collection resource directory and the collection task based on the to-be-collected index item, send the collection resource directory and the collection task to the second business end, so that the second business end determines the index data corresponding to the to-be-collected index item, receive the index data sent by the second business end, and send the index data to the first business end, so that the first business end determines whether the index data meets the preset submission requirement based on the index data. Finally, the feedback log sent by the first business end is received, and the feedback log is sent to the second business end, so that the second business end determines whether the index data meets the submission requirement based on the feedback log. In this way, the diversified and complex data collection requirements are met, and the data quality is ensured.

[0072] Embodiment 2

[0073] The embodiment of the application provides a data collection exchange method applied to the second business end, the first business end, the data collection exchange platform and the second business end are sequentially connected in communication, Figure 2 A flowchart of the data collection exchange method applied to the second business end is provided in the embodiment of the application. As shown in the figure, Figure 2 The data collection exchange method can include the following steps:

[0074] In step S201, the collection resource directory and the collection task sent by the data collection exchange platform are acquired.

[0075] The data collection exchange platform will periodically receive the to-be-collected index item sent by the first business end, and then generate the collection resource directory and the corresponding collection task based on the to-be-collected index item.

[0076] The collection resource directory can include: a collection table name, a collection frequency, a collection period, a collection range, a collection description, and related information for reporting index data to the second service end.

[0077] Different to-be-collected index items can be pre-set with different collection requirements, such as collection frequency, collection period, collection range, collection description, and the like. The corresponding collection resource directory is generated based on the collection requirements, and the collection task can be set according to the collection resource directory.

[0078] Step S202, collecting index items based on the collection resource directory and the collection task to obtain index data.

[0079] Specifically, collecting index items based on the collection resource directory and the collection task to obtain index data can include: collecting index items based on the collection resource directory to obtain initial index data; converting the initial index data to obtain a database file and non-formatted data; submitting the database file and the non-formatted data to the collection task to obtain the index data.

[0080] The second service end prepares corresponding initial index data according to the resource directory and the collection task, converts the initial index data to obtain a database file and non-formatted data, the database file is a sqlite db file, and the database file and the non-formatted data are submitted to the collection task to form the index data.

[0081] Further, after collecting index items based on the collection resource directory and the collection task to obtain index data, the method further includes: performing format verification on the index data based on the data collection exchange platform to obtain a verification result; if the verification result is verified, the index data is sent to the data collection exchange platform.

[0082] When the second service end sends the index data to the data collection exchange platform, the format verification of the index data is triggered, if the verification result is not verified, the error reason is prompted, and the second service end can modify the index data according to the error reason, and then send the modified index data to the data collection exchange platform again until the verification result is verified.

[0083] Step S203, sending the index data to the data collection exchange platform.

[0084] Specifically, the data collection exchange platform sends the index data to the first service end.

[0085] Step S204, receiving the feedback log sent by the data collection exchange platform, and determining whether the index data meets the pre-set submission requirement based on the feedback log.

[0086] The feedback log can be a feedback error log or a feedback success log. If the index data does not meet the submission requirement, the feedback error log is sent, that is, if the feedback log received by the second service end is the feedback error log, the index data does not meet the submission requirement. If the index data meets the submission requirement, the feedback success log is sent, that is, if the feedback log received by the second service end is the feedback success log, the index data meets the submission requirement.

[0087] In step S205, if the index data does not meet the pre-set submission requirement, the index data is modified based on the feedback log.

[0088] If the index data does not meet the pre-set submission requirement, the feedback log is a feedback error log. The feedback error log can include the line number, column number, error reason, modification suggestion, etc. of the error index data.

[0089] In step S206, the modified index data is sent to the data collection exchange platform.

[0090] The data collection exchange method provided by the embodiment of the application can obtain the collection resource directory and the collection task sent by the data collection exchange platform, collect index items based on the collection resource directory and the collection task to obtain index data, send the index data to the data collection exchange platform, and send the index data to the first service end by the data collection exchange platform. The feedback log sent by the data collection exchange platform is received, and whether the index data meets the pre-set submission requirement is determined based on the feedback log. If the index data does not meet the pre-set submission requirement, the index data is modified based on the feedback log. The modified index data is sent to the data collection exchange platform. In this way, diversified and complex data collection requirements are met, and the data quality is ensured.

[0091] Embodiment 3

[0092] The embodiment of the application provides a data collection exchange method applied to a first service end, a first service end, a data collection exchange platform and a second service end are sequentially connected in communication, Figure 3 As shown in the flowchart of the data collection exchange method applied to the first service end provided by the embodiment of the application, the data collection exchange method can include the following steps: Figure 3 As shown in the flowchart of the data collection exchange method applied to the first service end provided by the embodiment of the application, the data collection exchange method can include the following steps:

[0093] In step S301, the index item to be collected is sent to the data collection exchange platform.

[0094] The data collection exchange platform generates a collection resource directory and a collection task based on the index item to be collected.

[0095] The to-be-collected index item can be sent to the collection exchange platform periodically. The to-be-collected index item can be data required by the first service end to be submitted by the second service end.

[0096] After the to-be-collected index item is sent to the data collection exchange platform, the method further includes sending a key to the data collection exchange platform. After the index data sent by the data collection exchange platform is received, the method further includes decrypting the index data based on the key.

[0097] Step S302, receiving index data sent by the data collection exchange platform.

[0098] Step S303, determining whether the index data meets the pre-set submission requirement.

[0099] The first service end includes a first service system, and whether the index data meets the pre-set submission requirement can be determined by the first service system.

[0100] Step S304, if the index data meets the pre-set submission requirement, the index data and the to-be-collected index item are stored correspondingly.

[0101] When the index data is stored, it is specifically stored in a database of the first service system itself.

[0102] Further, if the index data does not meet the pre-set submission requirement, an error item in the index data is determined based on the submission requirement; a feedback log containing the error item is sent to the data collection exchange platform.

[0103] The feedback log containing the error item is a feedback error log, and the error item can include an error line number, an error column number, an error reason, a modification suggestion, etc. The data collection exchange platform receives the feedback log and sends the feedback log to the second service end, and the second service end modifies the index data based on the feedback log.

[0104] Step S305, sending a feedback log representing that the index data meets the submission requirement to the data collection exchange platform.

[0105] The feedback log representing that the index data meets the submission requirement is the above-mentioned feedback success log, and the feedback success log can include a number of a current collection task and a success identifier.

[0106] The data collection exchange method provided by the embodiment of the present application can send the to-be-collected index item to the data collection exchange platform, so that the data collection exchange platform generates a collection resource directory and a collection task based on the to-be-collected index item, receives the index data sent by the data collection exchange platform, determines whether the index data meets the preset submission requirement, stores the index data and the to-be-collected index item in correspondence if the index data meets the preset submission requirement, and finally sends a feedback log indicating that the index data meets the submission requirement to the data collection exchange platform. In this way, diversified and complex data collection requirements are met, and the data quality is ensured.

[0107] Embodiment 4

[0108] Corresponding to the above method embodiment, the embodiment of the present application provides a data collection exchange device applied to a data collection exchange platform, a first service end, the data collection exchange platform and a second service end are sequentially connected in communication, Figure 4 The structure diagram of the data collection exchange device applied to the data collection exchange platform provided by the embodiment of the present application is shown in Figure 4 As shown in the figure, the data collection exchange device can include:

[0109] The to-be-collected index item acquisition module 401 is configured to acquire the to-be-collected index item sent by the first service end.

[0110] The directory and task forwarding module 402 is configured to generate a collection resource directory and a collection task based on the to-be-collected index item, and send the collection resource directory and the collection task to the second service end, so that the second service end determines the index data corresponding to the to-be-collected index item.

[0111] The index data forwarding module 403 is configured to receive the index data sent by the second service end, and send the index data to the first service end, so that the first service end determines whether the index data meets the preset submission requirement based on the index data.

[0112] The feedback log forwarding module 404 is configured to receive the feedback log sent by the first service end, and send the feedback log to the second service end, so that the second service end determines whether the index data meets the submission requirement based on the feedback log.

[0113] The data collection exchange device provided by the embodiment of the present application can acquire the to-be-collected index item sent by the first service end, generate a collection resource directory and a collection task based on the to-be-collected index item, and send the collection resource directory and the collection task to the second service end, so that the second service end determines the index data corresponding to the to-be-collected index item, receives the index data sent by the second service end, and sends the index data to the first service end, so that the first service end determines whether the index data meets the preset submission requirement based on the index data, finally receives the feedback log sent by the first service end, and sends the feedback log to the second service end, so that the second service end determines whether the index data meets the submission requirement based on the feedback log. In this way, diversified and complex data collection requirements are met, and the data quality is ensured.

[0114] In some embodiments, the index data forwarding module is further configured to receive a key sent by the first service end, and encrypt the index data based on the key.

[0115] In some embodiments, the data collection exchange platform comprises a configuration database unit, and a collection resource directory unit, a data index definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit, and a data transmission unit which are respectively communicatively connected with the configuration database unit; the configuration database unit is configured to maintain a collection resource directory template of the collection resource directory unit; the collection resource directory unit is configured to store the collection resource directory template; the data index definition unit is configured to define index content of the to-be-collected index item; the collection task unit is configured to save the index data; the log management unit is configured to forward the feedback log; the encryption and decryption software package unit is configured to encrypt the index data sent by the second service end; and the data transmission unit is configured to perform data transmission.

[0116] The device provided by the embodiment of the present application has the same implementation principle and technical effects as the foregoing method embodiment, and for brevity of description, the part not mentioned in the device embodiment can be referred to the corresponding content in the foregoing method embodiment.

[0117] Embodiment 5

[0118] Corresponding to the foregoing method embodiment, the embodiment of the present application provides a data collection exchange device applied to a second service end, a first service end, a data collection exchange platform, and the second service end are communicatively connected in sequence, Figure 5 A structural schematic diagram of a data collection exchange device applied to a second service end provided by the embodiment of the present application is shown in Figure 5 The data collection exchange device can comprise:

[0119] A directory and task acquisition module 501 is configured to acquire the collection resource directory and the collection task sent by the data collection exchange platform.

[0120] The index data obtaining module 502 is configured to obtain index data based on the collection resource directory and the collection task.

[0121] The first index data sending module 503 is configured to send the index data to the data collection exchange platform, so that the data collection exchange platform sends the index data to the first service end.

[0122] The feedback log receiving module 504 is configured to receive the feedback log sent by the data collection exchange platform, and determine whether the index data meets the pre-set submission requirement based on the feedback log.

[0123] The index data modifying module 505 is configured to modify the index data based on the feedback log if the index data does not meet the pre-set submission requirement.

[0124] The second index data sending module 506 is configured to send the modified index data to the data collection exchange platform.

[0125] The data collection exchange device provided by the embodiment of the present application can obtain the collection resource directory and the collection task sent by the data collection exchange platform, obtain index data based on the collection resource directory and the collection task, send the index data to the data collection exchange platform, receive the feedback log sent by the data collection exchange platform, determine whether the index data meets the pre-set submission requirement based on the feedback log, modify the index data based on the feedback log if the index data does not meet the pre-set submission requirement, and send the modified index data to the data collection exchange platform. In this way, the diversified and complex data collection requirements are met, and the data quality is ensured.

[0126] In some embodiments, the index data obtaining module is further configured to obtain initial index data based on the collection resource directory, perform format conversion on the initial index data to obtain a database file and non-formatted data, and submit the database file and the non-formatted data to the collection task to obtain the index data.

[0127] In some embodiments, the index data obtaining module is further configured to perform format verification on the index data based on the data collection exchange platform to obtain a verification result, and send the index data to the data collection exchange platform if the verification result is a verification pass.

[0128] The device provided by the embodiment of the present application has the same implementation principle and technical effects as the foregoing method embodiments. For brevity, the part not mentioned in the device embodiment part can be referred to the corresponding content in the foregoing method embodiments.

[0129] Embodiment 6

[0130] Corresponding to the above method embodiments, the embodiments of the present application provide a data collection exchange device, applied to a first service end, the first service end, a data collection exchange platform and a second service end are sequentially connected in communication, Figure 6 A structural schematic diagram of the data collection exchange device applied to the first service end provided by the embodiments of the present application is shown in the figure, which can include: Figure 6

[0131] The to-be-collected index sending module 601 is configured to send a to-be-collected index item to the data collection exchange platform, so that the data collection exchange platform generates a collection resource directory and a collection task based on the to-be-collected index item.

[0132] The index data receiving module 602 is configured to receive index data sent by the data collection exchange platform.

[0133] The index data judging module 603 is configured to determine whether the index data meets a pre-set submission requirement.

[0134] The index data storage module 604 is configured to, if the index data meets the pre-set submission requirement, store the index data and the to-be-collected index item correspondingly.

[0135] The feedback log sending module 605 is configured to send a feedback log representing that the index data meets the submission requirement to the data collection exchange platform.

[0136] The data collection exchange device provided by the embodiments of the present application can send a to-be-collected index item to the data collection exchange platform, so that the data collection exchange platform generates a collection resource directory and a collection task based on the to-be-collected index item, then receive index data sent by the data collection exchange platform, determine whether the index data meets a pre-set submission requirement, if the index data meets the pre-set submission requirement, store the index data and the to-be-collected index item correspondingly, and finally send a feedback log representing that the index data meets the submission requirement to the data collection exchange platform. In this way, diversified and complex data collection requirements are met, and data quality is ensured.

[0137] In some embodiments, the index data judging module is further configured to, if the index data does not meet the pre-set submission requirement, determine an error item in the index data based on the submission requirement; and send a feedback log containing the error item to the data collection exchange platform.

[0138] In some embodiments, the to-be-collected index sending module is further configured to send a key to the data collection exchange platform; and decrypt the index data based on the key.

[0139] ​The device provided by the embodiments of the present application has the same implementation principle and generated technical effects as the foregoing method embodiments, and for brevity of description, the part not mentioned in the device embodiments can be referred to the corresponding content in the foregoing method embodiments.

[0140] Embodiment 7

[0141] The embodiments of the present application also provide an electronic device for running the data collection and exchange method described above; refer to Figure 7 The electronic device shown in the structural schematic diagram of the electronic device, the electronic device includes a memory 700 and a processor 701, wherein the memory 700 is used to store one or more computer instructions, and the one or more computer instructions are executed by the processor 701 to realize the data collection and exchange method described above.

[0142] Further, Figure 7 The electronic device shown also includes a bus 702 and a communication interface 703, and the processor 701, the communication interface 703 and the memory 700 are connected through the bus 702.

[0143] The memory 700 can include a high-speed random access memory (RAM, Random Access Memory), and can also include a non-volatile memory, for example, at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 703 (which can be wired or wireless), and the Internet, a wide area network, a local area network, a metropolitan area network, etc. can be used. The bus 702 can be an ISA bus, a PCI bus or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 7 Only one bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0144] The processor 701 can be an integrated circuit chip having a processing capability of signals. In the implementation process, each step of the above method can be completed by the integrated logic circuit of hardware or the instruction in the form of software in the processor 701. The processor 701 described above can be a general processor, including a central processing unit (CPU), a network processor (NP), etc.; can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Each method, step and logic block diagram disclosed in the embodiment of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiment of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a random access memory, a flash memory, a read only memory, a programmable read only memory or an electrically erasable programmable memory, a register, etc. The storage medium in the art. The storage medium is located in the memory 700, and the processor 701 reads the information in the memory 700, and combines the hardware to complete the steps of the method of the above embodiment.

[0145] The embodiment of the present application also provides a computer readable storage medium, the computer readable storage medium stores computer executable instructions, when the processor calls and executes the computer executable instructions, the computer executable instructions cause the processor to implement the above data acquisition and exchange method, and the specific implementation can be referred to the method embodiment, and will not be repeated here.

[0146] The computer program product for performing the data acquisition and exchange method provided by the embodiment of the present application comprises a computer readable storage medium storing nonvolatile program codes executable by the processor, and the instructions included in the program codes can be used to execute the method described in the foregoing method embodiment, and the specific implementation can be referred to the method embodiment, and will not be repeated here.

[0147] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, and will not be repeated here.

[0148] In several embodiments provided by the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. The described device embodiments are merely schematic, and for example, the division of the units is only a logical function division, and there can be another division manner in actual implementation; for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between different units, or the among different units, can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electric, mechanical or other forms.

[0149] The units described as separated components can or can not be physically separated, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. In actual implementation, some or all of the units can be selected according to the actual needs to achieve the purposes of the embodiments of the present application.

[0150] In addition, each function unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can exist physically as a separate unit, or two or more units can be integrated in one unit.

[0151] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art, or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0152] Finally, it should be noted that the above-described embodiments are merely specific embodiments of the present application, which are used to illustrate the technical solutions of the present application, but not to limit the present application, and the protection scope of the present application is not limited thereto. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still make modifications or easily think of changes to the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some technical features therein, within the technical range disclosed by the present application. The modifications, changes or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A data acquisition exchange method, characterized by, The method is applied to a data collection exchange platform, a first service end, the data collection exchange platform and a second service end are sequentially connected in communication, and the method comprises the following steps: Obtaining an index item to be collected sent by the first service end; Generating a collection resource directory and a collection task based on the index item to be collected, and sending the collection resource directory and the collection task to the second service end, so that the second service end determines the index data corresponding to the index item to be collected; Receiving index data sent by the second service end, and sending the index data to the first service end, so that the first service end determines whether the index data meets the preset submission requirement based on the index data; Receiving feedback logs sent by the first service end, and sending the feedback logs to the second service end, so that the second service end determines whether the index data meets the submission requirement based on the feedback logs; The feedback logs include feedback error logs and feedback success logs, the feedback error logs include: line number, column number, error reason, modification suggestion of the error index data; Recording the account information corresponding to the second service end, and the feedback error logs corresponding to the account information sent by the first service end; extracting the error reason in the feedback error logs; mapping and saving the error-free index data after the error reason, the collection resource directory and the collection task corresponding to the error reason, and the modification of the second service end according to the feedback error logs; when the error information in the feedback error logs of the account information is extracted again, the error number is accumulated; when the error number accumulates to the preset number, after receiving the index data sent by the second service end, the position corresponding to the error reason is checked based on the error-free index data, if the error still exists, it is fed back to the second service end in real time for reference; Or when the error information in the feedback error logs of the account information is extracted again, the continuous error number is accumulated, when the continuous error number accumulates to the preset continuous number, after receiving the index data sent by the second service end, the position corresponding to the error reason is checked based on the error-free index data, if the error still exists, it is fed back to the second service end in real time for reference.

2. The method of claim 1, wherein, Before the step of receiving the index data sent by the second service end, the method further comprises the following steps: Receiving a key sent by the first service end to encrypt the index data based on the key.

3. The method according to claim 1 or 2, characterized in that, The data collection exchange platform comprises a configuration database unit, and a collection resource directory unit, a data index definition unit, a collection task unit, a log management unit, an encryption and decryption software package unit and a data transmission unit which are sequentially connected in communication with the configuration database unit; The configuration database unit is used for maintaining a collection resource directory template of the collection resource directory unit; the collection resource directory unit is used for storing the collection resource directory template; the data index definition unit is used for defining index contents of the to-be-collected index items; the collection task unit is used for saving the index data; the log management unit is used for forwarding the feedback log; the encryption and decryption software package unit is used for encrypting the index data sent by the second service end; and the data transmission unit is used for data transmission.

4. A data acquisition exchange method characterized by, The method is applied to a second service end, a first service end, a data collection exchange platform and the second service end are sequentially connected in communication, and the method comprises the following steps: Obtaining a collection resource directory and a collection task sent by the data collection exchange platform; Collecting index items based on the collection resource directory and the collection task to obtain index data; Sending the index data to the data collection exchange platform, so that the data collection exchange platform sends the index data to the first service end; Receiving a feedback log sent by the data collection exchange platform, and determining whether the index data meets a pre-set submission requirement based on the feedback log; If the index data does not meet the pre-set submission requirement, modifying the index data based on the feedback log; Sending the modified index data to the data collection exchange platform; The feedback log comprises a feedback error log and a feedback success log, and the feedback error log comprises a line number, a column number, an error reason and a modification suggestion of the error index data; The data collection exchange platform records account information corresponding to the second service end, and a feedback error log corresponding to the account information sent by the first service end; extracts an error reason in the feedback error log; maps and saves the error reason, the collection resource directory and the collection task corresponding to the error reason, and the modified correct index data after the second service end modifies according to the feedback error log; when the error information in the feedback error log of the account information is extracted again, the error number is accumulated; when the error number accumulates to a preset number, after receiving the index data sent by the second service end, the position corresponding to the error reason is checked based on the modified correct index data, if the error still occurs, it is fed back to the second service end in real time for reference; or when the error information in the feedback error log of the account information is extracted again, the continuous error number is accumulated, and when the continuous error number accumulates to a preset continuous number, after receiving the index data sent by the second service end, the position corresponding to the error reason is checked based on the modified correct index data, if the error still occurs, it is fed back to the second service end in real time for reference.

5. The method of claim 4, wherein, The method comprises the following steps: Collecting index items based on the collection resource directory to obtain initial index data; Converting the initial index data to obtain a database file and non-formatted data; Submit the database file and the non-formatted data to the collection task to obtain the index data.

6. The method of claim 4, wherein, After the index data is obtained based on the collection resource directory and the collection task, the method further comprises: Performing format verification on the index data based on the data collection exchange platform to obtain a verification result; If the verification result is a verification pass, the index data is sent to the data collection exchange platform.

7. A data acquisition exchange method characterized by, The method comprises: sending a to-be-collected index item to the data collection exchange platform, so that the data collection exchange platform generates a collection resource directory and a collection task based on the to-be-collected index item; receiving index data sent by the data collection exchange platform; determining whether the index data meets a pre-set submission requirement; If the index data meets the pre-set submission requirement, the index data and the to-be-collected index item are stored correspondingly; sending a feedback log representing that the index data meets the submission requirement to the data collection exchange platform; The feedback log comprises a feedback error log and a feedback success log, and the feedback error log comprises: line number, column number, error cause, and modification suggestion of the error index data. The data collection exchange platform records account information corresponding to the second business end, and feedback error logs corresponding to the account information sent by the first business end; extracts the error cause in the feedback error log; maps and saves the error cause, the collection resource directory and the collection task corresponding to the error cause, and the modified correct index data after the second business end modifies according to the feedback error log; when the error information in the feedback error log of the account information is extracted again, the error number is accumulated; when the error number accumulates to a preset number, after receiving the index data sent by the second business end, the position corresponding to the error cause is checked based on the modified correct index data, and if the error still occurs, it is fed back to the second business end in real time for reference; Or when the error information in the feedback error log of the account information is extracted again, the continuous error number is accumulated, and when the continuous error number accumulates to a preset continuous number, after receiving the index data sent by the second business end, the position corresponding to the error cause is checked based on the modified correct index data, and if the error still occurs, it is fed back to the second business end in real time for reference.

8. The method of claim 7, wherein, The method further comprises: If the index data does not meet the pre-set submission requirement, determine the error item in the index data based on the submission requirement; send the feedback log containing the error item to the data collection exchange platform.

9. The method of claim 7, wherein, After the to-be-collected index item is sent to the data collection exchange platform, the method further comprises: sending a key to the data collection exchange platform; After the index data sent by the data collection exchange platform is received, the method further comprises: decrypting the index data based on the key.

10. An electronic device, comprising: A computer program product comprising a computer readable medium having stored thereon computer executable instructions that, when executed by a processor, cause the processor to implement the data acquisition exchange method of any of claims 1 to 3, and the data acquisition exchange method of any of claims 4 to 6, and the data acquisition exchange method of any of claims 7 to 9.

Images