Cross-platform data processing method, system, equipment and medium

Abstract

The invention discloses a cross-platform data processing method, system and device and a medium, and relates to the technical field of data governance, and the method comprises the steps: extracting first data of a customer center for a business acceptance process and second data of a company, carrying out the synchronous processing of the first data and the second data, and generating a difference analysis report; according to the difference analysis report, re-checking and repairing processing are carried out through a company; extracting third data of the service application terminal in the service acceptance process, performing synchronous processing on the third data and the first data, and generating a comparison analysis report; and according to the comparison analysis report, re-checking and processing are carried out through the client center. According to the method, the data is acquired from the three-party platform, the difference analysis report or the comparison analysis report is generated after further data synchronization, and data restoration and other processing are performed on the basis, so that the data difference between the platforms can be greatly reduced, and the experience feeling of using the data by a customer is greatly improved.

Description

Background Art

[0002] IT system data security and data governance are becoming more and more frequent. Third-party data from multiple platforms, groups, and provinces has always been a difficult point, and groups are collecting data more and more frequently. In most provinces, data has been directly collected, and the data from various provinces are used to carry out business operations on platforms such as the National Family Network, One Certificate and Five Numbers for the Whole Network, and the Whole Network Anti-Fraud Platform. Therefore, the consistency of data from the three parties needs to be managed urgently. Summary of the invention

[0003] The technical problem to be solved by the present invention is to address the deficiencies of the prior art and specifically provide a cross-platform data processing method, system, device and medium, as follows:

[0004] 1) In the first aspect, the present invention provides a cross-platform data processing method, and the specific technical solution is as follows:

[0005] Extracting first data of the customer center regarding the business acceptance process and second data of the company regarding the business acceptance process, and synchronously processing the first data and the second data and generating a difference analysis report;

[0006] According to the difference analysis report, the company will conduct a review and repair process;

[0007] Extracting third data from the service application terminal during the service acceptance process, synchronously processing the third data and the first data, and generating a comparison analysis report;

[0008] Based on the comparison and analysis report, the customer center will review and process it.

[0009] The beneficial effects of a cross-platform data processing method provided by the present invention are as follows:

[0010] By acquiring data from three-party platforms (customer center, company, and business application terminal), further synchronizing the data to generate a difference analysis report or a comparison analysis report, and using this as a basis for data repair and other processing, the data differences between the platforms can be greatly reduced, thereby greatly improving the customer experience of using data.

[0011] Based on the above solution, the present invention can also be improved as follows.

[0012] Furthermore, the process of review and repair by the company is specifically as follows:

[0013] An online work order is generated in the customer center, and based on the online work order, a table horizontal expansion governance plan, a business line expansion governance plan, and a periodic governance plan are generated.

[0014] Furthermore, the table horizontal expansion management solution is specifically: the newly connected data tables are processed in batches and time periods through the customer center.

[0015] Furthermore, the business line expansion governance solution is specifically: all newly connected data tables are sorted according to priority through the customer center, and processing is performed based on the sorting results.

[0016] Furthermore, the periodic governance plan is specifically: evaluating and processing the company's complaint tickets and the company's fault tickets through the customer center.

[0017] 2) In the second aspect, the present invention also provides a cross-platform data processing system, and the specific technical solution is as follows:

[0018] The first extraction module is used to extract first data of the business acceptance process of the customer center and second data of the business acceptance process within the company, and synchronously process the first data and the second data and generate a difference analysis report;

[0019] The repair processing module is used to: conduct review and repair processing through the company according to the difference analysis report;

[0020] The second extraction module is used to: extract the third data in the service acceptance process of the service application terminal, synchronously process the third data and the first data, and generate a comparison analysis report;

[0021] The processing module is used to: review and process the comparison and analysis report through the customer center.

[0022] 3) In a third aspect, the present invention further provides an electronic device, comprising a processor, wherein the processor is coupled to a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor so that the electronic device implements any of the above methods.

[0023] 4) In a fourth aspect, the present invention further provides a computer-readable storage medium, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor so that a computer implements any of the above methods.

[0024] It should be noted that the beneficial effects achieved by the technical solutions of the second to fourth aspects of the present invention and the corresponding possible implementation methods can be found in the above-mentioned technical effects of the first aspect and its corresponding possible implementation methods, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0026] Figure 1 A schematic flow chart of a cross-platform data processing method according to an embodiment of the present invention;

[0027] Figure 2 A multi-platform interaction schematic diagram of a cross-platform data processing method according to an embodiment of the present invention;

[0028] Figure 3 The figure is a structural framework diagram of an electronic device. DETAILED DESCRIPTION

[0029] In order to make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0030] like Figure 1 as well as Figure 2 As shown, a cross-platform data processing method according to an embodiment of the present invention, the specific technical solution is as follows:

[0031] S1, extracting first data of the customer center for the business acceptance process and second data of the company for the business acceptance process, and synchronously processing the first data and the second data and generating a difference analysis report;

[0032] S2, review and repair the difference analysis report through the company;

[0033] S3, extracting third data in the service acceptance process of the service application terminal, synchronously processing the third data and the first data, and generating a comparison analysis report;

[0034] S4, reviewing and processing the comparison and analysis report through the customer center.

[0035] The beneficial effects of a cross-platform data processing method provided by the present invention are as follows:

[0036] By acquiring data from three-party platforms (customer center, company, and business application terminal), further synchronizing the data to generate a difference analysis report or a comparison analysis report, and using this as a basis for data repair and other processing, the data differences between the platforms can be greatly reduced, thereby greatly improving the customer experience of using data.

[0037] The first data in the business acceptance process includes but is not limited to: business acceptance time, relevant acceptance personnel, business type, called interface, business end time and business acceptance results, etc.

[0038] The second data and the third data contain similar contents to the first data, including at least the business acceptance time, relevant acceptance personnel, business type, business end time and business acceptance result.

[0039] Synchronous processing can also be understood as comparative processing. First, it is necessary to compare the business acceptance times of different platforms. For example, the synchronous processing of the first data and the second data is as follows: Business A should be processed by the customer center first, and the processing results should be fed back to the company, and then processed by the company and handed over to the business application terminal. Therefore, in the process of comparing the business acceptance time, it should be compared whether the company's business acceptance time is earlier than the business end time of the customer center.

[0040] The synchronization process of the third data and the first data is similar to the synchronization process of the second data and the first data.

[0041] The difference analysis report includes but is not limited to: business type, business name, data with abnormalities after comparison, and abnormality type.

[0042] The specific process of providing the company's application data in conjunction with the customer center and reviewing and processing the difference analysis report is as follows:

[0043] According to the exception type and the corresponding business name, all relevant data requests corresponding to the business name are sent to the customer center. After receiving the request, the customer center will feedback the corresponding data and check again on the company platform to see if there is an exception. If so, notify manual intervention. If not, delete the relevant content in the difference analysis report.

[0044] The comparison and analysis report includes but is not limited to: business type, business name, data with anomalies after comparison, and the anomaly type.

[0045] The difference between the difference analysis report and the comparison analysis report is that the difference analysis report is generated for the abnormal data between the customer center and the company, while the comparison analysis report is generated for the difference data between the business application terminal and the customer center.

[0046] Embodiment 1. In this embodiment, the three-party platform is specifically: a customer center, a provincial company and a business application terminal. The customer center provides business data to the interface machine. Through SFTP, data is extracted in the provincial company according to the type of business data provided by the customer center. The extracted data is synchronized to the interface machine, and data comparison is performed within the provincial company, that is, synchronous processing (since the business data provided by the customer center is the same as the type of data extracted by the provincial company, it is necessary to compare whether there are abnormal situations in the processing process and whether the data is incomplete), and generate a difference analysis report. The difference analysis report contains the abnormal data and the business project name corresponding to the abnormal data, and the corresponding review processing is performed according to the difference analysis report. The same method is applied to the business application terminal and the customer center, and a comparison analysis report is generated. The review and processing are completed through the comparison analysis report.

[0047] The review process may also include: the customer center issues an online work order, and based on the online work order, generates a table horizontal expansion management plan, a business line expansion management plan, and a periodic management plan.

[0048] Online work orders include business name, business type, abnormal data, and abnormal type.

[0049] Table horizontal expansion management: The customer center manages the tables that are not covered in certain domains or the newly connected data tables in batches and time periods. The newly connected data tables can be classified, that is, classified by batch or by time period, and the corresponding data tables are processed according to the batch order or time period order.

[0050] Business line expansion management: As the number of business lines accepted by the customer center increases, the number of tables involved in data management increases, and data management of high-priority tables related to this part of the business is gradually carried out.

[0051] Periodic governance of provinces: The customer center evaluates the work orders, data complaints, and provincial faults of the provinces, and performs cyclical governance of data for the provinces. Periodic data governance of provinces is the main work in the early stage of data governance. After the customer center uses this governance method to make the data meet production requirements, it will carry out online work order data governance, table horizontal expansion governance, and business line expansion governance in turn.

[0052] After determining the horizontal expansion governance plan, business line expansion governance plan and periodic governance plan for the above table, coordinate the company and business application terminals to carry out corresponding data processing, and promptly feedback the processing results to the customer center. After the customer center confirms that the online work order is completed, delete the relevant content from the online work order list.

[0053] Based on the above solution, the present invention can also be improved as follows.

[0054] Furthermore, the process of review and repair by the company is specifically as follows:

[0055] An online work order is generated in the customer center, and based on the online work order, a table horizontal expansion governance plan, a business line expansion governance plan, and a periodic governance plan are generated.

[0056] Furthermore, the table horizontal expansion management solution is specifically: the newly connected data tables are processed in batches and time periods through the customer center.

[0057] Furthermore, the business line expansion governance solution is specifically: all newly connected data tables are sorted according to priority through the customer center, and processing is performed based on the sorting results.

[0058] Furthermore, the periodic governance plan is specifically: evaluating and processing the company's complaint tickets and the company's fault tickets through the customer center.

[0059] This solution has the following beneficial effects:

[0060] 1. Extract provincial data based on key fields through Kafka, and then convert it into group data through the conversion library, so that each province can have differences, and the group has only one table data of the same model.

[0061] 2. The provincial side uses the hardoop computing framework to compare the consistency data, which can quickly provide analysis results and difference analysis

[0062] 3. The provincial side deploys applications through the fortress backend distributed framework, which can perform incremental and full data processing in real time.

[0063] In the above embodiments, although the steps are numbered S1, S2, etc., these are only specific embodiments given by the present invention. Those skilled in the art may adjust the execution order of S1, S2, etc. according to actual conditions, which is also within the protection scope of the present invention. It can be understood that in some embodiments, some or all of the above embodiments may be included.

[0064] The present invention also provides a cross-platform data processing system, and the specific technical solution is as follows:

[0065] The first extraction module is used to extract first data of the business acceptance process of the customer center and second data of the business acceptance process within the company, and synchronously process the first data and the second data and generate a difference analysis report;

[0066] The repair processing module is used to: conduct review and repair processing through the company according to the difference analysis report;

[0067] The second extraction module is used to: extract the third data in the service acceptance process of the service application terminal, synchronously process the third data and the first data, and generate a comparison analysis report;

[0068] The processing module is used to: review and process the comparison and analysis report through the customer center.

[0069] It should be noted that the beneficial effects of a cross-platform data processing system provided by the above embodiment are the same as the beneficial effects of the cross-platform data processing method provided by the above embodiment, which will not be described in detail here. In addition, when the system provided by the above embodiment realizes its functions, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the system can be divided into different functional modules according to actual conditions to complete all or part of the functions described above. In addition, the system and method embodiments provided by the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be described in detail here.

[0070] like Figure 3 As shown, an electronic device 300 according to an embodiment of the present invention includes a processor 320, the processor 320 is coupled to a memory 310, and the memory 310 stores at least one computer program 330, and the at least one computer program 330 is loaded and executed by the processor 320, so that the electronic device 300 implements any of the above methods, specifically:

[0071] The electronic device 300 may have relatively large differences due to different configurations or performances, and may include one or more processors 320 (Central Processing Units, CPU) and one or more memories 310, wherein at least one computer program 330 is stored in the one or more memories 310, and the at least one computer program 330 is loaded and executed by the one or more processors 320, so that the electronic device 300 implements a cross-platform data processing method provided by the above embodiment. Of course, the electronic device 300 may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output, and the electronic device 300 may also include other components for realizing device functions, which will not be repeated here.

[0072] A computer-readable storage medium according to an embodiment of the present invention stores at least one computer program, and the at least one computer program is loaded and executed by a processor so that a computer implements any one of the above methods.

[0073] Optionally, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0074] In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device performs any of the above methods.

[0075] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects and represent the definition of a specific order or sequence. The order of use of similar objects can be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than the order shown or described.

[0076] Those skilled in the art know that the present invention can be implemented as a system, method or computer program product. Therefore, the present disclosure can be specifically implemented in the following forms, namely: it can be complete hardware, it can be complete software (including firmware, resident software, microcode, etc.), or it can be a combination of hardware and software, which is generally referred to as "circuit", "module" or "system" herein. In addition, in some embodiments, the present invention can also be implemented in the form of a computer program product in one or more computer-readable media, and the computer-readable medium contains computer-readable program code.

[0077] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0078] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A cross-platform data processing method, characterized in that: include: Extracting first data of the customer center regarding the business acceptance process and second data of the company regarding the business acceptance process, and synchronously processing the first data and the second data and generating a difference analysis report; According to the difference analysis report, the company will conduct a review and repair process; Extracting third data from the service application terminal during the service acceptance process, synchronously processing the third data and the first data, and generating a comparison analysis report; Based on the comparison and analysis report, the customer center will review and process it.

2. A cross-platform data processing method according to claim 1, characterized in that: The specific process of review and repair by the company is as follows: An online work order is generated in the customer center, and based on the online work order, a table horizontal expansion governance plan, a business line expansion governance plan, and a periodic governance plan are generated.

3. A cross-platform data processing method according to claim 2, characterized in that: The table horizontal expansion management solution is specifically: the newly connected data tables are processed in batches and time periods through the customer center.

4. A cross-platform data processing method according to claim 2, characterized in that: The business line expansion governance solution is specifically: all newly connected data tables are sorted according to priority through the customer center, and processing is performed based on the sorting results.

5. The cross-platform data processing method according to claim 2, characterized in that: The periodic governance plan specifically includes: evaluating and processing the company's complaint tickets and the company's fault tickets through the customer center.

6. A cross-platform data processing system, characterized in that: include: The first extraction module is used to extract first data of the business acceptance process of the customer center and second data of the business acceptance process within the company, and synchronously process the first data and the second data and generate a difference analysis report; The repair processing module is used to: conduct review and repair processing through the company according to the difference analysis report; The second extraction module is used to: extract the third data in the service acceptance process of the service application terminal, synchronously process the third data and the first data, and generate a comparison analysis report; The processing module is used to: review and process the comparison and analysis report through the customer center.

7. A cross-platform data processing system according to claim 6, characterized in that: The specific process of review and repair by the company is as follows: An online work order is generated in the customer center, and based on the online work order, a table horizontal expansion governance plan, a business line expansion governance plan, and a periodic governance plan are generated.

8. A cross-platform data processing system according to claim 7, characterized in that: The table horizontal expansion management solution is specifically: the newly connected data tables are processed in batches and time periods through the customer center.

9. An electronic device, characterized in that: The electronic device comprises a processor, the processor is coupled to a memory, at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor so that the electronic device implements the method according to any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by a processor so that a computer implements the method according to any one of claims 1 to 5.

Images