A data exchange method, apparatus, device, program product, and storage medium

Abstract

The application discloses a data exchange method and device, equipment, program product and storage medium, and relates to the technical field of big data. The method comprises the following steps: receiving each shared data sent by a standard service platform at a current time; determining a target processing time of each shared data according to data exchange requirement information of the standard service platform, historical shared data state information of a personalized service platform, the current time and a preset time length; performing data type identification on the current shared data at the target processing time corresponding to the current shared data, so as to obtain the data type of the current shared data; performing data processing on the current shared data according to the data type of the current shared data, so as to obtain target data corresponding to the current shared data; and transmitting the target data corresponding to each shared data to the standard service platform. The application can reasonably allocate the computing resources of the personalized service platform and improve the efficiency of data exchange.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of big data, and particularly relate to a data exchange method, device, equipment, program product and storage medium BACKGROUND

[0002] In the background of digital government service, to meet the demand of government service data sharing, government service platforms at all levels can directly exchange and share data. For example, the national government service platform can send some basic data used to support personalized government services of each provincial government service platform to each provincial government service platform, and each provincial government service platform sends its business service data to the national government service platform, so that the national government service platform can aggregate, analyze and abnormally monitor the business service data of each provincial government service platform.

[0003] The current data exchange method between government service platforms only involves structured data such as database data, and cannot process unstructured data such as images. Moreover, the government service platforms mostly send shared data of each government service according to a fixed period or time, and the government service platforms receiving the shared data also process the shared data and return data according to a fixed time period. However, the service standards, ranges and data processing amounts of each government service platform are different, and this method is not flexible enough, which leads to uneven allocation of resources when the government service platforms process data, and causes the government service platforms to return data with a lag, or process some data that does not need to be returned in real time, thereby squeezing the computing resources of data that needs to be processed in real time. SUMMARY

[0004] Embodiments of the present application provide a data exchange method, device, equipment, program product and storage medium, which can flexibly adjust the time for each personalized service platform to process shared data, and reasonably allocate the computing resources of the personalized service platform, so that each personalized service platform can efficiently process structured shared data and unstructured shared data.

[0005] In a first aspect, embodiments of the present application provide a data exchange method, comprising:

[0006] receiving each shared data sent by a standard service platform at a current time;

[0007] determining a target processing time of each shared data according to the pre-determined data exchange demand information of the standard service platform, the pre-determined historical shared data state information of the personalized service platform, the current time and a preset time length;

[0008] For each of the shared data, data type identification is performed on the current shared data at a target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data;

[0009] According to the data type of the current shared data, data processing is performed on the current shared data, to obtain target data corresponding to the current shared data;

[0010] The target data corresponding to each of the shared data is transmitted to the standard service platform.

[0011] In a second aspect, an embodiment of the present application further provides a data exchange device, and the device comprises:

[0012] A data receiving module is configured to receive each shared data sent by a standard service platform at a current time;

[0013] A time determining module is configured to determine a target processing time of each of the shared data according to pre-determined data exchange requirement information of the standard service platform, pre-determined historical shared data state information of the individualized service platform, a current time and a preset time length;

[0014] A type determining module is configured to perform data type identification on a current shared data at a target processing time corresponding to the current shared data, to obtain a data type of the current shared data, for each of the shared data; wherein the data type is structured data or unstructured data;

[0015] A data processing module is configured to perform data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data;

[0016] A data transmission module is configured to transmit the target data corresponding to each of the shared data to the standard service platform.

[0017] In a third aspect, an embodiment of the present application further provides an electronic device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the processor implements the data exchange method according to any of the embodiments of the present application when executing the program.

[0018] In a fourth aspect, an embodiment of the present application further provides a computer readable storage medium, which stores a computer program, and the program is executable on a processor to implement the data exchange method according to any of the embodiments of the present application.

[0019] In a fifth aspect, an embodiment of the present application further provides a computer program product comprising a computer program which, when executed by a processor, implements the data exchange method according to any of the embodiments of the present application.

[0020] In the embodiment of the present application, the target exchange time of each shared data is dynamically determined according to the specific service attribute and the historical exchange time of the shared data, so that the personalized service platform can preferentially process the shared data that needs to be processed immediately, reasonably allocate the computing resources of the personalized service platform, and avoid the situation that the computing resources of the shared data that needs to be processed immediately are squeezed due to the immediate processing of the shared data that does not need to be processed immediately. Through data type identification, the personalized service platform can adopt different data processing methods to process different types of shared data in a timely and accurate manner, and update the service support data of the personalized service platform according to the processed shared data, so as to provide more reasonable and accurate service for users in the future, and facilitate the standard service platform to perform data aggregation, statistics and auditing according to the target data, thereby improving the efficiency of data exchange. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0022] Figure 1 A flowchart of a data exchange method provided by an embodiment of the present application;

[0023] Figure 2 A flowchart of determining the target data corresponding to the structured data provided by an embodiment of the present application;

[0024] Figure 3 A flowchart of determining the target data corresponding to the unstructured data provided by an embodiment of the present application;

[0025] Figure 4 A structural schematic diagram of a data exchange device provided by an embodiment of the present application;

[0026] Figure 5 A structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0027] The application will be described in further detail below with reference to the drawings and embodiments. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not to be used to limit the application. In addition, it should be noted that only the parts related to the application are shown in the drawings for ease of description.

[0028] It should be noted that similar reference numerals and letters refer to like items in the following drawings, and thus, once an item is defined in one drawing, it is not necessary to further define and explain it in subsequent drawings. Meanwhile, in the description of the application, the terms "first", "second", and the like are merely used to distinguish description, and cannot be understood as indicating or implying relative importance. The acquisition, storage, use, processing, and the like of data in the technical solution of the application comply with relevant provisions of national laws and regulations. It should be noted that in the embodiments of the application, some industry existing solutions, components, models, and the like may be mentioned, which should be considered as exemplary, and the purpose is only to illustrate the feasibility of the implementation of the technical solution of the application, but does not mean that the applicant has or will necessarily use the related content of the solution.

[0029] Figure 1 A flowchart of a data exchange method provided by an embodiment of the application is shown in FIG. 1. The method of the embodiment of the application can flexibly adjust the time for each personalized service platform to process shared data, and reasonably allocate the computing resources of the personalized service platform, so that each personalized service platform can efficiently process structured shared data and unstructured shared data. The method can be executed by a data exchange device provided by an embodiment of the application, which can be realized in the form of software and / or hardware. The following embodiments will be described by taking an example of the device being integrated in an electronic device, which can be a computer device or a server, and the like. Referring to FIG. 1, the method can specifically include the following steps: Figure 1

[0030] Step 101: receiving shared data sent by a standard service platform at a current time.

[0031] The standard service platform is an integrated business service platform. The standard service platform can receive service data of each personalized service platform, and perform data processing thereon, including data aggregation, data auditing, data processing, and data sharing and data exchange, and the like. The shared data is data obtained by the standard service platform after performing data processing on the standard service data and the received service data of each personalized service platform, and can be transmitted to each personalized service platform. The shared data is used to support and constrain the personalized service provided by each personalized service platform.

[0032] ​In an alternative embodiment, when the personalized service platform needs to obtain shared data from the standard service platform, the personalized service platform can send a data request instruction to the standard service platform. After receiving the data request instruction, the standard service platform determines the shared data requested by the personalized service platform according to the data request instruction, and sends the shared data to the personalized service platform. Alternatively, the standard service platform generates new shared data during operation, and needs to send the shared data to each personalized service platform in a timely manner, so that each personalized service platform updates the service data of its own platform in a timely manner to provide accurate and error-free personalized services for users. After the standard service platform sends the shared data to the personalized service platform, the personalized service platform can receive the shared data sent by the standard service platform at the current time in real time.

[0033] For example, the standard service platform records the service qualification information of a certain enterprise, including serviceable business and qualification validity period information. After the validity period of the enterprise has passed, the enterprise timely handles the business of updating the validity period in the standard service platform. After the standard service platform updates the service qualification information of the enterprise, it generates shared data according to the updated service qualification information of the enterprise and sends the shared data to the personalized service platform, so that the personalized service platform updates the service qualification information of the enterprise in a timely manner, avoiding the situation that the user handles the business related to the enterprise in the personalized service platform, and the business cannot be handled due to the lag of the information of the personalized service platform.

[0034] Step 102, determining the target processing time of each shared data according to the predetermined data exchange requirement information of the standard service platform, the predetermined platform information of the personalized service platform, the historical shared data state information, the current time and the preset time length.

[0035] The data exchange requirement information includes the business attribute field corresponding to each shared data and the exchange frequency range, and the business attribute field is used to mark the business attribute to which each shared data belongs. The business attribute includes real-time update business, batch processing business, periodic update business and event-driven update business. The shared data belonging to the real-time update business needs to be exchanged in real time, the shared data belonging to the periodic update business needs to be exchanged according to the predetermined period, and the shared data belonging to the event-driven update business needs to be exchanged after the corresponding event occurs. The exchange frequency range of the shared data of different business attributes is different. For example, the matter basic directory data, electronic certificate directory data and basic matter handling data in the matter handling of the personalized service platform all belong to the data of the periodic update business, the exchange frequency range of the matter basic directory is 0.5-1 hour; the exchange frequency range of the electronic certificate directory data is 0.5-24 hours; and the exchange frequency range of the basic matter handling data is 0.5-1 day.

[0036] The personalized service platform records the time when the data exchange of the shared data is completed, i.e., the last exchange time of the shared data, in the historical shared data state information after each execution of the data exchange of the shared data. The platform information includes basic information of the personalized service platform, such as geographical position, computing power demand, network connection information, storage capacity, computing capacity, and hardware resources. The preset time length is determined by the personalized service platform according to its platform information, and the preset time length corresponding to different personalized service platforms can be different. The preset time length is used to measure whether the personalized service platform needs to immediately process the shared data. In this scheme, the target processing time of each shared data is determined according to the pre-determined data exchange demand information of the standard service platform, the pre-determined platform information of the personalized service platform, the historical shared data state information, the current time, and the preset time length, including the following steps A1-A3:

[0037] Step A1: Identify the business attribute field of each shared data, and obtain the business attribute data of each shared data according to the business attribute field of each shared data.

[0038] The business attribute data is the data corresponding to the business attribute field in the shared data. Specifically, the standard service platform obtains each shared data during operation, determines all business attribute fields existing in the shared data according to the pre-defined business attribute field corresponding to each business attribute and the data content of the shared data, and binds the business attribute field and the corresponding data content to generate a shared data including the business attribute field and the corresponding data content.

[0039] Step A2: For each shared data, the target exchange time of the current shared data is determined according to the exchange frequency range of the business attribute data of the current shared data, the platform information, the current time, and the last exchange time of the business attribute data of the current shared data.

[0040] The current time is the time when the personalized service platform receives each shared data. The last exchange time is the time when the personalized service platform sends the business attribute data of the same business attribute to the standard service platform to perform data exchange. The target exchange time is the time when the personalized service platform sends the personalized service data obtained from the business attribute data to the standard service platform after processing the business attribute data. The number of service personnel, the number of transaction items, and the transaction rights carried by different personalized service platforms are different and will change, so the last exchange time of the business attribute data of the shared data of different personalized service platforms is also different. The exchange frequency range corresponding to different business attribute shared data and the target exchange time of different business attribute shared data are also different.

[0041] In an alternative embodiment, after obtaining the service attribute data, the individualized service platform determines the exchange frequency range corresponding to the service attribute data of the current shared data from the pre-defined exchange frequency ranges corresponding to various service attribute fields, and determines the specific exchange frequency of the service attribute data according to the platform information and service information of the individualized service platform. Further, the target exchange time of the current shared data is determined according to the last exchange time of the service attribute data in the individualized service platform and the exchange frequency.

[0042] For example, the individualized service platform A is a large-scale platform, which processes a large amount of data and serves a large number of users. Assuming that the exchange frequency range of a service attribute data is 2-8 hours once. The last exchange time of the service attribute data of the individualized service platform A is 10 o'clock. Since the individualized service platform A can obtain a large amount of service data according to the service attribute data in a short time, the individualized service platform A needs to send the service data to the standard service platform as soon as possible to complete the data exchange. Further, according to the exchange frequency range, the specific exchange frequency of the service attribute data of the individualized service platform A is determined to be 2 hours once, and the target exchange time of the service attribute data is determined to be 12 o'clock according to the last exchange time of the service attribute data. The individualized service platform B is a small-scale platform, and its geographical location is relatively remote, so it processes a small amount of data. The last exchange time of the service attribute data of the individualized service platform B is 10 o'clock. Since the individualized service platform B generates less service data in a short time, it does not need to process the service attribute data immediately, but accumulates a certain amount of service data before exchanging data with the standard service platform. Further, according to the exchange frequency range and the service condition of the individualized service platform B, the specific exchange frequency of the service attribute data is determined to be 6 hours once, which is the best, i.e., the target exchange time of the service attribute data of the individualized service platform B is 16 o'clock.

[0043] The individualized service platform dynamically determines the target exchange time of each shared data according to the specific service attribute and the historical exchange time of the shared data, so that the individualized service platform can adjust the data processing priority according to the actual situation. By considering the last exchange time and the exchange frequency range of the corresponding service, the individualized service platform can more effectively plan its computing and network resources to ensure the efficient operation of the individualized service platform. In particular, for services that need to be updated immediately, the individualized service platform can quickly respond to data changes and update the data in time, reducing the occurrence of data delay and data lag.

[0044] Step A3: If the time length from the target exchange time of the current shared data to the current time is greater than the preset time length, the target processing time of the current shared data is determined according to the target exchange time of the current shared data; if the time length from the target exchange time of the current shared data to the current time is less than or equal to the preset time length, the real-time time is obtained, and the real-time time is determined as the target processing time of the current shared data.

[0045] Specifically, the preset time length is a time length determined by the individualized service platform according to its platform information, and the preset time lengths corresponding to different individualized service platforms can be different. If the target exchange time of the current shared data is greater than the preset time length, it means that the target exchange time is still a long time away from the current time, and the individualized service platform does not need to process the current shared data immediately, and can determine the time which is the preset time length away from the target exchange time as the target processing time. If the target exchange time of the current shared data is less than or equal to the preset time length, it means that the individualized service platform needs to process the current shared data immediately to ensure that the individualized service platform can successfully exchange data with the standard service platform at the target exchange time.

[0046] For example, the individualized service platform A receives 2 items of shared data, which are shared data 1 and shared data 2. The exchange frequency range of shared data 1 is 1 hour-2 hours exchange once. The last exchange time of shared data 1 is 10 o'clock. The last exchange time of shared data 1 is 8 o'clock. The preset time length corresponding to the individualized service platform A is 4 hours. The time (current time) when the individualized service platform A receives each shared data is 11 o'clock. The individualized service platform A determines that it is best to exchange data with the standard service platform every 2 hours according to its platform information and the exchange frequency range of shared data 1, and determines that the target exchange time of shared data 1 is 12 o'clock. It can be further determined that the time length from the target exchange time of shared data 1 to the current time is less than the preset time length, and the current time (real-time time) is determined as the target processing time of shared data 1.

[0047] The exchange frequency range of shared data 2 is 5 hours-15 hours exchange once, the last exchange time of shared data 2 is 8 o'clock, and the current time is 11 o'clock. The individualized service platform A determines that it is best to exchange data with the standard service platform every 10 hours according to its platform information and the exchange frequency range of shared data 2, and determines that the target exchange time of shared data 2 is 18 o'clock. It can be further determined that the time length from the target exchange time of shared data 1 to the current time is greater than the preset time length, and the time (14 o'clock) which is the preset time length (4 hours) away from the target exchange time (18 o'clock) is determined as the target processing time of shared data 2.

[0048] In actual application, the standard service platform can send multiple pieces of shared data to the personalized service platform at the same time, and the exchange time of each piece of shared data is different. The target processing time of each piece of shared data is determined according to the exchange time of each piece of shared data, the service condition and platform information of the personalized service platform, and the like. In this way, the personalized service platform can preferentially process the shared data that needs to be processed immediately, reasonably allocate the computing resources of the personalized service platform, and avoid the situation that the personalized service platform processes the shared data that does not need to be processed immediately, thereby squeezing the computing resources of the shared data that needs to be processed immediately.

[0049] After the target processing time of each piece of shared data is determined, if the target processing time of the shared data is a real-time time, the shared data is processed immediately. If the target processing time of the shared data is not a real-time time, the shared data can be stored and processed at the target processing time. In the embodiment of the present application, optionally, if the target processing time of the current shared data is not a real-time time, the current shared data and the target processing time are transmitted to the edge computing node, so that the edge computing node performs data preprocessing on the current shared data, and returns the preprocessed current shared data at the target processing time.

[0050] The edge computing node is a physical machine or a virtual machine pre-deployed according to platform information, and the platform information includes the geographic location, the computing power requirement, the network connection information and the storage capacity of the personalized service platform. According to the platform information of the personalized service platform, it can be determined whether the edge computing node needs to be deployed. If the data volume that needs to be processed by the personalized service platform is large, the number of service users carried is large, the data computing pressure is large, and the network environment is stable, the edge computing node can be deployed in the vicinity of the geographic location where the personalized service platform is located. The personalized service platform can store the shared data that does not need to be processed immediately to the edge computing node, and use the edge computing node to pre-process the shared data, thereby reducing the computing pressure of the personalized service platform.

[0051] In an optional embodiment, after determining that the target processing time of the current shared data is not a real-time time, the current shared data is sent to the edge computing node using a pre-configured efficient data transmission protocol. If the current shared data is structured data, after receiving the current shared data, the edge computing node can pre-process the current shared data, such as checking the data format of the current shared data, correcting obvious error inputs in the current shared data, or eliminating duplicate data, etc. If the current shared data is unstructured data such as images, the edge computing node can perform format conversion and resolution adjustment on the received image according to the pre-configured image format requirements. After obtaining the pre-processed current shared data, the edge computing node can return the pre-processed current shared data to the individual service platform at the target processing time of the current shared data, so that the individual service platform can process the current shared data at the target processing time corresponding to the current shared data.

[0052] Storing the shared data that does not need to be processed immediately to the edge computing node enables the individual service platform to more effectively utilize its core computing resources to process high-priority or more real-time tasks. This approach can significantly improve the efficiency and response speed of the individual service platform in the case of large data volume and variable user service requirements. Pre-processing data using edge computing nodes that are particularly close to the individual service platform in terms of geographical location can reduce data transmission time and delay. At the same time, the edge computing node can pre-process the shared data to ensure that the data received by the individual service platform is clean and consistent. This improves the accuracy of data processing and reduces errors and exceptions in subsequent processing, thereby improving the reliability and stability of the overall service.

[0053] Step 103, for each shared data, performing data type identification on the current shared data at the target processing time corresponding to the current shared data, to obtain the data type of the current shared data.

[0054] In an optional embodiment, the individual service platform first performs preliminary inspection on each shared data when processing the shared data, to determine whether the data is complete and whether there are obvious errors or format problems. After inspection, the data type of each shared data is identified according to the data type tag, storage format or file suffix name, etc. of each shared data, to determine whether the data is structured data or unstructured data.

[0055] By identifying the data type of the shared data, it can be ensured that the subsequent data processing process can process the data according to the correct data type.

[0056] In step 104, data processing is performed on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data.

[0057] The target data is data to be transmitted by the personalized service platform to the standard service platform, and is used for data exchange. Specifically, the shared data sent by the standard service platform to the personalized service platform is used to support and constrain the personalized services provided by each personalized service platform. The main businesses and service focuses of each personalized service platform are different, and thus the shared data required by each personalized service platform is also different. After the standard service platform sends each shared data to each personalized service platform, each personalized service platform can filter the shared data according to platform information and personalized service requirements, to filter out the shared data required by the personalized service platform. After filtering the shared data, the business support table in the personalized service platform corresponding to the shared data is updated according to the filtered shared data, and the updated business support table is used to provide personalized services for users.

[0058] In an optional implementation, if the data type of the shared data is structured data, such as database table data, the personalized service platform can parse the shared data to obtain all identification fields in the shared data. From all the identification fields in the shared data, the identification field corresponding to the shared data required by the personalized service platform is filtered out, and the data in the business support table in the personalized service platform corresponding to the identification field is updated according to the specific data corresponding to the identification field. The business support table stores data used to constrain and support the personalized service platform to provide personalized services.

[0059] If the data type of the shared data is unstructured data, the personalized service platform can filter out the image coding or image identification field corresponding to the shared data required by the personalized service platform according to the image coding and image field information of each image in the shared data, and perform image processing on the image corresponding to the image identification field or the image coding, including image recognition, image classification, image cropping, image blurring and other operations. After obtaining the image corresponding to the processed current shared data, the business service image library of the personalized service platform is updated according to the processed image.

[0060] Further, the personalized service platform stores the business service data generated in the process of providing personalized services for users to each business service table or business service image library. After obtaining the updated business support table, the personalized service platform filters or updates the data in the corresponding business service table based on the updated business support table, to obtain target business data required to be sent to the standard service platform, and performs format conversion on the target business data according to the data format requirement of the standard service platform, to obtain target data corresponding to the shared data.

[0061] For example, all enterprises can conduct business in the individualized service platforms, but the individualized service platforms mainly focus on different enterprises. There are five enterprises A, B, C, D and E, in which the individualized service platform 1 mainly focuses on the enterprises A and D, and the individualized service platform 2 mainly focuses on the enterprises B, C and E. The business service table of the enterprises A and D of the individualized service platform 1 is marked as internal service, and the business service table of the enterprises B, C and E is marked as external service. The business service table of the enterprises B, C and E of the individualized service platform 2 is marked as internal service, and the business service table of the enterprises A and D is marked as external service. The standard service platform adjusts the enterprises focused by the individualized service platforms, and after the adjustment, the individualized service platform 1 mainly focuses on the enterprises A and B, and the individualized service platform 2 mainly focuses on the enterprises C, D and E. The standard service platform generates the shared data according to the adjusted enterprise focus information of the individualized service platforms, and sends the shared data to the individualized service platforms. When the individualized service platforms receive the shared data and determine to process immediately, the individualized service platforms update the business service tables according to the shared data. The updated business service table is that the business service data of the enterprises A and B of the individualized service platform 1 is marked as internal service, and the business service data of the enterprises C, D and E is marked as external service. The business service data of the enterprises C, D and E of the individualized service platform 2 is marked as internal service, and the business service data of the enterprises A and B is marked as external service. Further, the individualized service platform 1 and the individualized service platform 2 perform format conversion on the updated business service data to obtain target data, and send the target data to the standard service platform, so that the standard service platform performs data summarization, statistics and auditing according to the target data.

[0062] In step 105, the target data corresponding to the shared data is transmitted to the standard service platform.

[0063] Specifically, after obtaining the target data, the individualized service platforms can perform data encryption and data compression on the target data to ensure the transmission security and transmission efficiency of the target data. According to the pre-set network transmission protocol, the processed target data is transmitted to the standard service platform. After receiving the target data, the standard service platform can perform integrity and consistency check on the target data to ensure that the target data is not tampered or damaged in the transmission process.

[0064] The technical scheme of the embodiment receives each shared data sent by the standard service platform at the current time; determines a target processing time of each shared data according to the pre-determined data exchange requirement information of the standard service platform, the pre-determined historical shared data state information of the individualized service platform, the current time and a preset time length; for each shared data, performs data type identification on the current shared data at the target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data; performs data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data; and transmits the target data corresponding to each shared data to the standard service platform. The technical scheme of the embodiment dynamically determines the target exchange time of each shared data through the specific business attribute and the historical exchange time of the shared data, so that the individualized service platform can preferentially process shared data that needs to be processed immediately, reasonably allocates the computing resources of the individualized service platform, and avoids the situation that the computing resources of the individualized service platform are squeezed by the shared data that needs to be processed immediately due to the processing of the shared data that does not need to be processed immediately. Through data type identification, the individualized service platform can timely and accurately process shared data of different types by using different data processing methods, and update the business support data of the individualized service platform according to the processed shared data, so as to provide more reasonable and accurate business services for users in the future, and also facilitate the standard service platform to perform data aggregation, statistics and auditing according to the target data, thereby improving the efficiency of data exchange.

[0065] Figure 2 The flowchart for determining the target data corresponding to the structured data is provided for the embodiment of the application, and the embodiment is refined on the basis of the above-mentioned embodiment. The specific method can be as shown in Figure 2 The method can include the following steps:

[0066] In step 201, based on the pre-determined individualized service requirement, each identification field of the current shared data is extracted, and based on each item of data corresponding to each identification field and each business support table of the pre-determined individualized service platform, a current business support table corresponding to each identification field of the current shared data is determined.

[0067] The individualized service requirement is pre-determined according to the platform information of the individualized service platform, and includes business requirement information, service object requirement information and business support data requirement information of the individualized service platform. The individualized service requirement of different individualized service platforms is different, and therefore each item of data in the shared data required by different individualized service platforms is also different. The identification field is a field for uniquely identifying each record (each item of data) in the shared data.

[0068] In an alternative embodiment, after obtaining the shared data, the individualized service platform extracts the identification fields corresponding to the data required by the individualized service platform according to the business support data requirement information, etc. From all the business support tables of the individualized service platform, the current business support tables corresponding to the identification fields are screened out.

[0069] Step 202: updating the current business support tables according to the values of the data.

[0070] The values of the data are the specific data contents of the data in the current shared data. Specifically, the shared data are used to support and constrain the individualized services provided by the individualized service platform, and the individualized service platform provides the individualized services according to the business support tables. Therefore, after determining the current business support tables, the corresponding contents in the current business support tables are updated according to the values of the data in the shared data, so that the individualized service platform can accurately and quickly provide the individualized services according to the business support tables.

[0071] Step 203: generating the current business service data based on the updated business support tables and the pre-determined historical business service data.

[0072] The historical business service data are the data generated by the individualized service platform in the process of providing the individualized services in the historical period. The historical period can be the period from the last exchange time corresponding to the business service data to the current time. When the data in the business support tables changes, some data tags or data recording methods in the historical business service data will also change accordingly. Therefore, after obtaining the updated business support tables, the historical business service data are adjusted and updated according to the updated business support tables, and the updated current business service data are obtained.

[0073] Step 204: storing the current business service data into the pre-determined business service tables according to the generation time and the data contents of the current business service data.

[0074] The business service tables are the data tables pre-established by the individualized service platform according to the platform information and in a certain data format. The business service tables record the business service data in each time period. The generation time of the current business service data is the time of modifying the historical business service data to obtain the current business service data.

[0075] Specifically, the historical business service tables store the historical service data. After adjusting and updating the historical business service data, some data in the historical business service data have changed, and the data stored in the historical business service tables are no longer representative. Therefore, after obtaining the current business service data, the data contents of the current business service data are stored into the corresponding business service tables according to the generation time of the current business service data.

[0076] Step 205, for each business service table corresponding to the current shared data, determining a target conversion data table corresponding to the current business service table from all business data of the current business service table and from the pre-determined standard service data tables corresponding to the current shared data.

[0077] The standard service data table is used to store standard service data of the standard service platform. The target conversion data table is a table in the standard service data table used to store the current business data of the individualized service platform. Specifically, the data storage format of the standard service platform is different from the data storage format of the individualized service platform, and the data storage formats of the individualized service platforms are also different from each other. In order to reduce the pressure of the standard service platform in processing data sent by the individualized service platforms, the individualized service platforms can perform data format conversion on the data to be sent to the standard service platform, and convert the data into the data storage format of the standard service platform.

[0078] In an optional embodiment, after determining the business service tables to be sent to the standard service platform, the individualized service platform determines the standard service table corresponding to the business service table according to the data in the business service table, i.e., the target conversion data table of the business service table.

[0079] Step 206, determining the mapping relationship between all business data and conversion data according to all business data and the conversion data in the target conversion data table.

[0080] The conversion data is the data in the target conversion data table, and the mapping relationship is used to ensure that the business data of the individualized service platform is correctly converted from the original format to the format of the target conversion data. In an optional embodiment, the individualized service platform can compare the business data and the conversion data in the field, identify the expression difference of the same data in the standard service platform and the individualized service platform. For example, “enterprise number” may be identified as “ID_Number” in the individualized service platform, and as “Identity_Card_No” in the standard service platform. The individualized service platform can establish the mapping relationship between the business data and the conversion data according to the expression difference of the same data, and establish a mapping rule according to the mapping relationship, so as to facilitate subsequent format conversion of the business data according to the mapping relationship.

[0081] Step 207, performing batch data conversion on all business data according to the mapping relationship to obtain the target data corresponding to the current business service table.

[0082] Batch data conversion refers to processing and converting multiple data items simultaneously rather than individually. Batch data conversion can improve conversion efficiency and ensure data consistency and accuracy. In this scheme, optionally, all business data are batch data converted according to the mapping relationship to obtain target data corresponding to the current business service table, including the following steps B1-B3:

[0083] Step B1: Determine batch conversion information according to the data volume of all business data.

[0084] The batch conversion information includes the conversion batch number, the conversion batch number, and the number of data items in each batch. The conversion information includes at least the task name, the conversion batch number, the creation time, the execution time, the execution state, the execution number, and the exception record. The conversion batch number is the number of batches included in the entire data conversion task. According to the total amount of business data, the processing capacity of a single batch, and the computing capacity of the individualized service platform, etc., the conversion batch number of the batch conversion information can be determined. For example, if there are 1 million data items of business data to be converted, and each batch can process 50,000 data items, then a total of 20 batches are required.

[0085] The conversion batch number is the unique identifier of each batch in the processing process. The batch number can be a simple serial number, such as 001, or a combination of date and serial number, such as 20231201_001. The batch number helps to record and track the conversion process and results of each batch, facilitating subsequent management and review. The number of data items in each batch determines the size of the data processed by each batch. Reasonable batch size can not only ensure the load balancing of the individualized service platform, but also avoid processing failure caused by excessive data volume in a single batch. For example, according to historical data conversion conditions and platform information, 10,000 data items can be processed in each batch.

[0086] Through reasonable batch division, the individualized service platform can dynamically adjust the size of each batch according to its computing capacity and task load, thereby optimizing the use of system resources. This method helps to balance the load of the individualized service platform and avoid overload or delay caused by processing large data batches.

[0087] Step B2: According to the batch number, data conversion is performed on the business data according to the mapping relationship, and conversion information of each batch is obtained.

[0088] The conversion information at least includes a task name, a conversion batch number, a creation time, an execution time, an execution state, an execution frequency, and an exception record. In an optional embodiment, after determining the mapping relationship between the business data and the conversion data, the data conversion tool can be used to convert the business data. In the data conversion process, in order to facilitate the management and tracking of the data conversion task, the personalized service platform generates a corresponding task name and batch number each time the conversion is performed. The creation time, execution time, execution state, execution frequency, and exception record of the data conversion task are recorded.

[0089] By recording the detailed conversion information generated in the data batch conversion process, the traceability and manageability of the data conversion task are improved, and the reliability of the data conversion process is also improved.

[0090] Step B3: For each batch, if the execution state of the current batch is execution success, the converted data of the current batch is determined as the target data. If the execution state of the current batch is execution failure, the data conversion of the current batch is performed again at a preset time point, and the execution failure frequency of the current batch is recorded; when the execution failure frequency is greater than a preset frequency, an exception report is generated according to the conversion information of the current batch, and the exception report is displayed to the staff.

[0091] Specifically, if the execution state of the current batch is "execution success", it indicates that the data conversion of the batch does not have errors, and the converted data of the current batch can be determined as the target data. If the execution state of the current batch is "execution failure", it indicates that the business data of the batch has not been successfully converted into the format of the conversion data. For the batch with execution failure, the personalized service platform can retry at a preset time point. The preset time point can be set in advance according to the batch conversion information and the conversion information of each batch. At the same time, for each batch with execution failure, the personalized service platform records the execution failure frequency of the current batch after each execution failure.

[0092] When the execution failure frequency of a batch exceeds a preset frequency, it indicates that a problem in the conversion process of the batch cannot be automatically repaired by the personalized service platform, and the personalized service platform can generate a detailed exception report according to the conversion information of the current batch. The exception report includes error description, occurrence time, possible solution, failure frequency, and other key information. The exception report is displayed to the relevant staff in a timely manner, so that the staff can discover the problem in a timely manner and take measures, so as to obtain the target data smoothly.

[0093] Through batch data conversion, the personalized service platform can process and convert multiple data items at the same time instead of processing them individually one by one. This way can improve the efficiency of data conversion, especially when dealing with a large amount of business data, batch processing reduces the total time of data conversion, so that the personalized service platform can respond to user demand faster and provide updated business services.

[0094] The technical scheme of the embodiment extracts each identification field of the current shared data based on the pre-determined personalized service demand, determines the current business support table corresponding to each identification field of the current shared data according to each item of data corresponding to the identification field and each pre-determined business support table of the personalized service platform, updates each current business support table according to the value of each item of data, generates current business service data based on the updated business support table and pre-determined historical business service data, stores the current business service data into each pre-determined business service table according to the generation time and data content of the current business service data, determines the target conversion data table corresponding to the current business data table from each pre-determined standard service data table corresponding to the current shared data according to all business data of the current business service table for each business service table corresponding to the current shared data, determines the mapping relationship between all business data and conversion data according to all business data and conversion data in the target conversion data table, and performs batch data conversion on all business data according to the mapping relationship to obtain target data corresponding to the current business service table. The technical scheme of the embodiment can automatically extract each identification field of the shared data according to the personalized service demand, update the business support data and business service data of the personalized service platform, and improve the speed and accuracy of shared data processing. Batch data conversion of business service data can quickly convert business service data into target data, improve the utilization efficiency of computing resources of the personalized service platform, and further improve the efficiency of data exchange.

[0095] Figure 3 The flowchart for determining the target data corresponding to the unstructured data provided by the embodiment of the application is based on the above-mentioned embodiment. The specific method can be as shown in Figure 3 The method can include the following steps:

[0096] Step 301, for image data in each unstructured data, performing structural analysis on the image coding of the current image data according to the pre-determined coding rule to obtain the target business service item corresponding to the current image coding.

[0097] The encoding rule is defined by the standard service platform, and the encoding rule specifies the meaning of each character in the image encoding. Specifically, after the personalized service platform receives each shared data including unstructured data, the personalized service platform identifies each part in the image encoding according to the encoding rule, obtains the part representing the business service matter, and determines the target business service matter corresponding to the current image.

[0098] For example, the image encoding of an image is a 3-digit number string 123, and the encoding rule specifies that the first digit represents the image source, the second digit represents the service type, and the third digit represents the service matter. Then it can be determined that the image is from the personalized service platform 1, the service type is type 2 defined in the personalized service platform 1, and the service matter is matter 3 in the service type 2. According to the image encoding, it can be determined that the target business service matter corresponding to the image is matter 3.

[0099] Step 302, feature point detection is performed on the current image to obtain feature contour information of the current image.

[0100] The feature contour information of the current image includes the contours of each feature in the image and their positions in the image. In an optional embodiment, after obtaining the current image, the personalized service platform can convert the current image to obtain a binary image corresponding to the current image. After obtaining the binary image, the cv.findContours function in the cross-platform computer vision library can be used to retrieve contour information from the binary image. After obtaining the contour information, the contours of each feature can be drawn on the current image by the cv.drawContours function.

[0101] Step 303, determining a protection area of the current image based on the feature contour information and the target business service matter, and cropping the current image based on the protection area and the specified size to obtain a cropped current image.

[0102] The image requirement information includes the requirements of the personalized service platform for the image. The image requirement information includes permission information and data format information, and the data format information includes a specified size and a specified pixel. The protection area is used to ensure that important image features or information are not damaged or lost when the current image is cropped or other operations are performed. Image cropping is used to remove unnecessary background or edge parts of the image, focus on key information, and improve processing efficiency and accuracy.

[0103] After the feature contour information of the current image is obtained, the feature information of the key feature is determined according to the target business service matter corresponding to the current image, and the protection area is determined according to the feature information of the key feature. For example, the target business service matter is an enterprise qualification handling matter, and the protection area is the internal area of the enterprise information feature contour in the image. The overall size of the image also affects the setting of the protection area. For example, for a small size image, the protection area may need to be set relatively small to avoid occupying too much space. In an optional implementation, the coordinates of the clipping, the protection area and the specified size can be set in the automatic clipping tool in the image processing software library, and the automatic clipping tool is used to perform image clipping on the current image to obtain the clipped current image.

[0104] By reasonably setting the protection area and performing accurate image clipping, the key information in the image can be effectively retained, providing a reliable basis for further image analysis and processing.

[0105] Step 304, determining whether the target hidden item exists in the current image according to the permission information.

[0106] The image requirement information is the requirement of the individualized service platform for the image. The image requirement information includes permission information and data format information, and the data format information includes specified size and specified pixel. The permission information includes the use permission and display permission of the image by the individualized service platform. The target hidden item is the data in the current image that needs to be hidden in the individualized service platform. For example, the standard service platform sends a traffic condition map of a road section to the individualized service platform, and the map includes a license plate number of a private vehicle. The individualized service platform cannot display the license plate number. After obtaining the image, the individualized service platform determines that the business service matter corresponding to the image is "traffic condition" according to the image coding, and the corresponding target hidden item includes "license plate number". The individualized service platform can determine the license plate number contour according to the feature contour information of the image, and perform Gaussian blur processing on the license plate number feature.

[0107] Step 305, when the target hidden item exists in the current image, the feature contour of the target hidden item in the current image is determined according to the feature contour information, and the clipped current image and the feature contour of the target hidden item are input into a pre-defined Gaussian blur function to obtain a blurred image of the clipped current image.

[0108] ​The parameters of the Gaussian blur function are determined according to the image requirement information, and the parameters of the Gaussian blur function include a kernel size. The Gaussian blur function realizes the blur effect by performing a convolution operation on the image and the Gaussian function. The Gaussian blur function determines the weight of a pixel point by using a normal distribution, and the closer the pixel is to the center point, the greater the weight. The cropped image and the feature contour of the target hidden item are input into the Gaussian blur function, the image is blurred according to the set parameters, and the blur degree is determined by the kernel size and the standard deviation.

[0109] The Gaussian blur is used to blur the target hidden item of the current image, which can effectively reduce random noise in the image and improve the efficiency of image blurring. Some information that cannot be publicly displayed is effectively hidden or protected, while sufficient image details are retained for other analysis.

[0110] In step 306, the pixels of the blurred image are obtained, the difference between the pixels of the blurred image and the specified pixels is calculated, and the pixels of the blurred image are compressed or restored based on the difference, to obtain the service image corresponding to the current image.

[0111] The image requirement information includes permission information and data format information, and the data format information includes a specified size and a specified pixel. The service image is an image that can be stored and used by the personalized service platform. After obtaining the blurred image, the pixels of the blurred image are identified to obtain the pixels of the blurred image. By calculating the difference between the pixels of the blurred image and the specified pixels, it can be determined whether the pixels of the blurred image meet the specified requirements. If the pixels of the blurred image are less than the specified pixels, and the absolute value of the difference between the pixels of the blurred image and the specified pixels is greater than a preset difference value, it indicates that the pixels of the blurred image are too low, and the pixels of the blurred image can be increased by using a pixel restoration technology to obtain the service image corresponding to the current image. If the pixels of the blurred image are greater than the specified pixels, and the absolute value of the difference between the pixels of the blurred image and the specified pixels is greater than a preset difference value, it indicates that the pixels of the blurred image are too high, which will occupy the memory resources of the personalized service platform, and the pixels of the blurred image can be reduced by using a pixel compression technology to obtain the service image corresponding to the current image.

[0112] In step 307, when the current pre-image does not have a target hidden item, the cropped current image is determined as the service image corresponding to the current image.

[0113] If the current image does not have a target hidden item, it indicates that the current image does not need to be blurred, and the cropped current image is determined as the service image corresponding to the current image.

[0114] In step 308, the pre-determined service image library is updated based on all the service images of the current shared data, and the target data corresponding to the current shared data is determined according to the updated service image library.

[0115] The business service image library is an image database used to support the personalized service platform to provide personalized services. After obtaining the business service image, the personalized service platform can update the business service image library according to the business service image corresponding to each shared data. After obtaining the updated business service image library, the images in the updated business service image library can be associated and sorted according to the image codes of the business service images, for example, the images belonging to the same business service matter are stored in a folder or an image set, and the folder is named with the name of the business service matter. According to the business service matter corresponding to each shared data, the target data is screened out from the business service database after association and sorting.

[0116] The technical scheme of the embodiment is that, for the image data in each unstructured data, the image code of the current image data is structurally parsed according to a predetermined coding rule to obtain a target business service matter corresponding to the current image code. Feature point detection is performed on the current image to obtain feature contour information of the current image. A protection area of the current image is determined based on the feature contour information and the target business service matter, and the current image is cropped based on the protection area and a specified size to obtain a cropped current image. It is determined whether the current image has a target hidden item according to the permission information, and when the current image has the target hidden item, the feature contour of the target hidden item of the current image is determined according to the feature contour information, and the cropped current image and the feature contour of the target hidden item are input into a predefined Gaussian blur function to obtain a blurred image of the cropped current image. The pixels of the blurred image are obtained, the difference between the pixels of the blurred image and a specified pixel is calculated, and the pixels of the blurred image are compressed or restored based on the difference to obtain a business service image corresponding to the current image. When the current image does not have the target hidden item, the cropped current image is determined as the business service image corresponding to the current image. The predetermined business service image library is updated based on all the business service images of the current shared data, and target data corresponding to the current shared data is determined according to the updated business service image library. The technical scheme of the embodiment is that, by using the predetermined coding rule and the Gaussian blur function, the image data in the shared data is structurally parsed and feature point detection is performed, so that the speed and accuracy of image processing are improved. By determining the protection area, the retention of key information and the elimination of unnecessary information are ensured, so that the personalized service platform can update the business service image library in a timely manner according to the processed image, and target data is determined according to the updated business service image library, thereby improving the efficiency of data exchange.

[0117] Figure 4 The structure diagram of the data exchange device provided by the embodiment of the application is provided, and the device is suitable for executing the data exchange method provided by the embodiment of the application. As shown in Figure 4As shown, the apparatus can specifically include:

[0118] The data receiving module 401 is configured to receive each shared data sent by the standard service platform at a current time.

[0119] The time determining module 402 is configured to determine a target processing time of each shared data according to the pre-determined data exchange requirement information of the standard service platform, the pre-determined historical shared data state information of the individualized service platform, the current time and a preset time length.

[0120] The type determining module 403 is configured to, for each shared data, perform data type identification on the current shared data at the target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data.

[0121] The data processing module 404 is configured to perform data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data.

[0122] The data transmission module 405 is configured to transmit the target data corresponding to each shared data to the standard service platform.

[0123] Optionally, the historical shared data state information includes a last exchange time of each shared data, and the data exchange requirement information includes a business attribute field and an exchange frequency range corresponding to each shared data; and the time determining module 402 is specifically configured to identify the business attribute field of each shared data, and obtain business attribute data of each shared data according to the business attribute field of each shared data.

[0124] For each shared data, a target exchange time of the current shared data is determined according to an exchange frequency range of the business attribute data of the current shared data, the platform information, the current time and the last exchange time of the business attribute data of the current shared data.

[0125] The target processing time of the current shared data is determined according to the target exchange time of the current shared data, the current time and the preset time length.

[0126] Optionally, the time determining module 402 is further configured to, if a time length from the target exchange time of the current shared data to the current time is greater than the preset time length, set the target exchange time of the current shared data as the target processing time of the current shared data.

[0127] If a time length from an exchange time point of the current shared data to the current time point is less than or equal to the preset time length, a real-time time point is acquired, and the real-time time point is determined as a target processing time point of the current shared data.

[0128] Optionally, the data processing module 404 is specifically configured to: if the data type of the current shared data is the structured data, extracting each identification field of the current shared data based on a pre-determined personalized service requirement, and determining a current business support table corresponding to each identification field of the current shared data according to each item of data corresponding to each identification field and each pre-determined business support table of the personalized service platform.

[0129] updating each current business support table according to the value of the item of data;

[0130] performing data processing on the current shared data based on the updated each current business support table, to obtain target data corresponding to the current shared data.

[0131] Optionally, the data processing module 404 is further configured to: generating current business service data based on the updated business support table and the pre-determined historical business service data;

[0132] storing the current business service data to each pre-determined current business service table according to a generation time and data content of the current business service data;

[0133] performing data conversion on each business service table corresponding to the current shared data based on the data exchange requirement, to obtain target data corresponding to the current shared data.

[0134] Optionally, the data processing module 404 is further configured to: for each business service table corresponding to the current shared data, determining a target conversion data table corresponding to the current business data table from each pre-determined standard service data table corresponding to the current shared data according to all business data of the current business service table;

[0135] determining a mapping relationship between the all business data and conversion data in the target conversion data table according to the all business data and the conversion data;

[0136] performing batch data conversion on the all business data according to the mapping relationship, to obtain target data corresponding to the current business service table.

[0137] Optionally, the data processing module 404 is further configured to: determining batch conversion information according to a data amount of the all business data, wherein the batch conversion information includes a conversion batch number, a conversion batch serial number and a number of data in each batch.

[0138] According to the mapping relationship, sequentially performing data conversion on the service data according to the batch number, and obtaining conversion information of each batch; the conversion information at least includes a task name, a conversion batch number, a creation time, an execution time, an execution state, an execution frequency, and an exception record;

[0139] For each batch, if the execution state of the current batch is execution success, the converted data of the current batch is determined as the target data.

[0140] Optionally, the data processing module 404 is further configured to: if the execution state of the current batch is execution failure, performing data conversion on the current batch again at a preset time point, and recording the execution failure frequency of the current batch;

[0141] When the execution failure frequency is greater than a preset frequency, generating an exception report according to the conversion information of the current batch, and displaying the exception report to a staff.

[0142] Optionally, the data processing module 404 is further configured to: if the data type of the current shared data is the unstructured data, for image data in each unstructured data, performing structural analysis on image coding of the current image data according to a predetermined coding rule, to obtain a target business service matter corresponding to the current image coding;

[0143] According to the image requirement information of the target business service matter, performing image conversion on a current image in the current image data, to obtain a business service image corresponding to the current image;

[0144] Based on all business service images of the current shared data, updating a predetermined business service image library, and determining target data corresponding to the current shared data according to the updated business service image library.

[0145] Optionally, the data processing module 404 is further configured to: performing feature point detection on the current image, to obtain feature contour information of the current image;

[0146] Based on the feature contour information and the target business service matter, determining a protection area of the current image, and based on the protection area and the predetermined size, performing cropping on the current image, to obtain a cropped current image;

[0147] According to the permission information, determining whether the current image has a target hidden item, and when the current image has the target hidden item, based on the feature contour information, performing image blur processing on the cropped current image, to obtain a business service image corresponding to the current image;

[0148] When the current pre-image does not have the target hidden item, the cropped current image is determined as a service image corresponding to the current image.

[0149] Optionally, the data processing module 404 is further configured to determine a feature contour of the target hidden item of the current image according to the feature contour information, input the cropped current image and the feature contour of the target hidden item into a predefined Gaussian blur function to obtain a blurred image of the cropped current image, wherein a parameter of the Gaussian blur function is determined according to the image requirement information, and the parameter of the Gaussian blur function includes a kernel size and a standard deviation.

[0150] Pixels of the blurred image are obtained, a difference between the pixels of the blurred image and the specified pixels is calculated, and pixel compression or pixel recovery is performed on the blurred image based on the difference to obtain a service image corresponding to the current image.

[0151] Optionally, the data processing module 404 is further configured to, for each shared data, if a target processing time of a current shared data is a target exchange time of the current shared data, transmit the current shared data and the target exchange time to an edge computing node, so that the edge computing node performs data preprocessing on the current shared data and returns the preprocessed current shared data at the target exchange time; the edge computing node is pre-deployed according to the platform information, and the platform information includes a geographic location, a computing power requirement, network connection information and a storage capacity of the individualized service platform.

[0152] The data exchange device provided by the embodiment of the present application can perform the data exchange method provided by any embodiment of the present application, and has the corresponding function modules and beneficial effects of the execution method. The contents not described in detail in the embodiment can be referred to the description in any method embodiment of the present application.

[0153] Figure 5 An electronic device structure schematic diagram is provided for the embodiment of the present application, referring to Figure 5 , Figure 5 The electronic device 12 shown is merely an example and should not impose any limitation on the function and use range of the embodiments of the present application. As shown in Figure 5 , the electronic device 12 is in the form of a general computing device. The components of the electronic device 12 can include but are not limited to one or more processors or processing units 16, system memory 28, and bus 18 connecting different system components including system memory 28 and processing unit 16.

[0154] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration bus, a processor or local bus using any of a variety of bus architectures. By way of example, these architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0155] Electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

[0156] System memory 28 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Electronic device 12 can further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (e.g., a "hard drive"). Figure 5 not shown, a magnetic hard disk drive for reading from and writing to non-removable, nonvolatile magnetic media (e.g., a "hard drive"). Although not specifically shown, such Figure 5 In alternative embodiments, a magnetic hard disk drive, a solid state drive (SSD) which is a non- volatile storage medium, a floppy disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non- volatile optical disk (e.g., a CD-ROM, DVD-ROM, etc.) can be provided. In such instances, each can be connected to bus 18 by one or more data media interfaces. The drives and their associated computer system storage media, described above and below, can also be connected to bus 18 by a storage interface.

[0157] Program / utility 40 having a set (at least one) of program modules 42 can be stored in memory 28 by way of example, such as an operating system, one or more application programs, other program modules, and program data, each of which implements at least a portion of a network environment as described herein. Program modules 42 generally carry out the functions and / or methodologies of embodiments of the present application.

[0158] The electronic device 12 can also communicate with one or more external devices 14 such as a keyboard, a pointing device, a display 24, etc.; other devices that enable a user to interact with the electronic device 12; and / or any devices (e.g., a networking module, a Figure 5 Other hardware and / or software modules that can be used in conjunction with the electronic device 12 but are not shown in FIG. 1 include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.

[0159] The processing unit 16 performs various function applications and data processing by running programs stored in the system memory 28, such as implementing a data exchange method provided by an embodiment of the present application: receiving each shared data sent by a standard service platform at a current time; determining a target processing time of each shared data according to predetermined data exchange requirement information of the standard service platform, predetermined platform information of a personalized service platform, historical shared data state information, the current time and a preset time length; for each shared data, performing data type identification on the current shared data at the target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data; performing data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data; and transmitting the target data corresponding to each shared data to the standard service platform.

[0160] The embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to realize a data exchange method provided by all the embodiments of the present application: receiving each shared data sent by a standard service platform at a current time; determining a target processing time of each shared data according to predetermined data exchange requirement information of the standard service platform, predetermined platform information of a personalized service platform, historical shared data state information, the current time and a preset time length; for each shared data, performing data type identification on the current shared data at the target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data; performing data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data; and transmitting the target data corresponding to each shared data to the standard service platform. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, but is not limited to, an electronic device, a device or a component of an electronic device, a magnetic device, an optical device, an electromagnetic device, an infrared device or a semiconductor device, or a combination of any of the above. More specific examples (non-exhaustive list) of the computer readable storage medium include: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution electronic device, device or component.

[0161] The computer readable signal medium can include a data signal propagated in a baseband or as a part of a carrier wave, in which a computer readable program code is borne. Such a propagated data signal can take multiple forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer readable signal medium can also be any computer readable medium other than the computer readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution electronic device, device or component.

[0162] The program code contained on the computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0163] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0164] It is noted that the foregoing examples have been provided merely for the purposes of illustration and are not intended to limit the application of the application. Other variations of the examples described herein will be apparent to those of ordinary skill in the art, and the application should not be limited to the specifically enumerated examples herein. Furthermore, while the application has been described herein in any particularity, it should be apparent that the application need not be limited to the particulars disclosed herein. Rather, the scope of the present application should be determined only by the appended claims and equivalents thereof.

[0165] The embodiments of the present application further provide a computer program product, comprising a computer program which, when executed by a processor, implements the data exchange method according to any of the embodiments of the present application.

[0166] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0167] Note that the above merely describes preferred embodiments of the present application and the principles of the technology applied. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, modifications and substitutions can be made thereto without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A data exchange method, characterized by, The method is applied to a personalized service platform, and comprises the following steps: receiving shared data sent by a standard service platform at a current time; determining a target processing time of each shared data according to predetermined data exchange requirement information of the standard service platform, predetermined platform information of the personalized service platform, historical shared data state information, the current time and a preset time length; the historical shared data state information comprises a last exchange time of each shared data, the data exchange requirement information comprises a business attribute field corresponding to each shared data and an exchange frequency range; the business attribute field is used for marking a business attribute to which each shared data belongs; and the platform information comprises a geographical position, a computing power requirement, network connection information, storage capacity, computing capacity and hardware resources of the personalized service platform; determining a target processing time of each shared data according to predetermined data exchange requirement information of the standard service platform, predetermined platform information of the personalized service platform, historical shared data state information, the current time and a preset time length, comprising: identifying a business attribute field of each shared data, and obtaining business attribute data of each shared data according to the business attribute field of each shared data; for each shared data, determining a target exchange time of the current shared data according to an exchange frequency range of the business attribute data of the current shared data, the platform information, the current time and a last exchange time of the business attribute data of the current shared data; if a time length from the target exchange time of the current shared data to the current time is greater than the preset time length, determining a target processing time of the current shared data according to the target exchange time of the current shared data; if a time length from the exchange time of the current shared data to the current time is less than or equal to the preset time length, obtaining a real-time time, and determining the real-time time as the target processing time of the current shared data; for each shared data, performing data type identification on the current shared data at a target processing time corresponding to the current shared data, to obtain a data type of the current shared data; wherein the data type is structured data or unstructured data; performing data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data; transmitting the target data corresponding to each shared data to the standard service platform.

2. The method of claim 1, wherein, performing data processing on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data, comprising: if the data type of the current shared data is the structured data, extracting each identification field of the current shared data based on predetermined personalized service requirements, and determining a current business support table corresponding to each identification field of the current shared data according to each item of data corresponding to each identification field and each business support table of the personalized service platform; updating each current business support table according to the values of the items of data; Data processing is performed on the current shared data based on the updated current business support tables, to obtain target data corresponding to the current shared data.

3. The method of claim 2, wherein, The data processing based on the updated current business support tables, to obtain target data corresponding to the current shared data, includes: generating current business service data based on the updated business support table and predetermined historical business service data; storing the current business service data into predetermined current business service tables according to the generation time and data content of the current business service data; data conversion is performed on each business service table corresponding to the current shared data based on the data exchange requirement, to obtain target data corresponding to the current shared data.

4. The method of claim 3, wherein, The data conversion performed on each business service table corresponding to the current shared data based on the data exchange requirement, to obtain target data corresponding to the current shared data, includes: for each business service table corresponding to the current shared data, determining a target conversion data table corresponding to the current business data table from predetermined standard service data tables corresponding to the current shared data according to all business data of the current business service table; determining a mapping relationship between the all business data and conversion data in the target conversion data table according to the all business data and the conversion data; batch data conversion is performed on the all business data according to the mapping relationship, to obtain target data corresponding to the current business service table.

5. The method of claim 4, wherein, The batch data conversion performed on the all business data according to the mapping relationship, to obtain target data corresponding to the current business service table, includes: determining batch conversion information according to the data amount of the all business data, wherein the batch conversion information includes conversion batch number, conversion batch number and number of data in each batch; data conversion is sequentially performed on the business data according to the mapping relationship according to the batch number, and conversion information of each batch is obtained; the conversion information at least includes task name, conversion batch number, creation time, execution time, execution state, execution number and exception record; for each batch, if the execution state of the current batch is execution success, the converted data of the current batch is determined as the target data.

6. The method of claim 5, wherein, The method further includes: if the execution state of the current batch is execution failure, data conversion is performed again on the current batch at a preset time point, and the number of execution failures of the current batch is recorded; when the number of execution failures is greater than a preset number, an exception report is generated according to the conversion information of the current batch, and the exception report is displayed to a staff.

7. The method of claim 1, wherein, The unstructured data includes image data, and the image data includes image encoding and image; The data processing performed on the current shared data according to the data type of the current shared data, to obtain target data corresponding to the current shared data, includes: If the data type of the current shared data is the unstructured data, for image data in each unstructured data, performing structural analysis on image coding of current image data according to a predetermined coding rule to obtain a target business service matter corresponding to the current image coding; performing image conversion on the current image in the current image data according to predetermined image requirement information of the target business service matter to obtain a business service image corresponding to the current image; updating a predetermined business service image library based on all business service images of the current shared data, and determining a target data corresponding to the current shared data according to the updated business service image library.

8. The method of claim 7, wherein, The image requirement information includes permission information and data format information, and the data format information includes a specified size and a specified pixel. The image conversion on the current image in the current image data according to the predetermined image requirement information of the target business service matter to obtain the business service image corresponding to the current image includes: performing feature point detection on the current image to obtain feature contour information of the current image; determining a protection area of the current image based on the feature contour information and the target business service matter, and performing cropping on the current image based on the protection area and the specified size to obtain a cropped current image; determining whether the current image has a target hidden item according to the permission information, and when the current image has the target hidden item, performing image blur processing on the cropped current image based on the feature contour information to obtain the business service image corresponding to the current image; when the current image does not have the target hidden item, determining the cropped current image as the business service image corresponding to the current image.

9. The method of claim 8, wherein, The image blur processing on the cropped current image based on the feature contour information to obtain the business service image corresponding to the current image includes: determining a feature contour of the target hidden item of the current image according to the feature contour information, and inputting the cropped current image and the feature contour of the target hidden item into a predefined Gaussian blur function to obtain a blurred image of the cropped current image; wherein parameters of the Gaussian blur function are determined according to the image requirement information, and the parameters of the Gaussian blur function include a kernel size and a standard deviation; obtaining pixels of the blurred image, calculating a difference value between the pixels of the blurred image and the specified pixel, and performing pixel compression or pixel restoration on the blurred image based on the difference value to obtain the business service image corresponding to the current image.

10. The method of claim 1, wherein, Before the data type identification of the current shared data at a target processing time corresponding to the current shared data, the method further includes: For each shared data, if the target processing time of the current shared data is not the real-time time, the current shared data and the target processing time are transmitted to an edge computing node, so that the edge computing node performs data preprocessing on the current shared data and returns the preprocessed current shared data at the target processing time; the edge computing node is pre-deployed according to the platform information, and the platform information includes the geographic location, computing power demand, network connection information and storage capacity of the individualized service platform.

11. A data exchange device, characterized by Comprise: a data receiving module for receiving each shared data sent by a standard service platform at a current time; a time determining module for determining the target processing time of each shared data according to the pre-determined data exchange demand information of the standard service platform, the pre-determined historical shared data state information of the individualized service platform, the current time and the preset time length; the historical shared data state information includes the last exchange time of each shared data, and the data exchange demand information includes the business attribute field corresponding to each shared data and the exchange frequency range; the business attribute field is used to mark the business attribute to which each shared data belongs; the platform information includes the geographic location, computing power demand, network connection information, storage capacity, computing capacity and hardware resources of the individualized service platform; determining the target processing time of each shared data according to the pre-determined data exchange demand information of the standard service platform, the pre-determined platform information of the individualized service platform, the historical shared data state information, the current time and the preset time length, comprising: identifying the business attribute field of each shared data, and obtaining the business attribute data of each shared data according to the business attribute field of each shared data; for each shared data, determining the target exchange time of the current shared data according to the exchange frequency range of the business attribute data of the current shared data, the platform information, the current time and the last exchange time of the business attribute data of the current shared data; if the time length from the target exchange time of the current shared data to the current time is greater than the preset time length, determining the target processing time of the current shared data according to the target exchange time of the current shared data; if the time length from the exchange time of the current shared data to the current time is less than or equal to the preset time length, obtaining the real-time time, and determining the real-time time as the target processing time of the current shared data; a type determining module for data type identification of the current shared data at the target processing time corresponding to the current shared data for each shared data, to obtain the data type of the current shared data; wherein the data type is structured data or unstructured data; a data processing module for data processing of the current shared data according to the data type of the current shared data, to obtain the target data corresponding to the current shared data; a data transmission module for transmitting the target data corresponding to each shared data to the standard service platform.

12. A data exchange electronic device, characterized by Computer program product comprising a memory, a processor and a computer program stored on the memory and loadable into the processor, characterized in that the processor implements the data exchange method according to any one of claims 1 to 10 when executing the computer program.

13. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the data exchange method according to any one of claims 1 to 10.

14. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the data exchange method according to any one of claims 1 to 10.

Images