A multi-source heterogeneous data sharing method, device, equipment and storage medium

Abstract

The application discloses a kind of multi-source heterogeneous data sharing method, device, equipment and storage medium.The method comprises: according to the data selection operation for the shared data resource pool in the preset central library, target shared data is obtained, and according to the information configuration operation for data applicant, target front-end machine is obtained;According to target shared data and target front-end machine, data sharing request is generated, and when detecting that data sharing request is successfully passed through audit, according to the structure attribute corresponding to target shared data, shared implementation information and shared implementation system are obtained;Through shared implementation system, according to shared implementation information, target shared data is exchanged from the preset central library to target front-end machine.The technical scheme of the embodiment, by establishing the central library including standard format data, and using the shared implementation system matched with current request data to automatically carry out data exchange operation, the efficient sharing of multi-source heterogeneous data can be realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular to a multi-source heterogeneous data sharing method and device, equipment and storage medium. BACKGROUND

[0002] With the continuous deepening of digital economic construction, there are more and more demands for cross-industry, cross-department and cross-field data sharing. However, the existence of problems such as system incompatibility, scattered data without convergence, diversified data types without uniformity, and approval management between systems, leads to low efficiency of digital economic construction around various fields.

[0003] At present, the existing data sharing method usually adopts offline data exchange or online approval of each system. However, for offline data exchange, the process of approval, implementation and distribution consumes a lot of manpower and material resources, and the data collection method is relatively single. For the online approval of the system, the data interaction is realized by opening the interface between the systems, but the data standards and structures of different systems are not unified, which leads to the fact that the applicant cannot quickly and accurately connect to the effective department system, and the internal process flow of the department is not transparent in the application and approval process, so it is impossible to realize real-time monitoring of the data sharing process. Secondly, when multiple applicants propose multiple types of data requests, the systems they need to connect are numerous, and the data exchange links of different types and structures are very complex, greatly increasing the difficulty and workload of data sharing. SUMMARY

[0004] The present application provides a multi-source heterogeneous data sharing method, device, equipment and storage medium, which can realize efficient sharing of multi-source heterogeneous data.

[0005] According to one aspect of the present application, a multi-source heterogeneous data sharing method is provided, comprising:

[0006] According to the data selection operation for the shared data resource pool in the preset central library, the target shared data is obtained, and according to the information configuration operation for the data applicant, the target front-end machine is obtained;

[0007] According to the target shared data and the target front-end machine, a data sharing request is generated, and when it is detected that the data sharing request passes the audit successfully, the target shared data corresponding to the structure attribute is obtained. The shared implementation information and the shared implementation system corresponding to the target shared data are obtained;

[0008] According to the shared implementation information, the target shared data is exchanged from the preset central library to the target front-end machine through the shared implementation system.

[0009] According to another aspect of the present application, a multi-source heterogeneous data sharing device is provided, comprising:

[0010] a target shared data acquisition module configured to acquire target shared data according to a data selection operation for a shared data resource pool in a preset central library, and acquire a target front-end device according to an information configuration operation for a data applicant;

[0011] a shared implementation information acquisition module configured to generate a data sharing request according to the target shared data and the target front-end device, and acquire shared implementation information and a shared implementation system corresponding to the target shared data according to a structure attribute corresponding to the target shared data when it is detected that the data sharing request successfully passes an audit;

[0012] a target shared data exchange module configured to exchange the target shared data from the preset central library to the target front-end device according to the shared implementation information through the shared implementation system.

[0013] According to another aspect of the present application, an electronic device is provided, which comprises:

[0014] at least one processor; and

[0015] a memory connected to the at least one processor in communication; wherein,

[0016] the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the sharing method of multi-source heterogeneous data according to any one of the embodiments of the present application.

[0017] According to another aspect of the present application, a computer readable storage medium is provided, which stores computer instructions for enabling a processor to perform the sharing method of multi-source heterogeneous data according to any one of the embodiments of the present application when executed by the processor.

[0018] The technical solution of the embodiments of the present application acquires target shared data according to a data selection operation for a shared data resource pool in a preset central library, and acquires a target front-end device according to an information configuration operation for a data applicant; then, generates a data sharing request according to the target shared data and the target front-end device, and acquires shared implementation information and a shared implementation system corresponding to the target shared data according to a structure attribute corresponding to the target shared data when it is detected that the data sharing request successfully passes an audit; finally, exchanges the target shared data from the preset central library to the target front-end device according to the shared implementation information through the shared implementation system, and can realize efficient sharing of multi-source heterogeneous data by establishing a central library including standard format data and automatically performing data exchange operations by using a shared implementation system matching current requested data.

[0019] It is to be understood that the details set forth herein do not limit the scope of the embodiments of the application to the specific embodiments described. Rather, the scope of the embodiments of the application is to be defined by the appended claims. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0021] Figure 1A is a flow chart of a multi-source heterogeneous data sharing method according to the first embodiment of the present application;

[0022] Figure 1B is a frame schematic diagram of a data sharing system according to the first embodiment of the present application;

[0023] Figure 2 is a flow chart of a multi-source heterogeneous data sharing method according to the second embodiment of the present application;

[0024] Figure 3 is a structural schematic diagram of a multi-source heterogeneous data sharing device according to the third embodiment of the present application;

[0025] Figure 4 is a structural schematic diagram of an electronic device implementing the multi-source heterogeneous data sharing method of the embodiments of the present application. DETAILED DESCRIPTION

[0026] In order to make the technical personnel in the art better understand the present application scheme, the following will combine the drawings in the embodiments of the present application, and the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only some embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should belong to the scope of protection of the present application.

[0027] It should be noted that the terms "first", "second", "target", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily limit to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0028] Embodiment one

[0029] Figure 1A A flowchart of a multi-source heterogeneous data sharing method is provided for the first embodiment of the present application. The present embodiment can be applied to the sharing of multi-source heterogeneous data between different departments, organizations and systems. The method can be performed by a multi-source heterogeneous data sharing device, which can be realized in the form of hardware and / or software. The multi-source heterogeneous data sharing device can be configured in an electronic device, which can typically be a computer device or a server. As shown in Figure 1A The method comprises the following steps:

[0030] S110, according to the data selection operation for the shared data resource pool in the preset central library, obtaining target shared data, and according to the information configuration operation for the data applicant, obtaining a target front-end machine.

[0031] In the present embodiment, a preset central library can be established by gathering public multi-source heterogeneous data of all levels of units and departments in the system, such as application program interface data, structured data, unstructured data, change data capture real-time data, etc. In the preset central library, the gathered data can be processed by data cleaning, conversion, fusion and governance, etc. to be uniformly output as standard library tables, interfaces, files, maps, certificates, video streams and Internet of Things type data, thereby establishing a high-standard public data resource library. Secondly, various application libraries can be constructed based on application requirements, such as various public basic libraries, special libraries and theme libraries, and then the various types of application libraries can be combined to form a shared data resource pool.

[0032] In a specific example, the data applicant can first log in the data sharing system, and can select the required directory data in the data selection page of the system according to the business requirement, add the required directory data to the selected data, and click the confirm button; for example, the data application library can be selected first, and then the specific data required in the data application library can be selected. Thus, the data sharing system can determine the data required by the user as the target shared data according to the data selection operation of the user.

[0033] Further, the data applicant can set the attribute information of the data applicant after selecting the shared data, such as the department to which the data applicant belongs, the front-end machine used, the database, and the like. Thus, the data sharing system can determine the target device of the data sharing, i.e., the target front-end machine. The front-end machine can be a server for data storage.

[0034] S120, generating a data sharing request according to the target shared data and the target front-end machine, and acquiring the shared implementation information and the shared implementation system corresponding to the target shared data according to the structure attribute corresponding to the target shared data when it is detected that the data sharing request successfully passes the review.

[0035] In a specific example, the data applicant can click the data application button after setting the target shared data and the target front-end machine, and the data sharing system can automatically generate a data sharing request according to the target shared data and the target front-end machine. Then, the data sharing system can determine the data sharing mode corresponding to the target shared data, and if the data sharing mode is conditional sharing, the data sharing request can be assigned to the corresponding person in charge for review. If the data sharing request successfully passes the review, it means that the data applicant meets the use condition of the target shared data, and the target shared data can be further analyzed to determine the structure attribute corresponding to the target shared data. The structure attribute can include library table, interface, file, map, license, video stream, and Internet of Things, and the like.

[0036] Further, the data sharing system can determine the shared implementation information and the shared implementation system corresponding to the target shared data according to the structure attribute and the preset corresponding relationship between the structure attribute and the shared implementation information and the shared implementation system.

[0037] It should be noted that different data sharing modes can be used for different data structure attributes. In this embodiment, the corresponding shared implementation system and shared implementation information can be preset for each structure attribute; for example, for library table type data, the corresponding shared implementation system can be a data exchange system and a service construction system, and the data sharing can be realized by using two modes of library table exchange and service interface. In addition, the shared implementation system can also include a license system, a map system, an Internet of Things system, and a video stream system, and the like.

[0038] The shared implementation information can be parameter information required by the shared implementation system to perform a data sharing operation, for example, a filter query statement, an input parameter and an output parameter of an interface, and the like.

[0039] In S130, the shared implementation system is used to exchange the target shared data from the preset central library to the target front-end machine according to the shared implementation information.

[0040] In this embodiment, the data sharing task can be automatically performed according to the shared implementation information by the determined shared implementation system, so as to exchange the target shared data from the preset central library to the target front-end machine, thereby realizing data sharing. For example, the data sharing can be automatically realized by a data exchange system according to a condition filter SQL statement; or the service interface can be automatically constructed by a service construction system according to an input parameter and an output parameter of an interface, and the data sharing can be realized based on the service interface.

[0041] The technical scheme of the embodiment of the application can obtain the target shared data according to the data selection operation for the shared data resource pool in the preset central library, and obtain the target front-end machine according to the information configuration operation for the data applicant; then, the data sharing request is generated according to the target shared data and the target front-end machine, and when it is detected that the data sharing request is successfully passed through the audit, the shared implementation information and the shared implementation system are obtained according to the structure attribute corresponding to the target shared data; finally, the target shared data is exchanged from the preset central library to the target front-end machine according to the shared implementation information by the shared implementation system, the central library including the standard format data is established, and the data exchange operation is automatically performed by the shared implementation system matched with the current request data, so that the efficient sharing of the multi-source heterogeneous data can be realized.

[0042] In an optional implementation of the embodiment, the shared data resource pool can include a plurality of basic databases and subject databases, and the target shared data can be obtained according to the data selection operation for the shared data resource pool in the preset central library, which can include:

[0043] The target database is obtained according to the database selection operation for the shared data resource pool in the preset central library, and the target shared data is obtained according to the data selection operation for the target database.

[0044] The target shared data can include at least one of library table data, interface data, file data, map data, license data, video stream data and Internet of Things data.

[0045] In a specific example, after a data applicant successfully logs in the data sharing system, the data applicant can first select a database to be used in the shared data resource pool, and then can further select specific data to be used in the selected database. Thus, the data sharing system can determine the target database and the target shared data in sequence according to the click selection operation of the data applicant. The database and the data can be displayed in the form of an identification list.

[0046] In another optional implementation of the embodiment, detecting that the data sharing request passes the review successfully can include:

[0047] obtaining configuration information corresponding to the target shared data, and obtaining a sharing mode corresponding to the target shared data according to the configuration information;

[0048] if it is detected that the sharing mode is conditional sharing, obtaining an auditor corresponding to the target shared data according to the configuration information;

[0049] generating an audit task corresponding to the data sharing request, and sending the audit task to a business system of the auditor through a preset message bus;

[0050] if the audit pass information corresponding to the audit task is received, it is determined that the data sharing request passes the review successfully.

[0051] In the embodiment, the configuration information corresponding to the data in the preset central library can be pre-set, for example, whether conditional sharing, data sharing distribution range, data provision type, data desensitization range, and auditor, to realize unified management of the data sharing mode. Thus, after the target shared data is determined, the corresponding configuration information can be found, and then the auditor and the sharing mode corresponding to the target shared data can be determined based on the configuration information.

[0052] Then, if it is determined that the sharing mode is conditional sharing, indicating that the data sharing needs to be approved, an audit task (for example, an audit sheet) corresponding to the data sharing request can be generated, and the audit task is distributed to the corresponding auditor through a pre-set message bus, for example, an enterprise service bus (ESB). The auditor can review and confirm the data sharing request in the audit task, and if it is determined that the current data applicant meets the use conditions of the target shared data, the audit pass can be selected. The data sharing system can determine that the current data sharing request passes the review successfully when the audit pass information of the auditor is detected.

[0053] Optionally, if it is determined that the sharing mode is unconditional sharing, it indicates that the current data sharing does not need to be audited, and the data sharing operation can be directly performed according to the corresponding sharing implementation information through the corresponding sharing implementation system after the data sharing request is recorded.

[0054] In another optional implementation of the embodiment, according to the structure attribute corresponding to the target shared data, the sharing implementation information and the sharing implementation system corresponding to the target shared data can be obtained, which can include:

[0055] If it is detected that the structure attribute corresponding to the target shared data is a library table, a data exchange system or a service construction system is obtained as the sharing implementation system corresponding to the target shared data.

[0056] When the sharing implementation system is a data exchange system, according to the organization level of the target front-end machine, a filter query statement is obtained as the sharing implementation information.

[0057] Among them, the data source of the library table type data can include MySQL, Oracle, SQLServer, DB2, PostgreSQL and MongoDB, etc., and the data sharing can be realized in two ways of library table exchange and service interface, and correspondingly, the sharing implementation system can be a data exchange system or a service construction system.

[0058] In a specific example, when the data sharing is realized by the library table exchange mode, the source data of the target library receiving application can be selected, and the information items and key data desensitization required in the application library table can be customized. Then, according to whether the library table has a conditional sharing mode, it is determined whether the data is conditional data approval or unconditional data recording. After the approval or recording is completed, according to the organization level of the applicant, the data range that the data applicant has the right to view is determined, and then according to the data range, a filter query statement, for example, a SQL statement, is generated as the sharing implementation information. Among them, the filter query statement can be a query instruction information for the multi-source heterogeneous data in the preset central library.

[0059] Correspondingly, according to the sharing implementation information, the target shared data is exchanged from the preset central library to the target front-end machine through the sharing implementation system, which can include:

[0060] According to the filter query statement, the target shared data is exchanged from the preset central library to the target front-end machine through the data exchange system.

[0061] Specifically, firstly, the filtering query statement can be transmitted and routed to the data exchange system via the message bus; then, the data exchange system creates a data exchange task based on the filtering query statement; finally, based on the data exchange task, the target shared data can be automatically updated from the preset central database to the selected target front-end machine according to the data provider's directory data update frequency and data sharing scope, and then the target shared data can be periodically moved from the preset central database to the selected target front-end machine according to the minimum level to complete the data sharing.

[0062] In another optional implementation of this embodiment, after obtaining a data exchange system or service construction system as the sharing implementation system corresponding to the target shared data, it may further include:

[0063] When the shared implementation system builds a service system, it obtains the input and output parameters of the interface as shared implementation information;

[0064] In a specific example, when the structural attribute of the target shared data is a database table, data sharing can also be achieved using a service interface. Specifically, a service building system is used as the sharing implementation system, and the input and output parameters of the interface configured by the data applicant are obtained as sharing implementation information. Then, after successful approval or filing, the input and output parameters of the interface are forwarded to the service building system through a preset message bus.

[0065] Correspondingly, through the shared implementation system, based on the shared implementation information, exchanging the target shared data from the preset central database to the target front-end machine may include:

[0066] The service building system establishes a service interface based on the input and output parameters of the interface, and exchanges the target shared data from the preset central database to the target front-end machine through the service interface.

[0067] Specifically, the service building system can automatically construct service interfaces based on the input and output parameters of the API, register the service interfaces with the gateway, and add the business system accounts and keys (e.g., passid and token) of the data requesters to the whitelist to complete the construction, registration, and authorization of the service interfaces. Finally, through this service interface, the exchange of target shared data can be automatically realized. The service interface can be a precise or fuzzy query interface.

[0068] Specifically, data exchange content and protocols can be encapsulated in the form of services through service interfaces, and the required data can be obtained by calling the public data service of the target shared data. The data can then be updated to the target front-end machine according to certain data transformation and data update rules.

[0069] It should be noted that the interface authorization, license, map, Internet of Things and video stream and other structural attributes mainly realize data sharing in the form of service interface. Among them, the interface authorization type data can configure the calling period, daily calling volume, calling time range and usage peak and other parameters, and the video stream type data can select the regional video monitoring point data and authorized registration and the like.

[0070] In addition, after the data sharing request is successfully reviewed, a service request can be initiated to the ESB according to different structural attributes; the ESB accesses the service request and converts the communication protocol and message format through the adapter technology, and forwards the service to the corresponding sharing implementation system through service routing. The sharing implementation system can configure a white list for the passid of the business system of the data applicant, and can complete dynamic authorization of the data code in an asynchronous manner. Through integration of the sharing implementation system, unified registration, unified management, unified sharing and unified authorization of shared data can be completed, and data sharing and opening can be promoted based on unified data services.

[0071] In the embodiment, by constructing the fusion center library, the application, approval and implementation of the sharing process are completed according to the requirements of the applicant, the data sharing process is simplified, the data is more liquid, and the sharing of multi-source heterogeneous data can be realized. Secondly, since the message bus ESB has the functions of service management, protocol conversion, format conversion, service routing and message processing, the embodiment adopts the service-oriented architecture (SOA), splits the functional units for implementing data sharing into sharing implementation systems, connects the systems through predefined interfaces and protocols, and realizes application integration and routing forwarding through the bus ESB, and configures data sharing distribution rules, so that the sharing is more accurate, and the minimum authorization principle can be implemented, the sharing efficiency can be improved, the data fine automatic sharing can be realized, and the data dynamic implementation automation can be realized.

[0072] In a specific example, the framework of the data sharing system can be as shown in Figure 1B ; wherein the multi-source heterogeneous data can include library tables, interfaces, files, Internet of Things, licenses, maps and video streams and the like. In the embodiment, the public multi-source heterogeneous data of all levels of units and departments in the whole system can be converged, and after processing such as data cleaning, conversion, fusion and governance, the data can be stored in the center library. Secondly, in the center library, various types of application libraries can be established according to application requirements, for example, various public basic libraries and theme libraries and the like, to form a shared data resource pool.

[0073] When the data applicant needs to use data, the data sharing platform can be selected according to business needs, and a data sharing application can be submitted. If the required data is in a conditional sharing mode, the data sharing application can be distributed to the corresponding reviewer. After passing the review, the data sharing platform can distribute the data sharing task to the corresponding sharing implementation system through the message bus ESB, and the sharing implementation system can specifically execute and carry the data required by the user to the front-end machine of the data applicant. In addition, after the implementation is completed, the data applicant can also feed back the application effect of the application data quality and relevance, etc. to form a data closed-loop link. Moreover, for the sharing process chain file and key document, they can be uploaded and stored to the blockchain node after adding the anti-forgery electronic seal.

[0074] In the embodiment, through data acquisition monitoring front-end, intelligent big data security analysis and research, the daily operation safety of the data center can be guaranteed, the connection link for all data in the system can be built, and the demand sharing can be guided. The one-key application, rapid approval and data sharing management mechanism can be realized, and the full and intelligent data support can be provided.

[0075] Embodiment two

[0076] Figure 2 A flowchart of a multi-source heterogeneous data sharing method provided by the second embodiment of the application is shown in the figure. The technical solution in the embodiment is a further refinement of the above technical solution, and can be combined with one or more of the above embodiments. As shown in the figure, the method comprises: Figure 2

[0077] S210, according to the data selection operation for the shared data resource pool in the preset center library, the target shared data is obtained, and according to the information configuration operation for the data applicant, the target front-end machine is obtained.

[0078] S220, according to the target shared data and the target front-end machine, a data sharing request is generated, and when it is detected that the data sharing request passes the review successfully, according to the structure attribute corresponding to the target shared data, the sharing implementation information and the sharing implementation system corresponding to the target shared data are obtained.

[0079] S230, through the sharing implementation system, according to the sharing implementation information, the target shared data is exchanged from the preset center library to the target front-end machine.

[0080] S240, the current application effect information fed back by the data applicant is obtained, and according to the current application effect information, the predicted demand data corresponding to the data applicant is obtained.

[0081] ​The application effect information can be evaluation information of the data applicant on data application after obtaining the target shared data. In this embodiment, the data applicant can report the demand target and application effect information after completing data application. The data sharing system can collect data application cases and generate data calling information, and can display the application effect information provided by the data applicant.

[0082] Specifically, the data sharing system can generate predicted demand data of the data applicant in the future according to the current application effect information and historical application effect information through a pre-trained demand data prediction model. The demand data prediction model can be established based on a machine learning algorithm (for example, a convolutional neural network), and the input can be previous shared data and corresponding application effect information, and the output can be future shared data.

[0083] Optionally, the application effect information can be visually analyzed from different themes and dimensions. For example, trend analysis of data sharing demand can be performed from the department dimension or the time dimension to obtain data sharing demand of users or units, so as to realize intelligent recommendation of hot data.

[0084] S250, generating push information corresponding to the predicted demand data, and sending the push information to the data applicant.

[0085] The push information can be in the form of a pop-up window, a link, or the like. In this embodiment, after the predicted demand data is determined, the current push information can be generated according to the predicted demand data based on a pre-set push information generation rule, and the push information can be sent to the business system of the data applicant. When the data applicant is interested in the pushed data, the data sharing application can be sent to the data sharing system to obtain specific shared data.

[0086] Optionally, the technical solution of this embodiment can also include generating overtime review information when it is detected that the review time exceeds a pre-set time threshold according to the urgency of the data sharing application, and sending the overtime review information to the reviewer through a pre-set information sending mode. Specifically, the overtime review information can be written into the middleware Kafka through short message, email, in-site notification, or the like. Then, the message push system can be accessed as a consumer to connect Kafka and receive messages to complete intelligent follow-up.

[0087] In this embodiment, the message publishing and subscribing are realized by using the Kafka message queue, the system is decoupled in an asynchronous manner, and the peak shaving effect can be achieved when high traffic is encountered.

[0088] In addition, for the key reports of data application basis in the data sharing process and sharing process chain file, an anti-fake electronic seal can be generated, and the key reports added with the anti-fake electronic seal can be uploaded and stored to the blockchain node.

[0089] The advantage of the above setting is that, compared with the previous offline paper document or computer hard disk storage mode, the embodiment adopts the blockchain technology to store the signed key documents, and adopts the decentralized distributed accounting mode, which can guarantee the tamper-proof, traceability, security and transparency of the data link.

[0090] In the embodiment, by collecting all multi-source heterogeneous data in the whole system, according to the data structure and hierarchical model design, eliminating data swamp, formulating unified standards and unified sharing entrance, intensive construction and shared governance can be realized for continuous operation and management, and data dynamic updating and synchronization mechanism can be optimized. Secondly, by adopting online circulation, according to the different data types, the data is routed to different implementation systems through bus ESB to complete the automatic implementation and dynamic authorization of the data, and automatic sharing can be realized. Compared with the previous offline application which takes months and the interaction between online systems which takes about a month, the average settlement time of the whole system data can be reduced by 99%, and the data sharing efficiency can be greatly improved.

[0091] The technical scheme of the embodiment of the application comprises the following steps: after the target shared data is exchanged from the preset central library to the target front-end machine, the current application effect information fed back by the data applicant is acquired, and the predicted demand data corresponding to the data applicant is acquired according to the current application effect information; then, the push information corresponding to the predicted demand data is generated, and the push information is sent to the data applicant; by feeding back the application effect information of the shared data, the closed-loop management of the data sharing can be realized, and the sharing efficiency of the multi-source heterogeneous data can be further improved.

[0092] Embodiment three

[0093] Figure 3 A structure schematic diagram of a multi-source heterogeneous data sharing device provided for the third embodiment of the application is shown in FIG. 3. Figure 3 As shown in the figure, the device can include a target shared data acquisition module 310, a shared implementation information acquisition module 320 and a target shared data exchange module 330; wherein,

[0094] The target shared data acquisition module 310 is configured to acquire target shared data according to a data selection operation on a shared data resource pool in a preset central library, and acquire a target front-end machine according to an information configuration operation on a data applicant.

[0095] The shared implementation information acquisition module 320 is configured to generate a data sharing request according to the target shared data and the target front-end machine, and acquire shared implementation information and a shared implementation system corresponding to the target shared data according to a structure attribute corresponding to the target shared data when it is detected that the data sharing request successfully passes an audit.

[0096] The target shared data exchange module 330 is configured to exchange the target shared data from a preset central library to the target front-end machine through the shared implementation system according to the shared implementation information.

[0097] The technical scheme of the embodiment of the application acquires target shared data according to a data selection operation on a shared data resource pool in a preset central library, acquires a target front-end machine according to an information configuration operation on a data applicant, generates a data sharing request according to the target shared data and the target front-end machine, acquires shared implementation information and a shared implementation system according to a structure attribute corresponding to the target shared data when it is detected that the data sharing request successfully passes an audit, and finally exchanges the target shared data from the preset central library to the target front-end machine through the shared implementation system according to the shared implementation information. The central library including standard format data is established, and the shared implementation system matching the current requested data is used to automatically perform a data exchange operation, so that efficient sharing of multi-source heterogeneous data can be realized.

[0098] Optionally, the shared data resource pool includes a plurality of basic databases and subject databases, and the target shared data acquisition module 310 is specifically configured to acquire a target database according to a database selection operation on the shared data resource pool in the preset central library, and acquire target shared data according to a data selection operation on the target database.

[0099] Optionally, the target shared data includes at least one of library table data, interface data, file data, map data, license data, video stream data and Internet of Things data.

[0100] Optionally, the shared implementation information acquisition module 320 includes:

[0101] The shared mode acquisition unit is configured to acquire configuration information corresponding to the target shared data, and acquire a shared mode corresponding to the target shared data according to the configuration information.

[0102] The auditor acquisition unit is configured to acquire an auditor corresponding to the target shared data according to the configuration information if it is detected that the shared mode is conditional sharing.

[0103] The audit task sending unit is configured to generate an audit task corresponding to the data sharing request, and send the audit task to a business system of the auditor through a preset message bus.

[0104] The audit pass information receiving unit is configured to determine that the data sharing request passes the audit successfully if the audit pass information corresponding to the audit task is received.

[0105] Optionally, the sharing implementation information acquisition module 320 is specifically configured to acquire a data exchange system or a service construction system as the sharing implementation system corresponding to the target shared data if it is detected that the structural attribute corresponding to the target shared data is a library table; and acquire a filter query statement as the sharing implementation information according to the organization level of the target front-end machine when the sharing implementation system is the data exchange system.

[0106] The target shared data exchange module 330 is specifically configured to exchange the target shared data from a preset central library to the target front-end machine through the data exchange system according to the filter query statement.

[0107] Optionally, the sharing implementation information acquisition module 320 is specifically configured to acquire the input parameter and the output parameter of an interface as the sharing implementation information when the sharing implementation system is the service construction system.

[0108] The target shared data exchange module 330 is specifically configured to establish a service interface according to the input parameter and the output parameter of the interface through the service construction system, and exchange the target shared data from the preset central library to the target front-end machine through the service interface.

[0109] Optionally, the multi-source heterogeneous data sharing device further comprises:

[0110] The predicted demand data acquisition module is configured to acquire current application effectiveness information fed back by the data applicant, and acquire predicted demand data corresponding to the data applicant according to the current application effectiveness information.

[0111] The push information sending module is configured to generate push information corresponding to the predicted demand data, and send the push information to the data applicant.

[0112] The multi-source heterogeneous data sharing device provided in the embodiment can execute the multi-source heterogeneous data sharing method provided in any embodiment of the application, and has the corresponding function modules and beneficial effects of the execution method.

[0113] It should be noted that, in the technical solution of the embodiment, the acquisition, storage and application of the user personal information all comply with the relevant laws and regulations and do not violate public order and good customs.

[0114] Embodiment Four

[0115] Figure 4A schematic diagram of an electronic device 40 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0116] like Figure 4 As shown, the electronic device 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42 or a random access memory (RAM) 43, communicatively connected to the at least one processor 41. The memory stores computer programs executable by the at least one processor. The processor 41 can perform various appropriate actions and processes based on the computer program stored in the ROM 42 or loaded into the RAM 43 from storage unit 48. The RAM 43 may also store various programs and data required for the operation of the electronic device 40. The processor 41, ROM 42, and RAM 43 are interconnected via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0117] Multiple components in electronic device 40 are connected to I / O interface 45, including: input unit 46, such as keyboard, mouse, etc.; output unit 47, such as various types of monitors, speakers, etc.; storage unit 48, such as disk, optical disk, etc.; and communication unit 49, such as network card, modem, wireless transceiver, etc. Communication unit 49 allows electronic device 40 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0118] Processor 41 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 41 performs the various methods and processes described above, such as methods for sharing heterogeneous data from multiple sources.

[0119] In some embodiments, the sharing method of multi-source heterogeneous data can be implemented as a computer program tangibly embodied in a computer readable storage medium, e.g., storage unit 48. In some embodiments, parts or all of the computer program can be loaded and / or installed onto electronic device 40 via, e.g., ROM 42 and / or communication unit 49. When the computer program is loaded onto RAM 43 and executed by processor 41, one or more steps of the sharing method of multi-source heterogeneous data as described above can be performed. Alternatively, in other embodiments, processor 41 can be configured to perform the sharing method of multi-source heterogeneous data by other means, e.g., via firmware.

[0120] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0121] Computer programs used to implement the methods of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed by the processor of the machine, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0122] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0123] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0124] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0125] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0126] It should be understood that the various forms of flow shown above can be used to reorder, add or delete steps. For example, each step described in the present application can be executed in parallel, sequentially or in a different order, as long as the desired results of the technical solutions of the present application can be achieved, which is not limited herein.

[0127] The above detailed description does not constitute a limitation on the scope of protection of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for sharing multi-source heterogeneous data, characterized in that, include: Based on the database selection operation for the shared data resource pool in the preset central database, the target database is obtained, and based on the data selection operation for the target database, the target shared data is obtained, and based on the information configuration operation for the data applicant, the target front-end machine is obtained; the shared data resource pool includes multiple basic databases and thematic databases, and the target shared data includes at least one of the following: database table data, interface data, file data, map data, certificate data, video stream data, and IoT data; Based on the target shared data and the target front-end machine, a data sharing request is generated. When the data sharing request is successfully approved, if the structural attribute corresponding to the target shared data is detected to be a library table, a data exchange system or service construction system is obtained as the sharing implementation system corresponding to the target shared data. When the shared implementation system is a data exchange system, a filtering query statement is obtained based on the organizational level of the target front-end machine to serve as shared implementation information; Through the shared implementation system, the target shared data is exchanged from the preset central database to the target front-end machine according to the shared implementation information; The process of exchanging the target shared data from the preset central database to the target front-end machine through the shared implementation system, based on the shared implementation information, includes: Through the data exchange system, the target shared data is exchanged from the preset central database to the target front-end machine according to the filtering query statement.

2. The method according to claim 1, characterized in that, The data sharing request was detected to have successfully passed the review, including: Obtain the configuration information corresponding to the target shared data, and obtain the sharing method corresponding to the target shared data based on the configuration information; If the sharing method is detected to be conditional sharing, then the reviewer corresponding to the target shared data is obtained according to the configuration information; Generate an audit task corresponding to the data sharing request, and send the audit task to the auditor's business system through a preset message bus; If the approval information corresponding to the approval task is received, it is determined that the data sharing request has successfully passed the approval.

3. The method according to claim 1, characterized in that, After acquiring a data exchange system or service construction system as the sharing implementation system corresponding to the target shared data, the system further includes: When the shared implementation system builds a service system, it obtains the input and output parameters of the interface as shared implementation information; Through the shared implementation system, based on the shared implementation information, the target shared data is exchanged from the preset central database to the target front-end machine, including: The service building system establishes a service interface based on the input and output parameters of the interface, and exchanges the target shared data from the preset central database to the target front-end machine through the service interface.

4. The method according to claim 1, characterized in that, After the target shared data is exchanged from the preset central database to the target front-end machine through the shared implementation system according to the shared implementation information, the process further includes: Obtain the current application effectiveness information fed back by the data requester, and obtain the predicted demand data corresponding to the data requester based on the current application effectiveness information; Generate push information corresponding to the predicted demand data and send the push information to the data requester.

5. A device for sharing multi-source heterogeneous data, characterized in that, include: The target shared data acquisition module is used to acquire a target database based on a database selection operation for a shared data resource pool in a preset central database, acquire target shared data based on a data selection operation for the target database, and acquire a target front-end machine based on an information configuration operation for the data applicant; the shared data resource pool includes multiple basic databases and thematic databases, and the target shared data includes at least one of the following: database table data, interface data, file data, map data, certificate data, video stream data, and IoT data; The shared implementation information acquisition module is used to generate a data sharing request based on the target shared data and the target front-end machine, and when the data sharing request is successfully approved, if the structural attribute corresponding to the target shared data is detected to be a library table, then the data exchange system or service construction system is acquired as the shared implementation system corresponding to the target shared data. When the shared implementation system is a data exchange system, a filtering query statement is obtained based on the organizational level of the target front-end machine to serve as shared implementation information; The target shared data exchange module is used to exchange the target shared data from the preset central database to the target front-end machine through the shared implementation system, based on the shared implementation information; The target shared data exchange module is specifically used to exchange the target shared data from the preset central database to the target front-end machine through the data exchange system according to the filtering query statement.

6. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to enable the at least one processor to perform the method for sharing multi-source heterogeneous data as described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that are used to cause a processor to execute the method for sharing multi-source heterogeneous data as described in any one of claims 1-4.

Images