A data exchange method and system, electronic equipment, storage medium
By building a trusted network through a data exchange platform and blockchain technology, and adopting a JSON-formatted data exchange model, the problem of data silos in large organizations has been solved, enabling efficient interconnection and secure sharing of heterogeneous data.
Patent Information
- Application Number
- CN202111188047.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-12
- Publication Date
- 2025-10-24
- Estimated Expiration
- 2041-10-12
AI Technical Summary
Traditional data sharing and exchange methods cannot meet the diverse and complex data resource needs of large organizations, resulting in serious data silos, complex system design, and low efficiency.
A trusted network is built using a data exchange platform and blockchain technology. The source data is encapsulated into data packets through a data exchange model, and the data is interconnected using JSON format. It supports parsing and accessing data in multiple languages and formats, and builds a cross-organizational and cross-regional data exchange system.
It enables efficient interconnection and interoperability of heterogeneous data, simplifies the data conversion process, improves data sharing efficiency, reduces complexity, and ensures data security and consistency.
Smart Images

Figure CN113849692B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of computer, in particular, to a data exchange method and system, an electronic device and a storage medium. BACKGROUND
[0002] With the continuous advancement of informatization construction, data has become an important strategic resource and a production factor. In the informatization construction of large organizations, a large amount of data resources will be generated in different levels, regions, systems, departments and businesses, and these data resources have the characteristics of structural diversity, inconsistent standards, dynamic changes, extensive distribution and hierarchical control.
[0003] However, the traditional interface packaging and data copying methods cannot meet the needs of data sharing and exchange, and the system is becoming more and more independent and the data island phenomenon is becoming more and more obvious. With the increasing frequency of cooperation between systems, the problem of data sharing and exchange has become an important bottleneck restricting data assetization and extreme. SUMMARY
[0004] The present disclosure aims to at least solve one of the problems in the prior art, and provides a data exchange method and system, an electronic device and a storage medium.
[0005] In one aspect of the present disclosure, a data exchange method is provided, which is applied to data exchange between a plurality of data exchange agents, and the method comprises:
[0006] A source data exchange agent obtains a published data exchange model from a data exchange platform, encapsulates source data to be exchanged into a data package corresponding to the data exchange model according to the data exchange model, and publishes the data package to the data exchange platform;
[0007] A target data exchange agent obtains the data package from the data exchange platform, parses the data package based on a data exchange model corresponding to the data package, and obtains the source data encapsulated in the data package.
[0008] Optionally, the method further comprises:
[0009] The data exchange platform receives a data type and data elements input by a user, generates and publishes the data exchange model according to the data type and the data elements.
[0010] Optionally, the method further comprises:
[0011] The plurality of data exchange agents construct a trusted network based on a blockchain to perform data exchange through the trusted network, wherein:
[0012] Each of the data exchange agents stores a block of the blockchain;
[0013] Each of the blockchains comprises a plurality of data blocks, each of the data blocks corresponding to one of the data exchange agents respectively; and
[0014] Each of the data blocks comprises preset data exchange strategies and authorized user information among the data exchange agents.
[0015] Optionally, the data block comprises a block creation timestamp, a unit identification to which the block belongs, an encrypted authorized block, a block checksum, a hash value of a current data block, a hash value of a previous data block, and a name of a next data block.
[0016] Optionally, the data exchange model comprises sender information, receiver information, time, data packet description, custom field, security level, data exchange rule, and at least one data content.
[0017] Another aspect of the present disclosure provides a data exchange system, comprising a data exchange platform and a plurality of data exchange agents in communication connection with the data exchange platform, wherein:
[0018] A source data exchange agent is configured to obtain a published data exchange model from the data exchange platform, encapsulate source data to be exchanged into a data packet corresponding to the data exchange model according to the data exchange model, and publish the data packet to the data exchange platform.
[0019] A destination data exchange agent is configured to obtain the data packet from the data exchange platform, parse the data packet based on a data exchange model corresponding to the data packet, and obtain the source data encapsulated in the data packet.
[0020] Optionally, the data exchange platform is configured to receive a data type and data elements input by a user, and generate and publish a data exchange model according to the data type and the data elements.
[0021] Optionally, the plurality of data exchange agents are built into a trusted network based on a blockchain, and data exchange is performed through the trusted network, wherein:
[0022] Each of the data exchange agents stores one of the blockchains respectively;
[0023] Each of the blockchains comprises a plurality of data blocks, each of the data blocks corresponding to one of the data exchange agents respectively; and
[0024] Each of the data blocks comprises preset data exchange strategies and authorized user information among the data exchange agents.
[0025] Optionally, the data block comprises a block creation timestamp, a unit identification to which the block belongs, an encryption authorization block, a block checksum, a hash value of a current data block, a hash value of a previous data block, and a name of a next data block.
[0026] Optionally, the data exchange model comprises sender information, receiver information, time, data packet description, custom field, security level, data exchange rule, and at least one data content.
[0027] In another aspect of the present disclosure, an electronic device is provided, comprising:
[0028] at least one processor; and
[0029] a memory in communication connection with the at least one processor; wherein
[0030] the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method as described above.
[0031] In another aspect of the present disclosure, a computer readable storage medium is provided, which stores a computer program executable by a processor to implement the method as described above.
[0032] The present disclosure, in view of the prior art, is characterized by a wide data source channel, a large number of data types, and a scattered geographical distribution of various types of organizational data of large enterprise groups, public management departments, and the like. The present disclosure fully considers the diversity and complexity of data and innovatively proposes a data exchange method and system, an electronic device, and a storage medium. A source data exchange agent obtains a published data exchange model from a data exchange platform, encapsulates source data to be exchanged into a data packet corresponding to the data exchange model according to the data exchange model, and publishes the data packet to the data exchange platform. A destination data exchange agent obtains a published data packet from the data exchange platform, parses the data packet based on the data exchange model corresponding to the data packet, and obtains the source data encapsulated in the data packet. The data exchange model is simple in format, easy to parse and access, and supports multiple languages. Multiple data exchange agents can perform operations such as “conversion-packing-uploading-sharing” or “downloading-decompression-conversion-use” of their own data according to the data exchange model published by the data exchange platform, thereby solving the problems of data location, data structure, data integrity, and information barriers in data exchange, realizing the interconnection of heterogeneous data, effectively avoiding the complex manual data conversion and adaptation process, greatly improving the efficiency of data exchange and sharing, and effectively promoting the flow and use of data. BRIEF DESCRIPTION OF DRAWINGS
[0033] One or more embodiments are illustrated by way of example in the figures that are not intended to be limiting in which like reference numbers refer to similar elements throughout the several views of the drawings, and wherein:
[0034] Figure 1 A flowchart of a data exchange method according to an embodiment of the present disclosure;
[0035] Figure 2 A structural diagram of a data exchange model according to another embodiment of the present disclosure;
[0036] Figure 3 A data exchange requirement diagram of each exchange node according to another embodiment of the present disclosure;
[0037] Figure 4 A structural diagram of a trusted network according to another embodiment of the present disclosure;
[0038] Figure 5 A structural diagram of a block chain according to another embodiment of the present disclosure;
[0039] Figure 6 A flowchart of a data exchange method according to another embodiment of the present disclosure;
[0040] Figure 7 A structural diagram of a data exchange system according to another embodiment of the present disclosure;
[0041] Figure 8 An architecture diagram of a data exchange platform according to another embodiment of the present disclosure;
[0042] Figure 9 An organization and operation diagram of a data exchange system according to another embodiment of the present disclosure;
[0043] Figure 10 A structural diagram of an electronic device according to another embodiment of the present disclosure. DETAILED DESCRIPTION
[0044] Public management departments and enterprise groups usually involve various cross-domain organizations, and business systems constructed by different technical routes and institutional mechanisms. Therefore, how to realize multi-source heterogeneous distributed data exchange and integration, and build an interconnected unified data system, has become a problem to be solved.
[0045] In the prior art, the research on data conversion technology includes the following contents:
[0046] In 2004, the second generation of Internet Web2.0 was born, and the development of such a strong interactive website was based on the increasingly complex data format. With the increasing amount of data generated by network applications, the data format is becoming more and more complex, and the traditional relational database systems such as MySQL, Oracle, etc. are not enough in performance when dealing with massive data, and lack of flexibility and responsiveness. Therefore, the joint use of multiple databases has become a basic mode of development, and one of the key problems that need to be solved in the joint use of multiple databases is the mutual transfer and exchange of data between databases. However, when building a heterogeneous multi-database system, programmers must write their own code to implement data interaction between multiple databases in the system, which will increase the workload in the design of large platform systems. At the same time, with the increase in the number of heterogeneous databases, the demand for data transfer solutions will grow exponentially, resulting in more complex database system logic, the need for a large number of external dependencies, difficult environment setup, and poor portability and scalability.
[0047] To solve the above problems, a data exchange scheme based on intermediate data format can be established, which selects a data format as the intermediate data standard for data conversion, realizes the classified storage of different database data and the migration of data between databases (Lu Yan. Research on Heterogeneous Data Exchange Technology Based on XML[D]. Nanchang: Nanchang University, 2011). This data exchange scheme is an application of database intermediate technology, and a complete set of conversion methods and models from database to intermediate data format are developed, which are accessed or called by data users through visual pages or interfaces, greatly reducing the workload of implementing data exchange, and the perfect interface can guarantee better performance stability, improve development efficiency, and also realize the convenient access of client application programs to heterogeneous databases and the storage of heterogeneous data.
[0048] Only about 15% of the data faced by information technology is structured, and the remaining 85% is basically semi-structured or unstructured, and most of these data can be understood as XML format, JSON format or other similar formats.
[0049] 1) XML-based heterogeneous data conversion:
[0050] In the data exchange process, XML document as a logical data module plays a role of intermediate bridge. XML is Extensible Markup Language, which is the standard of Internet data exchange and representation made by W3C (World Wide Web Consortium), and can be used to define data types and mark various data, belonging to the category of Standard Generalized Markup Language, and is widely used in network transmission. Because XML has the characteristics of cross-platform, easy to extend, strong semantics, good human-computer interaction effect, etc., XML is widely used in the exchange of data of heterogeneous data sources in network application (Wei Yanan. Research and design of business information system based on new HFC network[D]. Chongqing: Chongqing University, 2007).
[0051] XML data format conversion between heterogeneous data sources mainly includes three parts: data extraction, data conversion, and data transmission and reception. Data extraction is generally through ODBC (Open Database Connectivity) or JDBC (Java Database Connectivity) to connect the database to extract data, or directly use file method to extract data. Data conversion is to convert the data in the source database into XML metadata, and then parse it into the data type of the target database through operations such as reconstruction, replacement, data type conversion, and time and date format conversion. Data transmission adopts XML format in the form of byte stream, so there is no limit to the size of the transmitted data, but it will cause large data bandwidth occupation in certain scenarios, resulting in low data transfer efficiency between databases (Wenlong. Research and application of unstructured data management based on XML[D]. Hunan: Hunan University, 2009).
[0052] 2) JSON-based heterogeneous data conversion:
[0053] In order to solve the problems of large programming workload and poor scalability of XML, JSON, which can be easily recognized and displayed by the client, can be used for data transmission of WEB application. At the same time, JSON data format is also an ideal intermediate format for data exchange between heterogeneous databases, and there are mutual conversion schemes between most database technologies.
[0054] JSON (JavaScript Object Notation) is a lightweight independent language text data exchange format, which is based on a subset of JavaScript programming language, has good read-write performance, and is convenient for machine to parse and generate. High compatibility of JSON can be used as an intermediate logical data format for data interaction between heterogeneous platforms, which is convenient for developers to quickly master and use.
[0055] JSON designs two structures:
[0056] (1) A collection of Name / Value pairs: In other languages, it is understood as an object, record, structure, dictionary, hash table, key list, or associative array.
[0057] (2) An ordered list of values: In other languages, it is understood as an array, vector, list, or sequence. These are general-purpose data structures that are supported by almost all modern programming languages and can be used as data formats for programming languages.
[0058] In the prior art, there are several data exchange schemes for heterogeneous data sources in different application fields, and these schemes have perfect technical support for different business scenarios.
[0059] In the field of justice, in order to solve the problem of information exchange and sharing between different fields, some countries have proposed NIEM (National Information Exchange Model), which has become the de facto standard for information exchange and sharing between public management departments at all levels in the country after continuous improvement. NIEM allows public management departments to obtain the latest data model to encode their data for data exchange. In order to facilitate information exchange based on NIEM, some organizations have developed a logical entity exchange specification framework (LEXS) that defines the message organization structure, message reference model, message exchange process, and message exchange interface when exchanging information, forming an abstract information exchange framework that can meet different information exchange needs. However, China has not yet appeared a similar solution to LEXS. At the same time, LEXS is not designed for the characteristics of multiple user types, inconsistent data standards, and wide data sources, and cannot meet the data sharing and exchange needs of large organizations.
[0060] Chen Zhi-jian and Hao Zhong-xiao of China proposed a heterogeneous database integration model based on grid and XML, which can cross platforms and systems. The data query request is first converted through the XML data standard, and then connected to the target database system through grid technology node division (Chen Zhi-jian, Hao Zhong-xiao. Heterogeneous database integration model based on grid and XML [J]. Journal of Qiqihar University, 2008, (5): 5-10.).
[0061] In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure clearer, the embodiments of the present disclosure will be described in detail below with reference to the drawings. However, those skilled in the art can understand that, in the embodiments of the present disclosure, many technical details are presented in order to make the readers better understand the present application. However, the technical solutions claimed by the present application can be implemented even without these technical details and based on various changes and modifications of the following embodiments. The division of the following embodiments is for the convenience of description, and should not constitute any limitation on the specific embodiments of the present disclosure, and the embodiments can be combined with each other and referred to each other without contradiction.
[0062] One embodiment of the present disclosure relates to a data exchange method applied to data exchange between a plurality of data exchange agents, the flow of which is as shown in Figure 1 , comprising:
[0063] In step 101, the source data exchange agent obtains the published data exchange model from the data exchange platform, encapsulates the source data to be exchanged into a data packet corresponding to the data exchange model according to the data exchange model, and publishes the data packet to the data exchange platform.
[0064] Specifically, in order to support effective exchange of data in different formats and standards between different organizations, the data exchange platform can store and publish a plurality of data exchange models for each data exchange agent to obtain and use. The data exchange platform is a bridge for data exchange between each data exchange node. Each data exchange node as a data exchange entity can use the data exchange agent and the data exchange platform to exchange data.
[0065] The data exchange agent is a client of data exchange. Each unit participating in data exchange can be a data exchange node, which uses the data exchange agent to exchange data with other units. The data exchange agent can be divided into a source data exchange agent and a destination data exchange agent according to function. The source data exchange agent encapsulates each type of source data to be exchanged into a data packet according to the corresponding type of data exchange model, and publishes each data packet to the data exchange platform for the destination data exchange agent to obtain and use.
[0066] It should be noted that the same data exchange agent can only have the function of a source data exchange agent, or only have the function of a destination data exchange agent, or have both the function of a source data exchange agent and the function of a destination data exchange agent.
[0067] The data exchange model belongs to an intermediate data standard for data exchange of heterogeneous data, and can be used to standardize and guide specific work of data exchange. In the specific implementation technology of the data exchange model, JSON can be used as an intermediate data format for data exchange to construct the data exchange model of heterogeneous data conversion, so as to support efficient and convenient data exchange.
[0068] The source data exchange agent can use the data conversion tool to encapsulate the source data to be exchanged into a corresponding data packet according to the data exchange model, and publish the data packet to the data exchange platform, so as to realize the conversion and adaptation between the source data of the source data exchange agent and the standard data packet generated based on the data exchange model, and complete data reporting, sharing and other operations. The data packet here is similar to a container containing many databases and other information, including the specific contents included in each data option in the data exchange model.
[0069] Optionally, the data exchange model includes sender information, receiver information, time, data packet description, custom field, security level, data exchange rule and at least one data content.
[0070] For example, as shown in Figure 2 The data exchange model can include a header part, a trailer part and a data content part.
[0071] The header part can include standard fields and custom fields. The standard fields belong to information that must be included in each data exchange model. For example, the standard fields can include data packet identification, sender information, receiver information, time, data packet description and security level. The data packet identification is used to uniquely indicate the data packet, so as to be distinguished from other data packets. The sender information can include information such as personnel, organization and contact information of the sender. The receiver information can include information such as personnel, organization and contact information of the receiver. The time can include the generation time and the publishing time of the data packet. The data packet description can include a brief description of the data content in the data packet. Considering the security problem, each data packet needs to include the corresponding security level control information, so the security level corresponding to the data packet can be indicated in the header part to allow the exchange entity of the corresponding level to obtain and use the data packet. The custom field allows the data exchange entity to add custom information according to actual needs, which can include information such as the theme and industry involved in the data packet.
[0072] The trailer part can include data exchange rules, including communication protocols, sharing methods of data packets, exchange methods of data packets, security levels of data packet receivers and various rules related to data packet exchange.
[0073] The data content portion may include one or more data content blocks. Each data content block includes a corresponding header portion and a specific content portion. The header portion of a data content block may include information such as the data content identifier, type, description, and security level. The data content identifier uniquely identifies the data content block and distinguishes it from other data content blocks. The data content type indicates the data type of the specific content in the data content block, including structured data, semi-structured data, and unstructured data. The data content description may include a brief introduction to the data in the specific content portion. For security reasons, the header portion of a data content block may also include information about the data content's security level to allow exchange entities of the corresponding level to access and use the corresponding data content. The specific content portion of a data content block may include standardized SQL (Structured Query Language) / JSON data, standardized XML data such as contract documents, multimedia data such as images and videos, or other types of data, which are not limited in this embodiment. When the data content portion includes multiple data content blocks, the specific content portions of the data content blocks may also be linked to each other to facilitate the destination data exchange agent to parse the specific content portions of the data content blocks.
[0074] In step 102, the destination data exchange agent obtains the data packet from the data exchange platform, parses the data packet based on a data exchange model corresponding to the data packet, and obtains the source data encapsulated in the data packet.
[0075] Specifically, the destination data exchange agent can obtain one or more published data packets from the data exchange platform according to actual needs, and use data conversion tools to parse the data packets based on the data exchange model corresponding to the type of the obtained data packets to obtain the source data encapsulated in the data packets, thereby realizing the conversion and adaptation between the standard data packets generated based on the data exchange model and its own data, and completing data download, use and other operations.
[0076] like Figure 2 As shown, when parsing a data packet, the destination data exchange agent can automatically extract various types of data included in the specific content part of each data content block from the data content part of the data packet based on the data exchange model corresponding to the type of the data packet, thereby obtaining the source data in the data packet.
[0077] The data exchange method is innovative, fully considers the diversity and complexity of data, and is proposed in relation to the characteristics of a large enterprise group, a public management department, and other types of organization data source channels, a large number of data types, and scattered geographical distribution. A source data exchange agent obtains a published data exchange model from a data exchange platform, encapsulates source data to be exchanged into a data package corresponding to the data exchange model according to the data exchange model, and publishes the data package to the data exchange platform. A destination data exchange agent obtains the published data package from the data exchange platform, parses the data package based on the data exchange model corresponding to the data package, and obtains the source data encapsulated in the data package. The data exchange model is simple in format, easy to parse and access, and supports multiple languages. Multiple data exchange agents can perform operations such as "conversion-packing-uploading-sharing" or "downloading-decompression-conversion-use" of their own data according to the data exchange model published by the data exchange platform. The data exchange method solves problems such as data location, data structure, data integrity, and information barriers in data exchange, realizes the interconnection and intercommunication of heterogeneous data, effectively avoids the complex manual data conversion and adaptation process, greatly improves the efficiency of data exchange and sharing, and effectively promotes the flow and use of data.
[0078] Optionally, the method further includes:
[0079] The data exchange platform receives a data type and a data element input by a user, generates and publishes the data exchange model according to the data type and the data element.
[0080] Specifically, to support effective exchange of data in different formats and standards between different organizations, the data exchange model stored and published by the data exchange platform also has a configurable and extensible function to realize the interconnection and intercommunication of data of different sources and types. The data exchange platform can allow data exchange units to design and create custom data types and data elements, diversify data format design, describe and publish data dictionaries, form a sharing standard, support data exchange units to refer to the sharing standard to perform data mapping, extract information from complex raw data, form organized general data structures, and create general and industry-specific data exchange models, data types, and data elements to support cross-organizational, cross-regional, and cross-field data exchange and data sharing.
[0081] The data exchange platform can build a publishing tool through the data exchange model, receive data types and data elements input by a user at any time, create or modify the data exchange model according to the data types and data elements input by the user, and then generate and publish the data exchange model, thereby greatly improving the update and upgrade speed of the data exchange model. The data exchange model building and publishing tool supports dynamically generating a composite data model containing data in JSON, SQL, text, multimedia and other formats, and on this basis, a unified data exchange discourse system is established. Correspondingly, the data exchange platform can also provide a data conversion tool supporting automatic conversion of data in JSON, SQL, text, multimedia and other formats for use by each data exchange agent, thereby realizing sharing and exchange of data in different data formats.
[0082] The data exchange platform can also provide user security management, data package support and other functions, allowing data exchange entities to publish data packages, browse and search interested data packages, subscribe to data time notifications, download data packages and other operations through the data exchange agent according to their respective data exchange permissions.
[0083] By using the data exchange platform to receive data types and data elements input by a user, and generating and publishing a data exchange model according to the data types and data elements input by the user, each data exchange unit and other users can edit, update and publish standard data exchange models at any time, thereby helping large enterprise groups, public management departments and other types of organizations quickly establish an extensible data standard system, quickly expanding various newly added data and personalized data on the basis of effectively supporting basic data sharing and exchange, reducing the complexity of data exchange and improving the credibility of data exchange.
[0084] Optionally, the method further comprises:
[0085] The plurality of data exchange agents build a trusted network based on a blockchain to exchange data through the trusted network, wherein:
[0086] Each data exchange agent stores a block of the blockchain;
[0087] Each block of the blockchain includes a plurality of data blocks, and each data block corresponds to a data exchange agent; and
[0088] Each data block includes a preset data exchange strategy and authorized user information between the data exchange agents.
[0089] Since data exchange of large enterprise groups, public management departments and other organizations often needs to connect cross-domain entities, data exchange requirements are increasing, and single-point centralized data exchange services are difficult to handle increasing loads and guarantee data security. Therefore, in order to solve the above problems, a trusted network for data exchange can be constructed, and related data exchange services can be registered, and multiple data exchange entities across regions can be integrated and organized to work collaboratively. In this trusted network, a blockchain can be used as an underlying security mechanism to realize user authorization management in a distributed data exchange system. Data owners and authorized data users can be freely combined according to the needs of shared exchange to build a flexible data exchange trusted network, which realizes reliable distributed access authorization while guaranteeing data consistency and integrity, and creates a physically distributed and logically centralized data network.
[0090] Specifically, multiple data exchange agents can be constructed into a trusted network according to data exchange requirements between data exchange nodes, or into multiple trusted networks including part of the data exchange agents according to data exchange requirements between data exchange nodes.
[0091] As shown in Figure 3 , the data exchange requirements between the data exchange nodes are that exchange node 1 respectively performs bidirectional data exchange with exchange node 2 and exchange node 3, exchange node 3 performs bidirectional data exchange with exchange node 4, and exchange node 5 performs unidirectional data exchange with exchange node 2, i.e., exchange node 5 shares its own data with exchange node 2.
[0092] According to Figure 3 , the data exchange requirements can be constructed into a trusted network as shown in Figure 4 . Since exchange node 1 needs to respectively perform bidirectional data exchange with exchange node 2 and exchange node 3, and exchange node 3 needs to perform bidirectional data exchange with exchange node 4, exchange node 1 to exchange node 4 need to respectively use their own data exchange agents to communicate and connect with the data exchange agents of the exchange nodes that need to perform bidirectional data exchange through the data exchange platform. Since exchange node 5 needs to share its own data with exchange node 2, it is only necessary to communicate and connect the data exchange agent of exchange node 5 with the data exchange agent of exchange node 2 through the data exchange platform. In addition, since Figure 3 , exchange node 1 in the trusted network can also obtain the data shared by exchange node 5 with exchange node 2 from exchange node 2, i.e., exchange node 1 also needs to obtain the data shared by exchange node 5, therefore, as shown in Figure 4 , the data exchange agent of exchange node 5 can also be communicated and connected with the data exchange agent of exchange node 1 through the data exchange platform, so that exchange node 1 can directly obtain the data shared by exchange node 5, without having to obtain it through exchange node 2, thereby improving the efficiency of data exchange.
[0093] The trusted network service can host a blockchain-based electronic contract service at each data exchange agent. The administrator of each data exchange node can apply to connect their data exchange agent to other data exchange agents. Once the administrator of the data exchange node where the other data exchange agents reside approves the application, the data exchange agreement and authorized user information of each data exchange node will be added to the blockchain. The administrators of different data exchange nodes must agree on a set of data usage and access control policies. Once these data usage and access control policies are agreed upon, they will also be added to the blockchain. Based on these data usage and access control policies, automated data forwarding can be achieved.
[0094] Each data exchange agent in the trusted network stores a blockchain, each consisting of multiple data blocks. The number of data blocks in each blockchain is the same as the number of data exchange agents in the trusted network, and each data block corresponds to a data exchange agent. In other words, each data block in the blockchain corresponds one-to-one with a data exchange agent in the trusted network. Each data block includes the data exchange policy and authorized user information preset between each data exchange agent in the trusted network, enabling each data exchange agent to exchange data based on the data exchange policy and authorized user information. The data blocks in the blockchain are connected together to provide corresponding functions.
[0095] For example, due to Figure 4 The trusted network shown includes five data exchange agents, so Figure 5 As shown, the blockchain stored in the data exchange agent of exchange node 1 may include five data blocks, each corresponding to a data exchange agent of one exchange node. The data block labeled "Unit 1" corresponds to the data exchange agent of exchange node 1, the data block labeled "Unit 2" corresponds to the data exchange agent of exchange node 2, the data block labeled "Unit 3" corresponds to the data exchange agent of exchange node 3, the data block labeled "Unit 4" corresponds to the data exchange agent of exchange node 4, and the data block labeled "Unit 5" corresponds to the data exchange agent of exchange node 5. The asterisk * in the data blocks labeled "Unit 1" and "Unit 5" indicates the local unit, i.e., the unit that exchanges data through exchange node 1.
[0096] Each data exchange agent can use the data exchange platform to set authorized user information and data exchange policies by signing digital contracts and other methods, and build a trusted network based on blockchain, thereby realizing access authorization between each data exchange agent in the trusted network, as well as automated data reporting, uploading, pushing, downloading, etc.
[0097] The embodiment takes blockchain technology as an underlying authentication and authorization management technology, constructs an interconnected and interoperable data exchange trusted network, so that organizations at all levels and of all types can perform distributed sharing and exchange of complex data in a secure environment. The characteristics of the blockchain, which does not require a central institution to endorse trust, enable the embodiment to be applicable to large-scale cross-domain data exchange application scenarios. At the same time, the characteristics of the blockchain network, which is decentralized and cannot tamper with transactions, make the original authentication and authorization conditions that require intermediary platforms no longer exist.
[0098] Optionally, the data block comprises a block creation timestamp, a block belonging unit identifier, an encryption authorization block, a block checksum, a hash value of a current data block, a hash value of a previous data block, and a name of a next data block.
[0099] Specifically, the block creation timestamp is used to indicate the creation time of the data block. The block belonging unit identifier is used to indicate the data exchange unit to which the data exchange agent corresponding to the data block belongs. The encryption authorization block can include unit information, unit user security information, and content access policy of the data exchange unit to which the data exchange agent corresponding to the data block belongs.
[0100] For example, as shown in Figure 5 The data block marked as Unit 1 can include a block creation timestamp, a block belonging unit identifier, a block checksum, an encryption authorization block, a hash value of a current data block, a hash value of a previous data block, and a name of a next data block. The unit information can include exchange nodes, unit identifiers, names, contact information, and unit security levels / classifications, IP addresses of FTP (File Transfer Protocol) servers, usernames, and passwords. The unit user security information can include unit administrator information and data administrator information, both of which can include the names, usernames, passwords, roles, security levels, and contact information of the relevant administrators. The content access policy can include authorization policies of other units, such as authorization policies of Unit 1, Unit 2, Unit 3, etc. Each unit's authorization policy can include data categories, exchange methods, browsing / download / subscription / pushing, etc.
[0101] To enable those skilled in the art to better understand the above method, the following will be described with a specific example.
[0102] As shown in Figure 6As shown, the trusted community is built by at least 5 exchange nodes through a trusted network. The data exchange platform can receive relevant information input by a user through a data model to dynamically build a publishing tool, dynamically generate and publish a data exchange model. The data exchange agent in the exchange node 5 acts as a source data exchange agent, obtains the published data exchange model from the data exchange platform, encapsulates a data packet according to the data exchange model, and publishes the data packet to the data exchange platform. The data exchange agent in the exchange node 1 acts as a destination data exchange agent, obtains the data packet from the data exchange platform on demand, and parses the data packet based on the data exchange model corresponding to the data packet to obtain the source data encapsulated in the data packet.
[0103] Another embodiment of the present disclosure relates to a data exchange system, such as Figure 7 As shown, the system includes a data exchange platform 701 and a plurality of data exchange agents in communication connection with the data exchange platform 701, wherein:
[0104] The source data exchange agent 702 is configured to obtain the published data exchange model from the data exchange platform 701, encapsulate the source data to be exchanged into a data packet corresponding to the data exchange model according to the data exchange model, and publish the data packet to the data exchange platform 701.
[0105] The destination data exchange agent 703 is configured to obtain the data packet from the data exchange platform 701, parse the data packet based on the data exchange model corresponding to the data packet to obtain the source data encapsulated in the data packet.
[0106] Optionally, the data exchange platform 701 is configured to receive data types and data elements input by a user, generate and publish a data exchange model according to the data types and the data elements.
[0107] Optionally, the plurality of data exchange agents are built into a trusted network based on a block chain, and data exchange is performed through the trusted network, wherein:
[0108] Each of the data exchange agents stores a block chain.
[0109] Each of the block chains includes a plurality of data blocks, and each of the data blocks corresponds to one of the data exchange agents; and
[0110] Each of the data blocks includes a preset data exchange strategy and authorized user information between the data exchange agents.
[0111] Optionally, the data block includes a block creation timestamp, a block belonging unit identifier, an encrypted authorized block, a block checksum, a hash value of a current data block, a hash value of a previous data block, and a name of a next data block.
[0112] Optionally, the data exchange model comprises sender information, receiver information, time, data packet description, custom field, security level, data exchange rule and at least one data content.
[0113] The specific implementation method of the data exchange system provided by the embodiment of the present disclosure can be referred to the data exchange method provided by the embodiment of the present disclosure, which will not be described here.
[0114] The embodiment of the present disclosure, relative to the prior art, around the large enterprise group, public management department and other types of organization data source channel, data types, geographical distribution of scattered characteristics, fully consider the diversity and complexity of data, innovatively puts forward a kind of data exchange system, source data exchange agent obtains the published data exchange model from data exchange platform, according to data exchange model, the source data to be exchanged is packaged into the data packet corresponding to the data exchange model, and the data packet is published to the data exchange platform, the destination data exchange agent obtains the published data packet from the data exchange platform, based on the data exchange model corresponding to the data packet, the data packet is parsed, and the source data packaged in the data packet is obtained, the data exchange model format is simple, easy to parse and access, supports multiple languages, multiple data exchange agents can perform "conversion-packing-uploading-sharing" or "downloading-decompression-conversion-use" operation on their own data according to the data exchange model published by the data exchange platform, solve the problems of data location, data structure, data integrity and information barrier in data exchange, realize the interconnection of heterogeneous data, effectively avoid the complex manual data conversion adaptation process, greatly improve the efficiency of data exchange and sharing, and effectively promote the flow and use of data.
[0115] In order for those skilled in the art to better understand the above embodiments, the following is described with a specific example.
[0116] The data exchange platform in the data exchange system can provide standard data exchange model creation tools and data exchange services, support authorized users or organizations to share heterogeneous data in a unified and secure manner, and support various applications to obtain stable, accurate and high-speed data services through standardized methods. Figure 8As shown, the architecture of the data exchange platform includes a data exchange model construction and publishing part and a data exchange part. The data exchange model construction and publishing part includes exchange model and service, flexible data exchange template editing, and standardized dictionary editing. The exchange model and service includes pushing, publishing, browsing / searching, subscribing / notifying, and downloading of the data exchange model. The flexible data exchange template editing includes data block message definition standard and data packet exchange rule definition standard. The standardized dictionary editing includes SQL dictionary, JSON dictionary, XSD (XML Schema Definition) dictionary, data parsing algorithm, data conversion formula, and tool.
[0117] As shown in Figure 9 , the data exchange platform shown in Figure 8 , the organization and operation mode of the data exchange system can include:
[0118] The data exchange model construction and publishing tool in the data exchange platform generates the article data exchange model, the personnel data exchange model, and the event data exchange model using the data dictionary of the background processing part, and publishes the three types of data exchange models to the personalized data sharing and exchange portal. The data user can view data exchange information, view data models, download data conversion tools, perform data download and data upload, and the like using the data exchange agent from the personalized data sharing and exchange portal. The data exchange platform can perform data conversion and adaptation on the data packets in the exchange library through background processing when providing data exchange services. The data exchange platform can also implement data exchange through the data exchange service module. The data exchange agent can download the data packets in the exchange library through the personalized data sharing and exchange portal, and upload its own data packets to the exchange library through the personalized data sharing and exchange portal, or perform data packet reporting work. The data exchange agent can also upload data to the sFTP (Secret File Transfer Protocol) server in the data exchange service module through manual or programmatic methods. The data exchange service module can also provide push services for the FTP services of external organizations in the data exchange agent.
[0119] Another embodiment of the present disclosure relates to an electronic device, as shown in Figure 10 , comprising:
[0120] at least one processor 1001; and
[0121] a memory 1002 in communication connection with the at least one processor 1001; wherein
[0122] The memory 1002 stores instructions that are executable by the at least one processor, and the instructions are executed by the at least one processor 1001 to enable the at least one processor 1001 to perform the methods described in the above embodiments.
[0123] The memory and the processor are connected by a bus, which can include any number of interconnecting buses and bridges, and the bus connects the various circuits of the one or more processors and the memory together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further. The bus interface provides an interface between the bus and the transceiver. The transceiver can be a single element or multiple elements, such as a plurality of receivers and transmitters, which provides a means for communicating with various other apparatuses over a transmission medium. The data processed by the processor is transmitted over the wireless medium through the antenna, and further, the antenna also receives data and transmits the data to the processor.
[0124] The processor is responsible for managing the bus and general processing, and can also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory can be used to store data used by the processor during execution of operations.
[0125] Another embodiment of the present disclosure relates to a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method described in the above embodiments.
[0126] That is, those skilled in the art can understand that all or part of the steps of the methods described in the above embodiments can be completed by programs instructing relevant hardware, and the programs are stored in a storage medium, including a plurality of instructions for enabling a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to perform all or part of the steps of the methods described in the embodiments of the present disclosure. The aforementioned storage medium includes a U disk, a mobile hard disk, a ROM (Read-Only Memory), a RAM (Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.
[0127] Those skilled in the art can understand that the above embodiments are specific embodiments for implementing the present disclosure, and in actual applications, various changes can be made in form and details without departing from the spirit and scope of the present disclosure.
Claims
1. A data exchange method, characterized by, A method applied to data exchange between a plurality of data exchange agents, the method comprising: A source data exchange agent obtains a published data exchange model from a data exchange platform, encapsulates source data to be exchanged into a data package corresponding to the data exchange model according to the data exchange model, and publishes the data package to the data exchange platform; A destination data exchange agent obtains the data package from the data exchange platform, parses the data package based on a data exchange model corresponding to the data package, and obtains the source data encapsulated in the data package; The data exchange model is dynamically generated, stored and published by the data exchange platform for each data exchange agent to obtain and use; the data exchange model is an intermediate data standard for heterogeneous data exchange to support effective exchange of data in different formats.
2. The method of claim 1, wherein, The method further comprises: The data exchange platform receives data types and data elements input by a user, generates and publishes the data exchange model according to the data types and the data elements.
3. The method of claim 1, wherein, The method further comprises: A plurality of data exchange agents construct a trusted network based on a blockchain to exchange data through the trusted network, wherein: Each data exchange agent stores a block chain respectively; Each block chain comprises a plurality of data blocks, and each data block corresponds to a data exchange agent respectively; and Each data block comprises a preset data exchange strategy and authorized user information between the data exchange agents.
4. The method of claim 3, wherein, The data block comprises a block creation timestamp, a block belonging unit identifier, an encrypted authorized block, a block checksum, a current data block hash value, a previous data block hash value, and a next data block name.
5. The method according to any one of claims 1 to 4, characterized in that, The data exchange model comprises sender information, receiver information, time, data package description, custom fields, security level, data exchange rules, and at least one data content.
6. A data exchange system, characterized by The system comprises a data exchange platform and a plurality of data exchange agents in communication connection with the data exchange platform, wherein: A source data exchange agent obtains a published data exchange model from the data exchange platform, encapsulates source data to be exchanged into a data package corresponding to the data exchange model according to the data exchange model, and publishes the data package to the data exchange platform; A destination data exchange agent obtains the data package from the data exchange platform, parses the data package based on a data exchange model corresponding to the data package, and obtains the source data encapsulated in the data package; The data exchange model is dynamically generated, stored and published by the data exchange platform for each data exchange agent to obtain and use; the data exchange model is an intermediate data standard for heterogeneous data exchange to support effective exchange of data in different formats.
7. The system of claim 6, wherein: The data exchange platform receives data types and data elements input by a user, generates and publishes the data exchange model according to the data types and the data elements.
8. The system of claim 6, wherein, A plurality of the data exchange agents are constructed into a trusted network based on a blockchain, and data exchange is performed through the trusted network, wherein: Each of the data exchange agents stores one of the blockchains; Each of the blockchains comprises a plurality of data blocks, and each of the data blocks corresponds to one of the data exchange agents; and Each of the data blocks comprises preset data exchange strategies and authorized user information among the data exchange agents.
9. An electronic device, comprising: comprise: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 5.
10. A computer readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor to implement the method of any one of claims 1 to 5.
Citation Information
Patent Citations
Data management method and related product
CN110110006A
Data transmission method, device and system based on programmable network switching technology
CN110247908A
Electric power big data exchange method and system based on block chain
CN112036886A