Method and system for using public data flow

Abstract

The invention relates to the technical field of public data opening, in particular to a public data circulation and use method and system, and the method comprises the following steps: a government affair big data platform pushes metadata information of public data which can be used for operation to a public data authorization operation platform through a public data labeling process; the data demander judges whether the required public data is unconditionally operated on the public data authorization operation platform, and if yes, the data demander directly uses the required public data; the public data circulation and use method and system provided by the invention have the beneficial effects that accurate classification and grading of public data and clarification of operation conditions are realized by opening a government affair big data platform and a public data authorization operation platform, and scientificity and normalization of public data management are remarkably improved. Meanwhile, a credible data space is provided, and it is effectively guaranteed that original data are not out of the domain.

Description

Technical Field

[0001] The present invention relates to the field of public data opening technology, and in particular to a method and system for circulating and using public data. Background Art

[0002] With the in-depth development of the information age, various regions and departments have actively built and optimized government big data platforms, realized the centralized storage of massive public data, and significantly improved the efficiency of information sharing and business collaboration among government departments. However, as a new production factor, how to further promote the internal and external circulation of public data in the government big data platform, especially to achieve the integration and application of social data outside the government under the premise of ensuring data security, has become a key issue that needs to be solved urgently.

[0003] Specifically, the core challenges currently faced include:

[0004] 1. Definition of the scope of data operations: It is necessary to use advanced data classification and grading technologies, combined with laws, regulations and policy requirements, to clearly define which public data are suitable for public data operations to ensure the effective use and compliance of data.

[0005] 2. Data application and authorization mechanism: It is necessary to establish a data application and authorization mechanism based on blockchain technology to ensure that data demanders can submit data applications conveniently and in compliance with regulations, and obtain access to and use rights to the required data through a strict review and authorization process.

[0006] 3. Original data protection: In the process of data circulation and use, advanced data encryption, desensitization and access control technologies need to be adopted to ensure that the original data does not leave the domain and the data can be circulated and used in an invisible way. Through technologies such as distributed architecture and trusted data space, data can be stored, transmitted and used securely to avoid data retention, uncontrolled copying, dissemination and abuse.

[0007] The resolution of these problems will be directly related to whether the government big data platform can fully realize its due value and promote the in-depth development of the government's digital transformation. It will also help promote the deep integration of the digital economy and the real economy and inject new impetus into economic and social development. Summary of the invention

[0008] The object of the present invention is to provide a method and system for circulating and using public data to solve the problems raised in the above-mentioned background technology.

[0009] To achieve the above object, the present invention provides the following technical solution: a method for circulating and using public data, the method comprising the following steps:

[0010] S1: The government big data platform pushes metadata information of public data that can be used for operation to the public data authorization operation platform through the public data labeling process;

[0011] S2: The data demander determines whether the required public data is unconditionally operated on the public data authorization operation platform. If so, it is used directly; if not, it goes to step S3;

[0012] S3: The demander submits the required public data application to the government big data platform on the public data authorization operation platform;

[0013] S4: The data provider determines whether to authorize the required public data through the public data authorization approval process on the government big data platform. If not, it returns to step S2; if yes, it goes to step S5;

[0014] S5: The demander uses authorized data in the trusted data space to ensure that the original data does not leave the domain and the data is available but not visible.

[0015] Preferably, the government big data platform pushes metadata information of operational public data to the public data authorization operation platform through a one-way message mechanism, and supports real-time push of change information.

[0016] Preferably, the public data authorization operation platform provides full-process services for data authorization development and operation, including authorization operation management, data resource management, data product services, and supporting service functions, while ensuring that "the original data does not leave the domain and the data is available but not visible".

[0017] Preferably, the public data labeling process includes:

[0018] A1: The big data management department shall formulate the classification and grading standards for public data on the government big data platform;

[0019] A2: The big data management department issues classification and grading standards to each public data provider, and each data provider classifies and grades public data;

[0020] A3: Each data provider labels the data based on the classification and grading results to determine whether it can be used for public data operations;

[0021] A4: Determine whether the data that can be used for operations can be used for operations without authorization, and label it as unconditional operation or conditional operation accordingly;

[0022] A5: The government big data platform synchronizes the metadata information of operational public data to the public data authorization operation platform.

[0023] Preferably, the public data authorization approval process includes:

[0024] B1: The government big data platform receives the application, and the system automatically determines whether the public data requested has authorization records for the industry and application scenario;

[0025] B2: If there is an authorization record, the big data management department will determine whether the public data provider department needs to re-authorize based on the application purpose. If not, the system will automatically approve and file it. If yes, go to step B3;

[0026] B3: If there is no authorization record or repeated authorization is required, the department providing the public data will determine whether to authorize.

[0027] A public data circulation and utilization system, comprising:

[0028] Government big data platform: used to store public data and push metadata information of public data that can be used for operations to the public data authorization operation platform through the public data labeling process;

[0029] Public data authorization operation platform: used to receive metadata information pushed by the government big data platform, and allow data demanders to determine whether the required public data can be operated unconditionally. If not, submit an application to the government big data platform;

[0030] Trusted data space: used to provide a secure environment for data use after the data demander obtains authorization, ensuring that the original data does not leave the domain and the data is available but not visible;

[0031] Data provider: responsible for classifying and grading public data on the government big data platform, and making authorization decisions on applications based on the public data authorization and approval process.

[0032] Preferably, the government big data platform also pushes the change information of the pushed data, including editing and delisting, to the public data authorization operation platform in real time through a one-way message mechanism.

[0033] Preferably, the public data authorization operation platform provides the following functions:

[0034] Authorization operation management: manage the entire process of data authorization;

[0035] Data resource management: manage metadata information of public data;

[0036] Data product services: providing data products and services based on authorized data;

[0037] Support services: Provide technical support to data managers, data providers, and data application units.

[0038] Preferably, the public data metadata information includes data name, data description information, data providing department, data item information, data generation frequency, data generation method, data structured characteristics, data storage method and open conditions, and the data item information contains different detailed information depending on the data type.

[0039] Preferably, the public data authorization approval process includes the following steps:

[0040] Receiving applications: The government big data platform receives applications from data demanders;

[0041] Automatic judgment: The system automatically judges whether the public data applied for has authorization records for the corresponding industry fields and application scenarios;

[0042] Duplicate authorization judgment: If there is an authorization record, the big data management department will determine whether duplicate authorization is required based on the intended use;

[0043] Authorization decision: If repeated authorization is not required, the system will automatically approve and file it; otherwise, the public data provider department will decide whether to authorize it.

[0044] Compared with the prior art, the present invention has the following beneficial effects:

[0045] The method and system for the circulation and use of public data proposed in the present invention realizes the accurate classification and grading of public data and the clarification of operating conditions by connecting the government big data platform and the public data authorization operation platform, significantly improving the scientificity and standardization of public data management. At the same time, the present invention provides a trusted data space, effectively ensuring that the original data does not leave the domain, and the original data does not leave the domain during the circulation and use of the data. The data is available but invisible, which greatly enhances the security and privacy protection capabilities of the data. In addition, the present invention also promotes the deep integration and application of public data and social data, breaks the data island, realizes the efficient circulation and use of public data, provides strong support for the digital transformation of the government, and promotes the deep integration and development of the digital economy and the real economy. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 This is a schematic diagram of the circulation and use of public data of the present invention;

[0047] Figure 2 A flow chart for labeling public data of the present invention;

[0048] Figure 3 This is the public data authorization approval flow chart of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose and technical solution of the present invention clearly and completely described, and the advantages more clearly understood, the embodiments of the present invention are further described in detail with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are part of the embodiments of the present invention, rather than all of the embodiments, and are only used to explain the embodiments of the present invention, and are not used to limit the embodiments of the present invention. All other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] For example, see Figures 1 to 3 The present invention provides a technical solution: a method for circulating and using public data, the method comprising the following steps:

[0051] Step S1: The government big data platform pushes the metadata information of public data that can be used for operation to the public data authorization operation platform through the public data labeling process.

[0052] Step S2: The data demander determines whether the required public data is unconditionally operated on the public data authorization operation platform.

[0053] If so, the demander can directly use public data.

[0054] If not, then go to step S3.

[0055] Step S3: The demander submits an application for the required public data to the government big data platform on the public data authorization operation platform.

[0056] In step S4, the data provider determines whether to authorize the required public data through the public data authorization approval process on the government big data platform.

[0057] If not, then go to step S2 and reselect the required data according to the rejection reason.

[0058] If yes, then go to step S5.

[0059] In step S5, the demander uses the authorized data in the trusted data space, ensuring that the original data does not leave the domain and the data is available but not visible.

[0060] Preferably, the government big data platform pushes metadata information of operational public data to the public data authorization operation platform through a one-way message mechanism. It supports pushing public data that can be used for operation on the government big data platform, including historical data and new data, after labeling. It also supports real-time push of change information to the public data authorization operation platform after changes occur to the pushed data, including editing and delisting.

[0061] Preferably, the public data authorization operation platform refers to a technical platform that provides data authorization development and operation services throughout the entire process through traceable authorization, reliable supply, trusted processing, controllable services and security technologies, while ensuring that the original data of public data does not leave the domain and the data is available but not visible. It provides functions such as authorization operation management, data resource management, data product services, and support services for data supervisors, data providers, authorization operators, and data applications.

[0062] Preferably, the public data metadata information includes data name, data description information, data providing department, data item information, data generation frequency, data generation method, data structuring characteristics, data storage method, open conditions and other information.

[0063] Preferably, the data item information of structured data usually corresponds to a field in the data or a specific attribute in a record; the unstructured data item information can be a word, phrase or sentence in a text, a pixel or feature in an image, a frame in a video, etc.

[0064] Preferably, the data generation frequency includes every second, minute, hour, day, week, month, quarter, half year, year, irregular cycle, and no update.

[0065] Preferably, the data generation methods include manually collected data, secondary processed data, data generated by information systems, data generated by sensing devices, and original data.

[0066] Preferably, the data structuring features include structured data, board structured data and unstructured data.

[0067] Preferably, data storage methods include relational databases, key-value databases, columnar databases, graph databases, and document databases.

[0068] Preferably, the demander can better understand the data through metadata information, so as to make a more accurate data application.

[0069] Preferably, the types of public data that can be used for operations are divided into unconditional operations and conditional operations. The data that can be used for operations can be applied for on the operation platform. The data for unconditional operations can be used directly without obtaining authorization, while the data for conditional operations needs to be authorized before use. When the demander uses the data for unconditional operations, it is also necessary to initiate a data application. The public data operation platform will automatically authorize it and file it on the government big data platform to ensure that the use of data is traceable.

[0070] Preferably, the demander should comply with the principle of minimum data usage when applying for resources, be specific to the field when applying for structured data, clearly state the purpose of use, and use the data only to the extent required to achieve that purpose.

[0071] Preferably, the demander needs to select the industry field and application scenario for data use when submitting a public data application. Industry fields generally include market supervision, education and technology, culture and leisure, geospatial, social security and employment, health and medical institutions and groups, urban construction and housing, trade and industry, public safety, credit services, transportation, meteorological services, comprehensive government affairs, social assistance, finance and taxation, safety supervision, agriculture and rural areas, resources and environment. Application scenarios need to be set according to industry fields. For example, the finance and taxation field includes risk management, tax management, performance evaluation, intelligent tax consulting, and financial and taxation risk warning.

[0072] Preferably, the trusted data space promotes the efficient circulation and utilization of data, and effectively solves the long-standing security and trust issues among multiple parties such as data element providers, users, service providers, and regulators. In the trusted data space, the demander can perform privacy computing to ensure that there is no need to directly access plaintext data during the entire process of data processing and use, thereby greatly reducing the risk of data leakage. Data can only be further calculated and applied after being encrypted in a trusted environment. This mechanism implements the principle that the original data does not leave the domain, that is, the data can be necessary for computing and processing without leaving its original storage environment. In addition, the invisible nature of data not only meets the needs of data use, but also ensures the privacy and security of data, providing strong technical support for data sharing and circulation.

[0073] Preferably, the public data labeling process includes:

[0074] Step A1: The big data management department shall formulate the classification and grading standards for public data on the government big data platform.

[0075] Step A2: The big data management department issues classification and grading standards to each public data provider, and each data provider classifies and grades public data.

[0076] In step A3, each data provider labels the data based on the classification and grading results to determine whether it can be used for public data operations.

[0077] If not, then tagging is not operational.

[0078] If yes, then go to step A4.

[0079] Step A4: determine whether the data that can be used for operation can be used for operation without authorization.

[0080] If so, then labeling will operate unconditionally.

[0081] If no, then labeling is conditional.

[0082] Step A5: The government big data platform synchronizes the metadata information of the operational public data to the public data authorization operation platform.

[0083] Preferably, the big data management department can formulate local standards based on standards such as the National Economic Industry Classification (GB / T 4754-2017), General Terminology of Classification and Coding (GB / T 10113-2003), Information Security Technical Terminology (GB / T25069-2010), Information Technology Big Data Terminology (GB / T 35295-2017), and Information Technology Big Data Data Classification Guide (GB / T 38667-2020).

[0084] According to the open attributes of public data, it can be divided into three categories:

[0085] Prohibited data include: data that endangers national security, public security, economic security, and social stability after being disclosed; data that involves commercial secrets or personal privacy; data that is prohibited from being disclosed due to data acquisition agreements or intellectual property protection; and data that cannot be disclosed according to laws and regulations. Such public data should be labeled as non-operational data.

[0086] Restricted open categories include: data involving commercial secrets and personal privacy, which are open to specific citizens, legal persons or other organizations and are not prohibited by laws and regulations; data that will seriously squeeze public infrastructure resources and affect the efficiency of public data processing; data that are difficult to assess for security risks; and data that are prohibited from being opened after being desensitized and processed in accordance with the law. Such data can be labeled as conditional operational data.

[0087] Unconditionally open data includes: other public data except prohibited and restricted public data; and public data in prohibited and restricted public data that have been desensitized. Such data can be labeled as unconditionally operational data.

[0088] Preferably, the public data authorization approval process includes:

[0089] Step B1: The government big data platform receives the application, and the system automatically determines whether the public data requested has an authorization record for the industry field and application scenario.

[0090] If yes, then go to step B2.

[0091] If not, go to step B3.

[0092] Step B2: The big data management department determines whether repeated authorization is required from the public data provider based on the application purpose.

[0093] If not, the government big data platform system will automatically approve and file it.

[0094] If yes, then go to step B3.

[0095] In step B3, the department providing the public data determines whether to authorize.

[0096] Embodiment 2, based on embodiment 1, proposes a public data circulation and use system, the system comprising:

[0097] Government big data platform: used to store public data and push metadata information of public data that can be used for operations to the public data authorization operation platform through the public data labeling process; the government big data platform also pushes change information of pushed data, including editing and delisting, to the public data authorization operation platform in real time through a one-way message mechanism.

[0098] Public data authorization operation platform: used to receive metadata information pushed by the government big data platform, and allow data demanders to determine whether the required public data is unconditionally operated. If not, submit an application to the government big data platform; the public data authorization operation platform provides the following functions:

[0099] Authorization operation management: manage the entire process of data authorization;

[0100] Data resource management: manage metadata information of public data;

[0101] Data product services: providing data products and services based on authorized data;

[0102] Support services: Provide technical support to data managers, data providers, and data application units.

[0103] Trusted data space: used to provide a secure environment for data use after the data demander obtains authorization, ensuring that the original data does not leave the domain and the data is available but not visible;

[0104] Data provider: responsible for classifying and grading public data on the government big data platform, and making authorization decisions on applications based on the public data authorization and approval process.

[0105] Public data metadata information includes data name, data description information, data providing department, data item information, data generation frequency, data generation method, data structured characteristics, data storage method and open conditions, and the data item information contains different detailed information depending on the data type.

[0106] The public data authorization approval process includes the following steps:

[0107] Receiving applications: The government big data platform receives applications from data demanders;

[0108] Automatic judgment: The system automatically judges whether the public data applied for has authorization records for the corresponding industry fields and application scenarios;

[0109] Duplicate authorization judgment: If there is an authorization record, the big data management department will determine whether duplicate authorization is required based on the intended use;

[0110] Authorization decision: If repeated authorization is not required, the system will automatically approve and file it; otherwise, the public data provider department will decide whether to authorize it.

[0111] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for circulating and using public data, characterized in that: The method comprises the following steps: S1: The government big data platform pushes metadata information of public data that can be used for operation to the public data authorization operation platform through the public data labeling process; S2: The data demander determines whether the required public data is unconditionally operated on the public data authorization operation platform. If so, it is used directly; if not, it goes to step S3; S3: The demander submits the required public data application to the government big data platform on the public data authorization operation platform; S4: The data provider determines whether to authorize the required public data through the public data authorization approval process on the government big data platform. If not, it returns to step S2; if yes, it goes to step S5; S5: The demander uses authorized data in the trusted data space to ensure that the original data does not leave the domain and the data is available but not visible.

2. A method for circulating and using public data according to claim 1, characterized in that: The government big data platform uses a one-way messaging mechanism to push metadata information of operational public data to the public data authorization operation platform, and supports real-time push of change information.

3. A method for circulating and using public data according to claim 1, characterized in that: The public data authorization operation platform provides full-process services for data authorization development and operation, including authorization operation management, data resource management, data product services, and supporting service functions, while ensuring that "original data does not leave the domain and data is available but not visible".

4. A method for circulating and using public data according to claim 1, characterized in that: The public data labeling process includes: A1: The big data management department shall formulate the classification and grading standards for public data on the government big data platform; A2: The big data management department issues classification and grading standards to each public data provider, and each data provider classifies and grades public data; A3: Each data provider labels the data based on the classification and grading results to determine whether it can be used for public data operations; A4: Determine whether the data that can be used for operations can be used for operations without authorization, and label it as unconditional operation or conditional operation accordingly; A5: The government big data platform synchronizes the metadata information of operational public data to the public data authorization operation platform.

5. The method for circulating and using public data according to claim 1, characterized in that: The public data authorization approval process includes: B1: The government big data platform receives the application, and the system automatically determines whether the public data requested has authorization records for the industry and application scenario; B2: If there is an authorization record, the big data management department will determine whether the public data provider department needs to re-authorize based on the application purpose. If not, the system will automatically approve and file it. If yes, go to step B3; B3: If there is no authorization record or repeated authorization is required, the department providing the public data will determine whether to authorize.

6. A public data circulation and utilization system according to the method for circulating and utilizing public data according to any one of claims 1 to 5, characterized in that: The system comprises: Government big data platform: used to store public data and push metadata information of public data that can be used for operations to the public data authorization operation platform through the public data labeling process; Public data authorization operation platform: used to receive metadata information pushed by the government big data platform, and allow data demanders to determine whether the required public data can be operated unconditionally. If not, submit an application to the government big data platform; Trusted data space: used to provide a secure environment for data use after the data demander obtains authorization, ensuring that the original data does not leave the domain and the data is available but not visible; Data provider: responsible for classifying and grading public data on the government big data platform, and making authorization decisions on applications based on the public data authorization and approval process.

7. A public data circulation and utilization system according to claim 6, characterized in that: The government big data platform also pushes change information of pushed data, including editing and delisting, to the public data authorization operation platform in real time through a one-way messaging mechanism.

8. A public data circulation and utilization system according to claim 6, characterized in that: The public data authorization operation platform provides the following functions: Authorization operation management: manage the entire process of data authorization; Data resource management: manage metadata information of public data; Data product services: providing data products and services based on authorized data; Support services: Provide technical support to data managers, data providers, and data application units.

9. A public data circulation and utilization system according to claim 6, characterized in that: Public data metadata information includes data name, data description information, data providing department, data item information, data generation frequency, data generation method, data structured characteristics, data storage method and open conditions, and the data item information contains different detailed information depending on the data type.

10. A public data circulation and utilization system according to claim 6, characterized in that: The public data authorization approval process includes the following steps: Receiving applications: The government big data platform receives applications from data demanders; Automatic judgment: The system automatically judges whether the public data applied for has authorization records for the corresponding industry fields and application scenarios; Duplicate authorization judgment: If there is an authorization record, the big data management department will determine whether duplicate authorization is required based on the intended use; Authorization decision: If repeated authorization is not required, the system will automatically approve and file it; otherwise, the public data provider department will decide whether to authorize it.

Images