Smart city big data management method and system, sharing platform and medium

Abstract

The invention relates to the technical field of data management, in particular to a smart city big data management method and system, a sharing platform and a medium, and the method comprises the steps: obtaining a city data sharing standard, and transmitting the city data sharing standard to each department information platform. And then, acquiring a city data sharing interface, and establishing a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface. And then, standard city data is acquired by using the city data sharing interface, data verification is performed based on the standard city data, and the target city data passing the data verification is stored in the city sharing database. The city data sharing standard and the city data sharing interface jointly form a complete normative system of data uploading and transmission, communication between the smart city sharing platform and a department information platform is achieved, the situation of information islands is broken, data sharing and integration among departments are achieved, and therefore the construction process of the smart city is promoted.

Description

Technical Field

[0001] The present application relates to the technical field of data management, and in particular to a smart city big data management method, system, sharing platform and medium. Background Art

[0002] With the continuous development of modern urban construction, smart city management has become an important direction of current urban management. Smart city management refers to the use of modern scientific and technological means such as the Internet of Things, big data, and cloud computing to conduct comprehensive digital and intelligent management and services for cities, so as to improve the efficiency and quality of urban management and services, and improve the city's environment, transportation, and quality of life.

[0003] In the process of building smart cities, it is necessary to realize data sharing and integration between different fields and departments. The data sources of smart cities are very extensive, including transportation, public safety, environment, energy, education and other fields. However, data sources are often scattered in information platforms independently built by different departments, each of which is closed and lacks a unified data sharing mechanism and standardized interface, forming many information islands, which makes cross-domain and cross-department data sharing and integration operations difficult.

[0004] Therefore, how to solve the above technical defects is an urgent problem to be solved by those skilled in the art. Summary of the invention

[0005] The purpose of this application is to provide a smart city big data management method, system, sharing platform and medium to solve at least one of the above technical problems.

[0006] The above invention objectives of the present application are achieved through the following technical solutions: In the first aspect, the present application provides a smart city big data management method, which adopts the following technical solutions: A smart city big data management method, executed by a smart city sharing platform, comprising: Obtaining the city data sharing standard and sending the city data sharing standard to each department information platform, wherein the department information platform is a platform independently built and managed by departments in different fields, and the smart city sharing platform is connected with each of the department information platforms to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each of the department information platforms; Obtain a city data sharing interface, and establish a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network; The city data sharing interface is used to obtain standard city data, data verification is performed based on the standard city data, and the target city data that has passed the data verification is stored in the city shared database, wherein the city shared database realizes data sharing and integration, and promotes collaboration and information exchange among departments.

[0007] By adopting the above technical solution, the city data sharing standard is obtained and sent to each department information platform. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform. Then, the city data sharing interface is obtained, and the data transmission channel between each department information platform and the smart city sharing platform is established based on the city data sharing interface to break the information island and form a data sharing network. Then, the city data sharing interface is used to obtain standard city data, and data verification is performed based on the standard city data, and the target city data that has passed the data verification is stored in the city sharing database. The city data sharing standard and the city data sharing interface together constitute a complete specification system for data uploading and transmission, which realizes the connection between the smart city sharing platform and the department information platforms corresponding to different fields and departments, breaks the situation of information islands, realizes data sharing and integration between departments, and thus promotes the construction process of smart cities.

[0008] In a preferred example, the present application can be further configured as follows: Obtaining a hierarchical cascade blockchain architecture, wherein the hierarchical cascade blockchain architecture is composed of a primary blockchain and a secondary blockchain connected and coordinated with each other, the primary blockchain is responsible for macro-level data management and coordination, and the secondary blockchain is responsible for micro-level data recording and processing; Based on the department attributes of each department information platform, a hierarchical division is performed to determine the blockchain level corresponding to each department information platform; Based on the hierarchical cascading blockchain architecture and the blockchain level corresponding to each of the department information platforms, network node access is performed to obtain a city data sharing blockchain network, and each of the department information platforms is controlled to upload city data to the city data sharing blockchain network.

[0009] In a preferred example, the present application may be further configured as follows: after controlling each department information platform to upload city data to the city data sharing blockchain network, it also includes: When an abnormality is detected in the city shared database, abnormal data screening is performed based on the city shared database to determine abnormal city data; Based on the abnormal city data, the department information platform is screened to determine the target department information platform, and the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data; Data is updated based on the backup city data and the abnormal city shared database to obtain the city shared database in a normal state.

[0010] In a preferred example, the present application may be further configured as follows: storing the target city data that has passed the data verification into the city shared database includes: Performing data classification and identification based on the target city data that has passed the data verification to determine a classified data set, wherein the classified data set includes: sensitive data and personal identification; Performing desensitization processing based on the sensitive data to obtain desensitized sensitive data, and performing anonymization processing based on the personal identifier to obtain an anonymized personal identifier; The target city data, the desensitized sensitive data and the anonymized personal identifier are integrated to obtain privacy-protected city data, and the privacy-protected city data is stored in the city shared database.

[0011] In a preferred example, the present application may be further configured as follows: after storing the target city data that has passed the data verification into the city shared database, the following further includes: Performing data confidentiality assessment based on each of the target city data in the city shared database to determine the confidentiality level corresponding to each of the target city data; Based on the confidentiality level corresponding to each target city data, the city shared database is hierarchically encrypted to obtain an encrypted city shared database; The user role division is obtained, and permission settings are performed based on the user role division and the encrypted city shared database to obtain role permission configuration, wherein the permission settings are used to control data access by different roles within corresponding permission ranges.

[0012] In a preferred example, the present application may be further configured as follows: the data verification based on the standard city data includes: Perform multi-dimensional data verification based on the standard city data to obtain a single-dimensional verification result corresponding to each dimensional data verification, wherein the multi-dimensional data verification includes: data integrity verification, data accuracy verification, and data timeliness verification; The data verification result is determined by comprehensively considering each of the single-dimensional verification results, and finally a data verification result is obtained, wherein the data verification result includes: data verification passed and data verification failed.

[0013] In the second aspect, the present application provides a smart city big data management system, which adopts the following technical solutions: A smart city big data management system, comprising: A sharing standard setting module is used to obtain the city data sharing standard and send the city data sharing standard to each department information platform, wherein the department information platform is a platform independently built and managed by departments in different fields, and the smart city sharing platform is connected with each of the department information platforms to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each of the department information platforms; A transmission channel establishment module is used to obtain a city data sharing interface and establish a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network; The city data storage module is used to obtain standard city data using the city data sharing interface, perform data verification based on the standard city data, and store the target city data that has passed the data verification in the city shared database, wherein the city shared database realizes data sharing and integration, and promotes collaboration and information exchange across departments.

[0014] In the third aspect, this application provides a smart city sharing platform, which adopts the following technical solutions: at least one processor; Memory; At least one application, wherein at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the above-mentioned smart city big data management method.

[0015] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: A computer-readable storage medium stores a computer program, which, when executed in a computer, causes the computer to execute the smart city big data management method described above.

[0016] In summary, the present application includes at least one of the following beneficial technical effects: Obtain the city data sharing standard and send it to each department information platform. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform. Then, obtain the city data sharing interface, and establish a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network. Then, use the city data sharing interface to obtain standard city data, perform data verification based on the standard city data, and store the target city data that has passed the data verification in the city sharing database. The city data sharing standard and the city data sharing interface together constitute a complete specification system for data uploading and transmission, which realizes the connection between the smart city sharing platform and the department information platforms corresponding to different fields and departments, breaks the information island situation, realizes data sharing and integration between departments, and thus promotes the construction process of smart cities.

[0017] In order to ensure the authenticity and accuracy of urban data and avoid malicious tampering or forgery of urban data, blockchain technology is introduced to further strengthen the protection of urban data, prevent data leakage and unauthorized access, and improve the security and credibility of urban data. Therefore, a hierarchical cascade blockchain architecture is obtained, in which the first-level blockchain is responsible for data management and coordination at the macro level, and the second-level blockchain is responsible for data recording and processing at the micro level. The hierarchical cascade blockchain architecture is selected so that blockchains at different levels are responsible for data management at different levels and support data sharing and collaborative work between different levels. Then, based on the department attributes of each department information platform, the hierarchical division is carried out to determine the blockchain level corresponding to each department information platform. Furthermore, based on the hierarchical cascade blockchain architecture and the blockchain level corresponding to each department information platform, network node access is performed to obtain a city data sharing blockchain network, and each department information platform is controlled to upload city data to the city data sharing blockchain network. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flowchart of a smart city big data management method according to one embodiment of the present application; Figure 2 This is a schematic diagram of the structure of a smart city big data management system in one embodiment of the present application; Figure 3 It is a structural diagram of a smart city sharing platform according to one embodiment of the present application. DETAILED DESCRIPTION

[0019] The following combination Figures 1 to 3 This application is described in further detail.

[0020] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, a person skilled in the art may make non-creative modifications to the present embodiment as needed, but such modifications are protected by the patent law as long as they are within the scope of the present application.

[0021] In order to make the purpose, technical scheme and advantages of the embodiment of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is a part of the embodiment of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application. It should be noted that in the optional embodiments of the present application, the object information and other related data involved, when the embodiments in the present application are applied to specific products or technologies, need to obtain the permission or consent of the object, and the collection, use and processing of the relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions. In other words, if the data related to the object is involved in the embodiment of the present application, it needs to be obtained through the authorization and consent of the object, the authorization and consent of the relevant departments, and in accordance with the relevant laws, regulations and standards of the country and region. If personal information is involved in the embodiment, the acquisition of all personal information needs to obtain the consent of the individual. If sensitive information is involved, the separate consent of the information subject needs to be obtained, and the embodiment also needs to be implemented with the authorization and consent of the object.

[0022] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.

[0023] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0024] The present application embodiment provides a smart city big data management method, which is executed by a smart city sharing platform, such as Figure 1 As shown, the method includes step S101, step S102 and step S103, wherein: Step S101: Obtain the city data sharing standard and send the city data sharing standard to each department information platform, where the department information platform is a platform for independently building and managing data by departments in different fields. The smart city sharing platform is connected to each department information platform to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform.

[0025] For the embodiment of the present application, an innovative smart city sharing platform is built. The smart city sharing platform sets up a unified data sharing mechanism and standardized interface, which connects the smart city sharing platform with the department information platforms corresponding to different fields and departments, breaks the situation of information islands, realizes data sharing and integration among departments, and thus promotes the construction process of smart cities.

[0026] The specific operations for realizing urban data sharing and integration on the smart city sharing platform are as follows: pre-determine and store the urban data sharing standards to inform the uploading standards of urban data on different department information platforms, and ensure that the data uploaded by different department information platforms are unified and standardized. Among them, the data sharing standards include but are not limited to: data format, content requirements, naming specifications, coding rules, data quality requirements, etc. When setting the urban data sharing standards, the compatibility, integrity and consistency of the data will be comprehensively considered to provide a solid foundation for the exchange and sharing of urban data. Therefore, obtaining the urban data sharing standards and sending them to the information platforms of various departments to ensure that the data formats uploaded by the information platforms of various departments to the smart city sharing platform are consistent will help reduce parsing errors, data loss or data conversion costs caused by inconsistent data formats, thereby improving the efficiency and accuracy of data processing.

[0027] Step S102: Obtain a city data sharing interface, and establish a data transmission channel between the information platforms of various departments and the smart city sharing platform based on the city data sharing interface to break the information islands and form a data sharing network.

[0028] For the embodiment of the present application, a city data sharing interface is also pre-set in the smart city sharing platform. The city data sharing interface specifies how city data is transmitted in a standard format. Therefore, the city data sharing interface is obtained. The city data sharing interface includes but is not limited to: data transmission mode, data format, communication protocol, etc., which is used to unify the data transmission mode and interface specifications between the information platforms of various departments and the smart city sharing platform. After that, a data transmission channel is established between the information platforms of various departments and the smart city sharing platform based on the city data sharing interface. The establishment of the data transmission channel provides technical support for the sharing and integration of city data between the information platforms of various departments, helps to break the information island, and realizes the sharing and exchange of city data between different departments. At the same time, the data transmission channel is used to aggregate the data of the information platforms of various departments into a data resource pool, which helps city managers to have a more comprehensive understanding of the operation status and development trend of the city, and provide more scientific and accurate data support for urban planning, decision-making and management.

[0029] Both the urban data sharing standard and the urban data sharing interface are designed to ensure that the urban data uploaded from the information platforms of various departments to the smart city sharing platform are unified and standardized. The two together constitute a complete standard system for data uploading and transmission. Among them, the urban data sharing standard stipulates the content, format, naming specifications, etc. of the data, while the urban data sharing interface stipulates how urban data is transmitted in a standard format. That is, the urban data sharing standard is the basis of the urban data sharing interface, and the urban data sharing interface is the means to implement the urban data sharing standard.

[0030] Step S103: Use the city data sharing interface to obtain standard city data, perform data verification based on the standard city data, and store the target city data that has passed the data verification in the city sharing database, wherein the city sharing database realizes data sharing and integration, and promotes cross-departmental collaboration and information exchange.

[0031] For the embodiment of the present application, after completing the construction of the transmission channel between each department information platform and the smart city sharing platform, the smart city sharing platform can share data with each department information platform through the city data sharing interface. Therefore, when each department information platform completes the preliminary data processing operation on the city data and stores it in the database within the department information platform, the smart city sharing platform can obtain standard city data from the department information platform through the city data sharing interface, wherein the standard city data is the city data that meets the city data sharing standard. However, the standard city data will be affected by many factors during the transmission process, which may cause data missing, data errors and other problems. In order to ensure the accuracy of the standard city data uploaded to the smart city sharing platform, data verification is performed based on the standard city data to determine the data verification results, wherein the data verification results include: data verification passed and data verification failed. There are many specific implementation methods for data verification, which are no longer limited in the embodiments of the present application. In one feasible method, multi-dimensional data verification is performed based on standard city data to obtain a single-dimensional verification result corresponding to each dimensional data verification, wherein the multi-dimensional data verification includes: data integrity verification, data accuracy verification, and data timeliness verification; the data verification result is determined by integrating each single-dimensional verification result to finally obtain the data verification result. Finally, the target city data that has passed the data verification is stored in the city shared database to realize the sharing and integration of city data, and promote cross-departmental collaboration and information exchange. In order to ensure the security of data storage in the city shared database, the target city data can be desensitized and anonymized. Of course, the city shared database can also be encrypted in a hierarchical manner to prevent unauthorized users from illegally accessing city data.

[0032] It can be seen that in the embodiment of the present application, the city data sharing standard is obtained, and the city data sharing standard is sent to each department information platform. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform. Then, the city data sharing interface is obtained, and a data transmission channel between each department information platform and the smart city sharing platform is established based on the city data sharing interface to break the information island and form a data sharing network. Furthermore, the city data sharing interface is used to obtain standard city data, and data verification is performed based on the standard city data, and the target city data that has passed the data verification is stored in the city sharing database. The city data sharing standard and the city data sharing interface together constitute a complete specification system for data uploading and transmission, which realizes the connection between the smart city sharing platform and the department information platforms corresponding to different fields and departments, breaks the situation of information islands, and realizes data sharing and integration between departments, thereby promoting the construction process of smart cities.

[0033] Furthermore, in order to ensure the authenticity and accuracy of the city data and improve the security and credibility of the city data, in the embodiment of the present application, it also includes: Obtain a hierarchical cascade blockchain architecture, wherein the hierarchical cascade blockchain architecture is composed of a primary blockchain and a secondary blockchain interconnected and coordinated, the primary blockchain is responsible for macro-level data management and coordination, and the secondary blockchain is responsible for micro-level data recording and processing; Based on the department attributes of each department information platform, the hierarchical division is carried out to determine the blockchain level corresponding to each department information platform; Based on the hierarchical cascade blockchain architecture and the blockchain level corresponding to each department information platform, network node access is performed to obtain a city data sharing blockchain network, and each department information platform is controlled to upload city data to the city data sharing blockchain network.

[0034] For the embodiment of the present application, in order to ensure the authenticity and accuracy of urban data and avoid malicious tampering or forgery of urban data, blockchain technology is introduced to further strengthen the protection of urban data, prevent data leakage and unauthorized access, and improve the security and credibility of urban data. When selecting a blockchain architecture, in order to avoid the congestion and bottleneck problems of a single blockchain system, it is convenient to classify, store and process data according to different properties and needs. Therefore, a hierarchical cascade blockchain architecture is selected in the embodiment of the present application, so that different levels of blockchains are responsible for data management at different levels, and support data sharing and collaborative work between different levels. The hierarchical cascade blockchain architecture is composed of a primary blockchain and a secondary blockchain interconnected and coordinated. The primary blockchain is responsible for data management and coordination at the macro level. Data management includes but is not limited to: data standard formulation, authority management, data auditing, etc. The primary blockchain usually adopts a high-performance blockchain consensus algorithm, such as Byzantine fault tolerance, to improve the efficiency and security of data processing. Usually, the department information platform corresponding to key nodes such as government agencies and important public service departments is connected to the primary blockchain. The secondary blockchain is responsible for data recording and processing at the micro level, that is, it can be used for recording, querying and analyzing specific business data. The secondary blockchain usually adopts lightweight blockchain technology, such as alliance chain or private chain, to reduce operating costs and improve the flexibility of data processing. Usually, the department information platform corresponding to specific business nodes such as departments, enterprises and institutions is connected to the secondary blockchain. At the same time, a cross-chain communication protocol is designed to achieve data interoperability and collaborative work between the primary blockchain and the secondary blockchain. Distributed ledger technology can usually be used to ensure the synchronization and consistency of city data between different blockchains.

[0035] Then, based on the department attributes of each department information platform, the hierarchical division is carried out to determine the blockchain level corresponding to each department information platform, where the department attributes include but are not limited to: department functions, department data processing requirements, and department data security requirements. Therefore, when any one of the requirements for the first-level blockchain division is met, the blockchain level corresponding to the department information platform is determined to be the first-level blockchain, and the requirements for the first-level blockchain division are as follows: when the department functions are: departments involving macro-level decision-making, planning, coordination and supervision; department data processing requirements are: the amount of data processed is relatively large, but the frequency of data updates is relatively low, and more attention is paid to the comprehensiveness and accuracy of the data; department data security requirements are: involving global data, requiring higher data security measures. When any one of the requirements for the second-level blockchain division is met, the blockchain level corresponding to the department information platform is determined to be the second-level blockchain, and the requirements for the second-level blockchain division are as follows: when the department functions are: responsible for the execution and management of a certain field or aspect of business; department data processing requirements are: the amount of data processed is relatively small but the update frequency is high, and the real-time and accuracy requirements of the data are high; department data security requirements are: the amount of data is small, but the security and integrity of the data still need to be ensured.

[0036] Furthermore, based on the hierarchical cascade blockchain architecture and the blockchain level corresponding to each department information platform, network nodes are accessed to obtain a city data sharing blockchain network, that is, the department information platform whose blockchain level is determined as the first-level blockchain is connected to the first-level blockchain in the hierarchical cascade blockchain architecture; the department information platform whose blockchain level is determined as the second-level blockchain is connected to the second-level blockchain in the hierarchical cascade blockchain architecture. Then, after the access is completed and the city data sharing blockchain network is obtained, each department information platform is controlled to upload city data to the city data sharing blockchain network. The distributed storage and point-to-point transmission functions of the blockchain enable the city data uploaded by each department information platform to be directly transmitted to the designated distributed database without the need for data processing through the center, breaking the limitations of traditional data centers. At the same time, blockchain technology also has the characteristics of being tamper-proof, making city data open, transparent and traceable.

[0037] It can be seen that in the embodiment of the present application, in order to ensure the authenticity and accuracy of urban data and avoid malicious tampering or forgery of urban data, blockchain technology is introduced to further strengthen the protection of urban data, prevent data leakage and unauthorized access, and improve the security and credibility of urban data. Therefore, a hierarchical cascade blockchain architecture is obtained, in which the first-level blockchain is responsible for data management and coordination at the macro level, and the second-level blockchain is responsible for data recording and processing at the micro level. The hierarchical cascade blockchain architecture is selected so that blockchains at different levels are responsible for data management at different levels and support data sharing and collaborative work between different levels. Then, based on the department attributes of each department information platform, the hierarchical division is carried out to determine the blockchain level corresponding to each department information platform. Furthermore, network node access is performed based on the hierarchical cascade blockchain architecture and the blockchain level corresponding to each department information platform, and a city data sharing blockchain network is obtained, and each department information platform is controlled to upload city data to the city data sharing blockchain network.

[0038] Furthermore, in order to ensure the quality of urban data and the accuracy of urban data, in the embodiment of the present application, after controlling each department information platform to upload urban data to the urban data sharing blockchain network, it also includes: When anomalies are detected in the city shared database, abnormal data screening is performed based on the city shared database to determine abnormal city data; Based on the abnormal city data, the department information platform is screened to determine the target department information platform, and the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data; Data is updated based on the backup city data and the city shared database with abnormalities to obtain a city shared database in a normal state.

[0039] For the embodiment of the present application, the data quality in the city shared database is an important factor in ensuring subsequent city management and decision-making. Therefore, ensuring the quality of city data and ensuring the accuracy of city data is a very important basic work. Therefore, when abnormal data is monitored, it is necessary to adopt data backup and update functions in time to ensure the integrity and reliability of city data in the city shared database.

[0040] Specifically, the smart city sharing platform is provided with an intelligent monitoring function, which monitors various performance indicators and operation logs of the city shared database, and regularly manages and analyzes the performance indicators and operation logs, so as to promptly determine whether there are abnormalities in the city shared database. When an abnormality is detected in the city shared database, abnormal data screening is performed based on the city shared database to determine abnormal city data. There are many ways to screen abnormal data, and the embodiments of the present application are no longer limited. It is sufficient to screen out city data that is inconsistent with the initial storage in the city shared database. In an achievable method, data matching is performed based on the city data stored in the city shared database and the corresponding data sharing standards to determine whether there are abnormalities in the city data. The city data that fails to match the data is recorded as abnormal city data. The data matching operation is used to detect whether the city data currently stored in the city shared database still meets the requirements of the initial upload, so as to facilitate the city data to be modified without being discovered.

[0041] Then, based on the abnormal city data, the department information platform is screened to determine the target department information platform. The city data stored in the city shared database is uploaded by the department information platform through the city data sharing interface. Therefore, there is a one-to-one correspondence between the city data and the department information platform, so that the abnormal city data can be quickly used to screen out the department information platform that uploaded the data as the target department information platform. The target department information platform is connected to the city data sharing blockchain network and uploads the city data to the city data sharing blockchain network. Since the blockchain network uses advanced encryption technology to protect the confidentiality and integrity of the data, the integrity and tamper-proof of the city data uploaded to the city data sharing blockchain network are ensured. Therefore, the city data uploaded to the city data sharing blockchain network is made into backup data in the city shared database, so that when there is an abnormality in the city shared database, the abnormal data can be quickly updated. Therefore, the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data, and the data is updated based on the backup city data and the abnormal city shared database to obtain the normal city shared database.

[0042] It can be seen that in the embodiment of the present application, ensuring the quality of urban data and ensuring the accuracy of urban data is a very important basic work. Therefore, when abnormal data is monitored, it is necessary to promptly adopt the data backup and update function to ensure the integrity and reliability of the urban data in the city shared database. Therefore, when an abnormality is detected in the city shared database, the abnormal data is screened based on the city shared database to determine the abnormal city data. Then, the department information platform is screened based on the abnormal city data to determine the target department information platform, and the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data. Finally, data is updated based on the backup city data and the city shared database with abnormalities to obtain a city shared database in a normal state.

[0043] Furthermore, in order to effectively prevent the leakage of personal privacy, in the embodiment of the present application, the target city data that has passed the data verification is stored in the city shared database, including: Perform data classification and identification based on the target city data that has passed data verification, and determine the classified data set, where the classified data set includes: sensitive data and personal identifiers; Perform desensitization processing based on sensitive data to obtain desensitized sensitive data, and perform anonymization processing based on personal identification to obtain anonymized personal identification; The target city data, desensitized sensitive data and anonymized personal identifiers are integrated to obtain privacy-protected city data, which are then stored in the city shared database.

[0044] For the embodiment of the present application, in the process of executing data storage, data desensitization and anonymization processing technology is introduced to deform sensitive information before storage and transmission, and personal identification is anonymized to ensure that the anonymized data cannot be directly associated with personal identity. The introduction of data desensitization and anonymization processing technology makes it impossible to directly read the real content even if the data is stolen, effectively preventing the leakage of personal privacy. At the same time, the business logic relationship and data characteristics of the data are retained, and the subsequent data analysis work is not affected.

[0045] Specifically, sensitive data refers to data that may cause serious harm to society or individuals after being leaked, and personal identification refers to information that can directly or indirectly identify a specific natural person. The smart city sharing platform pre-stores sensitive data sets and personal identification sets. The sensitive data set specifies the types of all sensitive data, such as email addresses, passwords, medical information, educational background, business operations, corporate network structure, etc.; the personal identification set specifies information that can uniquely identify a specific natural person in a specific environment, including but not limited to: name, ID number, telephone number, student number, etc. Therefore, based on the target city data that has passed data verification, data classification matching is performed with the sensitive data set and the personal identification set to determine the classified data set, where the classified data set includes: sensitive data and personal identification.

[0046] Then, based on the sensitive data, desensitization processing is performed to obtain desensitized sensitive data, that is, according to the type of sensitive data and business needs, a suitable desensitization method is selected, and the sensitive data is desensitized in real time using the suitable desensitization method. Common desensitization methods include replacement, partial hiding, encryption, data masking, and generation of desensitized data, among which, replacement is: replacing the real data with a randomly generated placeholder value or false data; partial hiding is: only showing part of the data content and blurring part of the content; encryption is: encrypting the data using an encryption algorithm to ensure that only those with the key can decrypt the data; data masking is: masking or obfuscating the data through specific rules to protect the authenticity and privacy of the data; generation of desensitized data is: generating false data that conforms to the pattern but is not real data, and replacing the real data with this data. At the same time, anonymization processing is performed based on the personal identification to obtain an anonymized personal identification. Common anonymization methods include generalization, compression, decomposition, substitution, and interference, among which generalization is: replacing the data value with a wider category or range; compression is: reducing the accuracy or granularity of the data; decomposition is: decomposing the composite data into smaller components; substitution is: replacing the original data with randomly generated codes or false data; interference is: adding noise or randomness to the data so that it cannot be accurately restored. In the actual process of anonymization processing, a suitable anonymization method can be selected according to the type of personal identification and business needs, and this embodiment of the present application is no longer limited. Finally, the target city data, the desensitized sensitive data and the anonymized personal identification are integrated to obtain the city data with privacy protection, that is, the desensitized sensitive data and the anonymized personal identification are used to replace part of the data corresponding to the target city data, and the city data with privacy protection is stored in the city shared database.

[0047] It can be seen that in the embodiment of the present application, data classification and identification are performed based on the target city data that has passed the data verification to determine the classified data set. Then, desensitization processing is performed based on the sensitive data to obtain desensitized sensitive data, and anonymization processing is performed based on the personal identification to obtain the anonymized personal identification. Furthermore, the target city data, the desensitized sensitive data and the anonymized personal identification are integrated to obtain the city data with privacy protection, and the city data with privacy protection is stored in the city shared database. The introduction of data desensitization and anonymization processing technology makes it impossible to directly read the real content even if the data is stolen, effectively preventing the leakage of personal privacy. At the same time, the business logic relationship and data characteristics of the data are retained without affecting the subsequent data analysis work.

[0048] Furthermore, in order to effectively reduce the risk of data leakage and ensure that data with high confidentiality can be more strongly protected, in the embodiment of the present application, after storing the target city data that has passed the data verification in the city shared database, it also includes: Conduct data confidentiality assessment based on the data of each target city in the city shared database to determine the corresponding confidentiality level of each target city data; Based on the confidentiality level of each target city data, the city shared database is encrypted hierarchically to obtain an encrypted city shared database; Obtain user role divisions, set permissions based on the user role divisions and the encrypted city shared database, and obtain role permission configuration, wherein the permission settings are used to control data access by different roles within the corresponding permission range.

[0049] For the embodiment of the present application, in order to ensure the security of city data, the city shared database is encrypted to effectively prevent data leakage. Of course, due to the different importance of city data in the city shared database, the hierarchical encryption method is used to build a multi-level data security protection system, which can effectively reduce the risk of data leakage and ensure that highly confidential data can be more strongly protected. At the same time, the permissions of the encrypted relational database are set to ensure that only authorized users can access city data within the corresponding permission range, effectively preventing unauthorized access and data abuse, and further ensuring the security of city data.

[0050] Specifically, the smart city sharing platform pre-stores data confidentiality assessment standards, which are formulated based on relevant laws, regulations and industry specifications, and are used to assess the risks that may be caused by the leakage of each city data item. Therefore, using the data confidentiality assessment standards, each data item in the city shared database is evaluated for data confidentiality, and the corresponding confidentiality level of each target city data is determined, where the confidentiality level includes: low confidentiality, medium confidentiality and high confidentiality, and the confidentiality level can be used as the basis for subsequent data hierarchical encryption. Furthermore, based on the confidentiality level corresponding to each target city data, the city shared database is hierarchically encrypted to obtain an encrypted city shared database. When performing the hierarchical encryption operation, according to the confidentiality level corresponding to each target city data, the corresponding encryption algorithm and encryption strength are selected to encrypt the data. For example, for high-confidentiality data, a stronger encryption algorithm and a higher encryption strength are used.

[0051] Furthermore, in order to ensure that only users with corresponding permissions can access and operate specific city data and improve the security of the city shared database, permissions are set based on user role division and encrypted city shared database to obtain role permission configuration. User role division divides all users who access the city shared database into different roles. Users with the same role will have the same permissions. Permissions refer to the permissions to view, modify, and other operations on different city data in the city shared database. When executing permission settings, it is achieved by associating roles with permissions, rather than directly assigning permissions to users. This method improves the flexibility and security of permission management.

[0052] It can be seen that in the embodiment of the present application, in order to ensure the security of city data, the city shared database is encrypted. Therefore, a data confidentiality assessment is performed based on each target city data in the city shared database to determine the confidentiality level corresponding to each target city data. Then, based on the confidentiality level corresponding to each target city data, the city shared database is hierarchically encrypted to obtain an encrypted city shared database. The hierarchical encryption method is used to construct a multi-level data security protection system, which can effectively reduce the risk of data leakage and ensure that highly confidential data can be more strongly protected. Finally, based on the user role division and the encrypted city shared database, permission settings are performed to obtain role permission configuration.

[0053] Furthermore, in order to ensure the accuracy of the standard city data uploaded to the smart city sharing platform, in an embodiment of the present application, data verification is performed based on the standard city data, including: Perform multi-dimensional data verification based on standard city data to obtain the single-dimensional verification results corresponding to each dimensional data verification, where multi-dimensional data verification includes: data integrity verification, data accuracy verification, and data timeliness verification; The data verification result is determined by combining the verification results of each single dimension, and finally the data verification result is obtained, where the data verification results include: data verification passed and data verification failed.

[0054] For the embodiment of the present application, the standard city data will be affected by many factors during the transmission process, which may cause data loss, data error and other problems. In order to ensure the accuracy of the standard city data uploaded to the smart city sharing platform, the smart city sharing platform pre-stores the data sharing standard, which includes but is not limited to: data format, content requirements, naming specifications, coding rules, data quality requirements, etc. Therefore, based on the standard city data and data sharing standards, multi-dimensional data verification is performed to obtain the single-dimensional verification result corresponding to each dimensional data verification. For data integrity verification, it is used to determine whether the standard city data meets the content requirements, and whether the specified data has been filled in and is not empty; for data accuracy verification, it is used to determine whether the standard city data meets the data format, naming specifications and coding rules specified in the data sharing standard; for data timeliness verification, it is used to determine whether the update frequency of the standard city data meets the pre-specified regulations to ensure that the standard city data can be updated at a predetermined frequency. Finally, the data verification result is determined by combining each single-dimensional verification result, and the data verification result is finally obtained, that is, only when each single-dimensional verification result is verified, the data verification result is determined to be data verification passed; otherwise, the data verification result is determined to be data verification failed.

[0055] It can be seen that in the embodiment of the present application, the standard city data will be affected by various factors during the transmission process, which may seriously lead to problems such as data missing and data errors. In order to ensure the accuracy of the standard city data uploaded to the smart city sharing platform, multi-dimensional data verification is performed based on the standard city data to obtain the single-dimensional verification results corresponding to each dimensional data verification. Finally, the data verification results are determined by combining each single-dimensional verification result to obtain the data verification results.

[0056] The above-mentioned embodiment introduces a smart city big data management method from the perspective of method flow, and the following embodiment introduces a smart city big data management system from the perspective of virtual modules or virtual units. Please refer to the following embodiments for details.

[0057] The present application embodiment provides a smart city big data management system, such as Figure 2 As shown, the smart city big data management system may specifically include: The sharing standard setting module 210 is used to obtain the city data sharing standard and send the city data sharing standard to each department information platform, wherein the department information platform is a platform independently built and managed by departments in different fields. The smart city sharing platform is connected with each department information platform to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform; The transmission channel establishment module 220 is used to obtain the city data sharing interface and establish a data transmission channel between the information platform of each department and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network; The city data storage module 230 is used to obtain standard city data using the city data sharing interface, perform data verification based on the standard city data, and store the target city data that has passed the data verification in the city shared database, wherein the city shared database realizes data sharing and integration, and promotes collaboration and information exchange across departments.

[0058] For the embodiment of the present application, the city data sharing standard is obtained, and the city data sharing standard is sent to each department information platform. The city data sharing standard is used to unify the data definition and data format uploaded by each department information platform. Then, the city data sharing interface is obtained, and a data transmission channel between each department information platform and the smart city sharing platform is established based on the city data sharing interface to break the information island and form a data sharing network. Furthermore, the city data sharing interface is used to obtain standard city data, data verification is performed based on the standard city data, and the target city data that has passed the data verification is stored in the city shared database. The city data sharing standard and the city data sharing interface together constitute a complete specification system for data uploading and transmission, which realizes the connection between the smart city sharing platform and the department information platforms corresponding to different fields and departments, breaks the situation of information islands, and realizes data sharing and integration between departments, thereby promoting the construction process of smart cities.

[0059] A possible implementation of the embodiment of the present application is a smart city big data management system, which further includes: A blockchain network building module for obtaining a hierarchical cascade blockchain architecture, wherein the hierarchical cascade blockchain architecture is composed of a primary blockchain and a secondary blockchain interconnected and coordinated, wherein the primary blockchain is responsible for macro-level data management and coordination, and the secondary blockchain is responsible for micro-level data recording and processing; Based on the department attributes of each department information platform, the hierarchical division is carried out to determine the blockchain level corresponding to each department information platform; Based on the hierarchical cascade blockchain architecture and the blockchain level corresponding to each department information platform, network node access is performed to obtain a city data sharing blockchain network, and each department information platform is controlled to upload city data to the city data sharing blockchain network.

[0060] A possible implementation of the embodiment of the present application is a smart city big data management system, which further includes: The data update backup module is used to screen abnormal data based on the city shared database and determine abnormal city data when an abnormality is detected in the city shared database; Based on the abnormal city data, the department information platform is screened to determine the target department information platform, and the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data; Data is updated based on the backup city data and the city shared database with abnormalities to obtain a city shared database in a normal state.

[0061] In a possible implementation of the embodiment of the present application, when the city data storage module 230 executes storing the target city data that has passed the data verification into the city shared database, it is used to: Perform data classification and identification based on the target city data that has passed data verification, and determine the classified data set, where the classified data set includes: sensitive data and personal identifiers; Perform desensitization processing based on sensitive data to obtain desensitized sensitive data, and perform anonymization processing based on personal identification to obtain anonymized personal identification; The target city data, desensitized sensitive data and anonymized personal identifiers are integrated to obtain privacy-protected city data, which are then stored in the city shared database.

[0062] A possible implementation of the embodiment of the present application is a smart city big data management system, which further includes: A hierarchical encryption module is used to evaluate the confidentiality of each target city data in the city shared database and determine the confidentiality level of each target city data; Based on the confidentiality level of each target city data, the city shared database is encrypted hierarchically to obtain an encrypted city shared database; Obtain user role divisions, set permissions based on the user role divisions and the encrypted city shared database, and obtain role permission configuration, wherein the permission settings are used to control data access by different roles within the corresponding permission range.

[0063] In a possible implementation of the embodiment of the present application, when performing data verification based on standard city data, the city data storage module 230 is used to: Perform multi-dimensional data verification based on standard city data to obtain the single-dimensional verification results corresponding to each dimensional data verification, where multi-dimensional data verification includes: data integrity verification, data accuracy verification, and data timeliness verification; The data verification result is determined by combining the verification results of each single dimension, and finally the data verification result is obtained, where the data verification results include: data verification passed and data verification failed.

[0064] Technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working process of a smart city big data management system described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0065] The present application embodiment provides a smart city sharing platform, such as Figure 3 As shown, Figure 3 The smart city sharing platform 300 shown includes: a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, such as through a bus 302. Optionally, the smart city sharing platform 300 may also include a transceiver 304. It should be noted that in actual applications, the transceiver 304 is not limited to one, and the structure of the smart city sharing platform 300 does not constitute a limitation on the embodiments of the present application.

[0066] The processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor 301 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0067] The bus 302 may include a path to transmit information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 302 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but it does not mean that there is only one bus or only one type of bus.

[0068] The memory 303 may be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0069] The memory 303 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 301. The processor 301 is used to execute the application code stored in the memory 303 to implement the contents shown in the above method embodiment.

[0070] The smart city sharing platform includes, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs, desktop computers, etc. It can also be a server, etc. Figure 3 The smart city sharing platform shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present application.

[0071] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment.

[0072] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the method in any of the above embodiments is implemented.

[0073] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0074] The above are only some implementation methods of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A smart city big data management method, characterized in that: Executed by the Smart City Sharing Platform, including: Obtaining the city data sharing standard and sending the city data sharing standard to each department information platform, wherein the department information platform is a platform independently built and managed by departments in different fields, and the smart city sharing platform is connected with each of the department information platforms to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each of the department information platforms; Obtain a city data sharing interface, and establish a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network; The city data sharing interface is used to obtain standard city data, data verification is performed based on the standard city data, and the target city data that has passed the data verification is stored in the city shared database, wherein the city shared database realizes data sharing and integration, and promotes collaboration and information exchange among departments.

2. The smart city big data management method according to claim 1, characterized in that: Also includes: Obtaining a hierarchical cascade blockchain architecture, wherein the hierarchical cascade blockchain architecture is composed of a primary blockchain and a secondary blockchain connected and coordinated with each other, the primary blockchain is responsible for macro-level data management and coordination, and the secondary blockchain is responsible for micro-level data recording and processing; Based on the department attributes of each department information platform, a hierarchical division is performed to determine the blockchain level corresponding to each department information platform; Based on the hierarchical cascading blockchain architecture and the blockchain level corresponding to each of the department information platforms, network node access is performed to obtain a city data sharing blockchain network, and each of the department information platforms is controlled to upload city data to the city data sharing blockchain network.

3. The smart city big data management method according to claim 2, characterized in that: After controlling each of the department information platforms to upload city data to the city data sharing blockchain network, it also includes: When an abnormality is detected in the city shared database, abnormal data screening is performed based on the city shared database to determine abnormal city data; Based on the abnormal city data, the department information platform is screened to determine the target department information platform, and the backup data is extracted based on the target department information platform and the city data sharing blockchain network to obtain the backup city data; Data is updated based on the backup city data and the abnormal city shared database to obtain the city shared database in a normal state.

4. The smart city big data management method according to claim 1, characterized in that: The storing of the target city data that has passed the data verification into the city shared database includes: Performing data classification and identification based on the target city data that has passed the data verification to determine a classified data set, wherein the classified data set includes: sensitive data and personal identification; Performing desensitization processing based on the sensitive data to obtain desensitized sensitive data, and performing anonymization processing based on the personal identifier to obtain an anonymized personal identifier; The target city data, the desensitized sensitive data and the anonymized personal identifier are integrated to obtain privacy-protected city data, and the privacy-protected city data is stored in the city shared database.

5. The smart city big data management method according to claim 1, characterized in that: After storing the target city data that has passed the data verification in the city shared database, the method further includes: Performing data confidentiality assessment based on each of the target city data in the city shared database to determine the confidentiality level of each of the target city data; Based on the confidentiality level corresponding to each target city data, the city shared database is hierarchically encrypted to obtain an encrypted city shared database; The user role division is obtained, and permission settings are performed based on the user role division and the encrypted city shared database to obtain role permission configuration, wherein the permission settings are used to control data access by different roles within corresponding permission ranges.

6. The smart city big data management method according to claim 1, characterized in that: The data verification based on the standard city data includes: Perform multi-dimensional data verification based on the standard city data to obtain a single-dimensional verification result corresponding to each dimensional data verification, wherein the multi-dimensional data verification includes: data integrity verification, data accuracy verification, and data timeliness verification; The data verification result is determined by comprehensively considering each of the single-dimensional verification results, and finally a data verification result is obtained, wherein the data verification result includes: data verification passed and data verification failed.

7. A smart city big data management system, characterized in that: include: A sharing standard setting module is used to obtain the city data sharing standard and send the city data sharing standard to each department information platform, wherein the department information platform is a platform independently built and managed by departments in different fields, and the smart city sharing platform is connected with each of the department information platforms to facilitate data transmission. The city data sharing standard is used to unify the data definition and data format uploaded by each of the department information platforms; A transmission channel establishment module is used to obtain a city data sharing interface and establish a data transmission channel between each department information platform and the smart city sharing platform based on the city data sharing interface to break the information island and form a data sharing network; The city data storage module is used to obtain standard city data using the city data sharing interface, perform data verification based on the standard city data, and store the target city data that has passed the data verification in the city shared database, wherein the city shared database realizes data sharing and integration, and promotes collaboration and information exchange across departments.

8. A smart city sharing platform, characterized in that: include: at least one processor; Memory; At least one application, wherein at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the smart city big data management method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed in a computer, the computer is caused to execute the smart city big data management method described in any one of claims 1 to 6.

Images