Multi-source heterogeneous data sharing method and system for smart city

By building standard maps and data pipelines, combined with the hierarchical structure of data pipelines, the security and timeliness of multi-source heterogeneous data sharing in smart cities are solved, and efficient and secure data sharing is achieved.

CN119415605APending Publication Date: 2025-02-11萍乡市安源数字投资有限公司
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411434028.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-15
Publication Date
2025-02-11

AI Technical Summary

Technical Problem

In smart cities, how to effectively share multi-source heterogeneous data in hierarchical manners must not only ensure the effectiveness of data sharing, but also enhance the security of data and prevent the leakage of sensitive information.

Method used

By building standard maps and data pipelines, integrating and correcting multi-source heterogeneous data, and splitting the data pipeline into a basic layer, a feature layer and a control layer, setting sensitive values ​​and verification keys, realizing hierarchical sharing of data.

Benefits of technology

Real-time update and hierarchical sharing of multi-source heterogeneous data is realized, which improves the timeliness and security of data sharing and reduces the risk of data leakage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119415605A_ABST
    Figure CN119415605A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of data sharing, and particularly relates to a multi-source heterogeneous data sharing method and system for a smart city, and the method comprises the steps: S100: determining the sources of multi-source heterogeneous data in the smart city, configuring the relationship between the sources, defining standard phrases, integrating the standard phrases and the relationship, and constructing a standard map, the method comprises the following steps: acquiring a source, positioning an internet-of-things device at the source, constructing a data pipeline, connecting one end of the data pipeline with the internet-of-things device, connecting the other end of the data pipeline with a standard map, acquiring a real-time data stream in the data pipeline, correcting the real-time data stream by using the standard map, creating a plurality of blocks in one-to-one correspondence with the source, and storing the plurality of blocks in the data pipeline. And the corrected real-time data stream is transferred into the data block. According to the method, the multi-source heterogeneous data can be graded by splitting the data pipeline, so that the data sharing effect is guaranteed, the data security is greatly enhanced, and the data leakage risk is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data sharing, and in particular to a multi-source heterogeneous data sharing method and system for smart cities. Background Art

[0002] Multi-source heterogeneous data sharing in smart cities refers to the integration and sharing of data from different sources and types (such as sensor data, social media information, traffic flow and environmental monitoring, etc.) in urban management and services to provide data support for urban construction. This sharing method can break down data silos, promote collaboration between different departments and systems, and improve urban operation efficiency and service quality.

[0003] In the process of data information sharing, if the scope of opening is too large, it may lead to the leakage of sensitive information and bring security risks. On the other hand, if the scope of opening is too small, it will affect the effect of data sharing and limit the potential of smart cities. Therefore, "how to hierarchically share multi-source heterogeneous data" is the technical problem that the present invention needs to solve. Summary of the invention

[0004] The purpose of the present invention is to provide a multi-source heterogeneous data sharing method and system for smart cities to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A multi-source heterogeneous data sharing method and system for a smart city, the method comprising:

[0007] S100: Determine the sources of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and the relationship, build a standard map, locate the IoT device located at the source, build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a number block corresponding to the source one by one, and transfer the modified real-time data stream into the number block;

[0008] S200: splitting the data pipeline into a basic layer, a feature layer and a control layer, and dividing the blocks into the basic layer and the feature layer;

[0009] S300: In the feature layer, set the sensitivity value of each number block, and arrange the number blocks in descending order according to the sensitivity value, divide the arranged number blocks into a number of intervals, determine the number of digits threshold, and configure the verification key of each number block;

[0010] S400: The basic layer and the feature layer are hung down to the control layer, and a root node is embedded in the control layer. Using the root node, a call key uploaded by a user is received, and it is determined whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and query rights for the basic layer and the feature layer are opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and it is determined whether the correct number of digits is greater than the digit threshold. If so, the data pipeline is activated, and query rights for the basic layer are opened to the user. If not, a re-verification receipt is pushed to the user.

[0011] Furthermore, the S100 includes:

[0012] Determine the degree of association between different sources, and align the sources according to preset elements, wherein the preset elements include at least: time and location;

[0013] The standard graph is used to traverse the blocks, find out the blocks corresponding to the same standard phrase, and merge the found blocks, and transfer the merged blocks to the data pipeline.

[0014] Furthermore, the S100 further includes:

[0015] Inserting a separator into the real-time data stream, and dividing the real-time data stream into the blocks with the separator as interval;

[0016] The preset elements corresponding to the real-time data stream are traced back, and a storage order is determined. According to the storage order, the blocks are transferred to the data pipeline for storage.

[0017] Further, the S200 includes:

[0018] In the data pipeline, a transfer link of the blocks is determined, wherein the transfer link is: from a base layer to a feature layer, and then to a standard atlas;

[0019] The blocks are divided into a basic data part and a characteristic data part, the basic data part is migrated to the basic layer, and the characteristic data part is migrated to the characteristic layer.

[0020] Further, the S300 includes:

[0021] Linking an additional layer in the data pipeline, if the sensitivity value is greater than a preset threshold, transferring the corresponding block to the additional layer;

[0022] Integrate multiple authentication mechanisms into the additional layer.

[0023] Further, the S400 includes:

[0024] Configure the overall relationship between the root node and the block, determine the additional factors, wherein the additional factors at least include: location, common equipment and number of verifications, and integrate the additional factors into the call key;

[0025] After the query permission is obtained, the data pipeline is activated, the query request of the user is subscribed, the query results are traversed, and the query results are pushed to the user.

[0026] Furthermore, the method further comprises:

[0027] Based on the additional factors, a number of risk levels are determined, and a mapping between risk levels and digit thresholds is established;

[0028] The calling key is integrated into the query request, and the additional factor is updated in real time.

[0029] The technical solution of the present invention also provides a multi-source heterogeneous data sharing system for a smart city, the system comprising:

[0030] The transfer module is used to determine the source of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and relationships, build a standard map, locate the IoT device located at the source, build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a number block corresponding to the source one by one, and transfer the modified real-time data stream to the number block;

[0031] A segmentation module, used for segmenting the data pipeline into a basic layer, a feature layer and a control layer, and segmenting the data blocks into the basic layer and the feature layer;

[0032] A configuration module, used to set the sensitivity value of each number block in the feature layer, and arrange the number blocks in descending order according to the sensitivity value, divide the arranged number blocks into a number of intervals, and determine the digit threshold to configure the verification key of each number block;

[0033] A judgment module is used to hang the basic layer and feature layer down to the control layer, embed a root node into the control layer, use the root node to receive a call key uploaded by a user, and judge whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and the query permission of the basic layer and the feature layer is opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and judge whether the correct number of digits is greater than the digit threshold. If so, the data pipeline is activated, and the query permission of the basic layer is opened to the user. If not, a re-verification receipt is pushed to the user.

[0034] Furthermore, the transfer module includes:

[0035] An alignment unit, configured to determine the degree of association between different sources, and align the sources according to preset elements, wherein the preset elements at least include: time and location;

[0036] A fusion unit, used to use the standard graph to traverse the blocks, find out the blocks corresponding to the same standard phrase, fuse the found blocks, and transfer the fused blocks to the data pipeline;

[0037] An inserting unit, used for inserting a delimiter into the real-time data stream, and dividing the real-time data stream into the blocks with the delimiter as interval;

[0038] The storage unit is used to trace back the preset elements corresponding to the real-time data stream and determine the storage order, and transfer the blocks into the data pipeline for storage according to the storage order.

[0039] Furthermore, the segmentation module includes:

[0040] A transfer unit, configured to determine, in the data pipeline, a transfer link of the blocks, wherein the transfer link is: from a base layer to a feature layer, and then to a standard atlas;

[0041] The migration unit is used to divide the blocks into a basic data part and a characteristic data part, migrate the basic data part to the basic layer, and migrate the characteristic data part to the characteristic layer.

[0042] Compared with the prior art, the beneficial effects of the present invention are as follows: by constructing a standard graph, the present invention can unify entities in multi-source heterogeneous data and integrate scattered data, thereby greatly expanding data sources; by constructing a data pipeline, multi-source heterogeneous data can be updated in real time, greatly improving the timeliness of data sharing; by splitting the data pipeline, multi-source heterogeneous data can be graded, thereby greatly enhancing data security and reducing the risk of data leakage while ensuring the effect of data sharing. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0044] Figure 1 A flowchart of a multi-source heterogeneous data sharing method for a smart city provided by an embodiment of the present invention.

[0045] Figure 2 A first sub-process flowchart of a multi-source heterogeneous data sharing method for a smart city provided in an embodiment of the present invention.

[0046] Figure 3 A second sub-process flowchart of the multi-source heterogeneous data sharing method for a smart city provided in an embodiment of the present invention.

[0047] Figure 4 A third sub-process flowchart of the multi-source heterogeneous data sharing method for a smart city provided in an embodiment of the present invention.

[0048] Figure 5 This is a fourth sub-process flowchart of the multi-source heterogeneous data sharing method for a smart city provided in an embodiment of the present invention.

[0049] Figure 6 A block diagram of the composition of a multi-source heterogeneous data sharing system for a smart city provided by an embodiment of the present invention.

[0050] Figure 7 A block diagram of the composition of the transfer module in the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention.

[0051] Figure 8 A block diagram of the composition of a segmentation module in a multi-source heterogeneous data sharing system for a smart city provided in an embodiment of the present invention.

[0052] Fig. 9 A block diagram of the composition of a configuration module in a multi-source heterogeneous data sharing system for a smart city provided by an embodiment of the present invention.

[0053] Fig.10 A block diagram of the composition of a judgment module in a multi-source heterogeneous data sharing system for a smart city provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0055] In Example 1, Figure 1 The implementation process of the multi-source heterogeneous data sharing method for smart cities provided by an embodiment of the present invention is shown and described in detail below:

[0056] S100: Determine the sources of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and relationships, construct a standard map, locate the IoT device located at the source, and build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a number block corresponding to the source one by one, and transfer the modified real-time data stream into the number block.

[0057] The sources of multi-source heterogeneous data include: sensors, public service equipment and traffic management equipment, and the relationship between the sources is determined; for example, the flow of people at the traffic light intersection is determined through the video surveillance equipment in the public service equipment, and the flow of people is used to adjust the duration of the traffic lights in the traffic management equipment.

[0058] Determine the standard phrase, which is the standard expression of the same concept; for example, in source A, the commuting efficiency of vehicles on a road section is 30 kilometers per hour, while in source B, the average speed of the same road section is 32 kilometers per hour. Both the commuting efficiency and the average speed can be expressed using standard phrases, and the standard phrase is the travel speed.

[0059] Integrate standard phrases and relationships, build a standard graph, determine the IoT device corresponding to each source, where the specific IoT device is not limited. Use IoT devices to collect smart city data in real time, obtain real-time data streams, build data pipelines, and transfer real-time data streams through the data pipelines to the standard graph. Use the standard graph to integrate multi-source heterogeneous data from different sources, and then use standard phrases to modify them and configure relationships.

[0060] S200: splitting the data pipeline into a base layer, a feature layer and a control layer, and dividing the blocks into the base layer and the feature layer.

[0061] The data pipeline is divided into the basic layer, feature layer and control layer. Only after passing the verification of the root node in the control layer can the data in the basic layer or feature layer be queried, the data blocks are split and classified into the basic layer and feature layer respectively.

[0062] S300: In the feature layer, a sensitivity value of each number block is set, and the number blocks are arranged in descending order according to the sensitivity value, and the arranged number blocks are divided into a number of intervals, and a bit number threshold is determined to configure a verification key for each number block.

[0063] A sensitive value is set for each number block, wherein a specific method for determining the sensitive value may be: creating a sensitive word dictionary, wherein the sensitive word dictionary consists of sensitive words and their corresponding scores; first, querying whether there are sensitive words in the number block, if so, determining the score of each sensitive value according to the sensitive word dictionary, and superimposing them to obtain the sensitive value of the number block; if not, the sensitive value is "0", and the corresponding number block should be classified into the basic layer; arranging the number blocks in descending order of the sensitive values, and dividing the number blocks into several intervals, determining a digit threshold for each interval, and setting a verification key for each number block or every few number blocks.

[0064] S400: The basic layer and the feature layer are hung down to the control layer, and a root node is embedded in the control layer. Using the root node, a call key uploaded by a user is received, and it is determined whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and query rights for the basic layer and the feature layer are opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and it is determined whether the correct number of digits is greater than the digit threshold. If so, the data pipeline is activated, and query rights for the basic layer are opened to the user. If not, a re-verification receipt is pushed to the user.

[0065] A root node is embedded in the control layer, where the root node is mainly used to verify the calling key in the user's query request. The root node can also manage the data blocks in a coordinated manner. If the calling key verification passes (the verification key is exactly the same as the calling key), the data pipeline is opened, and the basic layer and feature layer are opened to the user for the user to query the data in the data blocks. If the verification fails, the correct number of digits is compared to determine whether some digits in the calling key input by the user are correct. If the correct number of digits is greater than the digit threshold, the query permission of the basic layer is opened to the user. If the correct number of digits is not greater than the digit threshold, the user needs to be re-verified, and a re-verification receipt is pushed to the user, where the receipt is displayed in the form of a pop-up window or text message.

[0066] In Example 2, Figure 2 The implementation process of the multi-source heterogeneous data sharing method for smart cities provided by an embodiment of the present invention is shown, and S100 is described in detail below:

[0067] S101: Determine the degree of association between different sources, and align the sources according to preset elements, wherein the preset elements at least include: time and location.

[0068] Based on the relationship between sources, the degree of association between different sources is determined, and the real-time data streams between sources with a higher degree of association are merged according to time or location.

[0069] S102: using the standard graph, traversing the blocks, finding blocks corresponding to the same standard phrase, merging the found blocks, and transferring the merged blocks into the data pipeline.

[0070] All blocks are traversed to find blocks containing the same standard phrase, the found blocks are merged, and the merged blocks are transferred to the data pipeline.

[0071] In Example 3, Figure 2 The implementation process of the multi-source heterogeneous data sharing method for smart cities provided by an embodiment of the present invention is shown. S100 is further described in detail below, as follows:

[0072] S103: inserting a delimiter into the real-time data stream, and dividing the real-time data stream into the blocks with the delimiter as interval.

[0073] A delimiter is inserted into the real-time data stream, and the real-time data stream is segmented using the delimiter, thereby segmenting the real-time data stream into several segments.

[0074] S104: Tracing back the preset elements corresponding to the real-time data stream, and determining a storage order, and transferring the blocks into the data pipeline for storage according to the storage order.

[0075] The blocks are transferred to the base layer or feature layer for storage in the order of time or location.

[0076] In Example 4, Figure 3 The implementation process of the multi-source heterogeneous data sharing method for smart cities provided by an embodiment of the present invention is shown, and S200 is described in detail below, as follows:

[0077] S201: In the data pipeline, determining a transfer link of the blocks, wherein the transfer link is: from a base layer to a feature layer, and then to a standard graph.

[0078] Determine the transfer link of the data block in the data pipeline, and when a new real-time data stream is generated, transfer it to the new data block.

[0079] S202: Divide the blocks into a basic data part and a characteristic data part, migrate the basic data part to a basic layer, and migrate the characteristic data part to a characteristic layer.

[0080] The new blocks are transferred to the base layer, the basic data part is split out, and the basic data part is stored in the base layer. The split blocks are then transferred to the feature layer, the feature data part is split out, and the feature data part is stored in the feature layer. Finally, the standard map is used to determine the relationship between the basic data part and the feature data part, and the blocks containing the same standard phrase are merged.

[0081] In Example 5, Figure 4 The implementation process of the multi-source heterogeneous data sharing method for a smart city provided by an embodiment of the present invention is shown, and S300 is described in detail below, as follows:

[0082] S301: linking an additional layer in the data pipeline, and if the sensitivity value is greater than a preset threshold, transferring the corresponding block to the additional layer.

[0083] Add an additional layer to the data pipeline and transfer blocks with sensitivity values ​​greater than a preset threshold to the additional layer, where the preset threshold is set by the administrator.

[0084] S302: Integrate a multiple authentication mechanism into the additional layer.

[0085] Insert multiple verification mechanisms into the additional layer, where the multiple verification mechanisms are multiple verifications of the query request; for example, when the additional layer needs to be accessed, the query request is first verified, and when several blocks need to be accessed, verification is performed again.

[0086] In Example 6, Figure 5 The implementation process of the multi-source heterogeneous data sharing method for a smart city provided by an embodiment of the present invention is shown, and S400 is described in detail below, as follows:

[0087] S401: Configure the overall relationship between the root node and the number block, determine the additional factors, wherein the additional factors at least include: location, common equipment and number of verifications, and integrate the additional factors into the call key.

[0088] Configure the coordination relationship between the root node and all digital blocks, and use the root node to manage all digital blocks; when the user's query request is obtained, determine the additional factors in the query request, where the additional factors can be location, common devices and number of verifications. The location is the location of the device that initiates the query request, the common device is to determine whether the device logged in by the user is a common device, and the number of verifications is the number of times the user verifies, and the additional factors are integrated into the call key.

[0089] S402: After the query permission is obtained, the data pipeline is activated, the query request of the user is subscribed, the query results are traversed, and the query results are pushed to the user.

[0090] After obtaining the query permission, the data pipeline is activated to obtain the user's query request, and the query request is used to traverse the data pipeline to determine the query result, and the query result is pushed to the user.

[0091] In Example 7, different from Example 1, in this embodiment of the present invention, the method further includes:

[0092] Based on the additional factors, a number of risk levels are determined, and a mapping between risk levels and digit thresholds is established;

[0093] The call key is integrated into the query request, and the additional factor is updated in real time.

[0094] Based on the additional factors, the risk level of the query request is determined, and different risk levels correspond to different digit thresholds; for example, when the user is at a common login location and uses a common device to query, a lower digit threshold can be set, otherwise, a higher digit threshold should be set; the correspondence between the digit threshold and the risk level is stored in a pre-constructed comparison table, which includes: digit threshold items and risk level items, and the comparison table is pre-prepared by the staff; the additional factors are updated in real time based on the user's location and the device used.

[0095] Figure 6 The structure diagram of the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention is shown. The multi-source heterogeneous data sharing system 1 for smart cities includes:

[0096] The transfer module 11 is used to determine the source of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and relationships, build a standard map, locate the IoT device located at the source, build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a digital block corresponding to the source one by one, and transfer the modified real-time data stream to the digital block;

[0097] A segmentation module 12, used to split the data pipeline into a basic layer, a feature layer and a control layer, and segment the data blocks into the basic layer and the feature layer;

[0098] Configuration module 13, used to set the sensitivity value of each block in the feature layer, and arrange the blocks in descending order according to the sensitivity value, divide the arranged blocks into a number of intervals, determine the digit threshold, and configure the verification key of each block;

[0099] The judgment module 14 is used to hang the basic layer and the feature layer down to the control layer, embed a root node into the control layer, and use the root node to receive the call key uploaded by the user, and judge whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and the query permission of the basic layer and the feature layer is opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and judge whether the correct number of digits is greater than the digit threshold. If it is greater, the data pipeline is activated, and the query permission of the basic layer is opened to the user. If it is not greater, a re-verification receipt is pushed to the user.

[0100] Figure 7 The structure diagram of the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention is shown, and the transfer module 11 includes:

[0101] An alignment unit 111 is used to determine the degree of association between different sources and align the sources according to preset elements, wherein the preset elements at least include: time and location;

[0102] A fusion unit 112 is used to use the standard graph to traverse the blocks, find the blocks corresponding to the same standard phrase, fuse the found blocks, and transfer the fused blocks to the data pipeline;

[0103] The inserting unit 113 is used to insert a delimiter into the real-time data stream, and divide the real-time data stream into the blocks at intervals of the delimiter;

[0104] The storage unit 114 is used to trace back the preset elements corresponding to the real-time data stream and determine the storage order, and transfer the blocks into the data pipeline for storage according to the storage order.

[0105] Figure 8 The structure diagram of the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention is shown, and the segmentation module 12 includes:

[0106] A transfer unit 121 is used to determine a transfer link of the blocks in the data pipeline, wherein the transfer link is: from a base layer to a feature layer, and then to a standard graph;

[0107] The migration unit 122 is used to divide the blocks into a basic data part and a characteristic data part, migrate the basic data part to the basic layer, and migrate the characteristic data part to the characteristic layer.

[0108] Fig. 9 The structure diagram of the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention is shown, and the configuration module 13 includes:

[0109] A linking unit 131, configured to link an additional layer in the data pipeline, and if the sensitivity value is greater than a preset threshold, transfer the corresponding block to the additional layer;

[0110] The integration unit 132 is used to integrate multiple authentication mechanisms into the additional layer.

[0111] Fig.10 The structure diagram of the multi-source heterogeneous data sharing system for smart cities provided by an embodiment of the present invention is shown, and the judgment module 14 includes:

[0112] The coordination unit 141 is used to configure the coordination relationship between the root node and the block, determine the additional factor, wherein the additional factor at least includes: location, common equipment and verification times, and integrate the additional factor into the call key;

[0113] The activation unit 142 is used to activate the data pipeline after obtaining the query permission, subscribe to the user's query request, traverse the query results, and push the query results to the user.

[0114] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A multi-source heterogeneous data sharing method for smart cities, characterized in that: The method comprises: S100: Determine the sources of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and the relationship, build a standard map, locate the IoT device located at the source, build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a number block corresponding to the source one by one, and transfer the modified real-time data stream into the number block; S200: splitting the data pipeline into a basic layer, a feature layer and a control layer, and dividing the blocks into the basic layer and the feature layer; S300: In the feature layer, set the sensitivity value of each number block, and arrange the number blocks in descending order according to the sensitivity value, divide the arranged number blocks into a number of intervals, determine the number of digits threshold, and configure the verification key of each number block; S400: The basic layer and the feature layer are hung down to the control layer, and a root node is embedded in the control layer. Using the root node, a call key uploaded by a user is received, and it is determined whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and query rights for the basic layer and the feature layer are opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and it is determined whether the correct number of digits is greater than the digit threshold. If so, the data pipeline is activated, and query rights for the basic layer are opened to the user. If not, a re-verification receipt is pushed to the user.

2. The multi-source heterogeneous data sharing method for smart city according to claim 1 is characterized in that: The S100 includes: Determine the degree of association between different sources, and align the sources according to preset elements, wherein the preset elements include at least: time and location; The standard graph is used to traverse the blocks, find out the blocks corresponding to the same standard phrase, and merge the found blocks, and transfer the merged blocks to the data pipeline.

3. The multi-source heterogeneous data sharing method for smart city according to claim 2 is characterized in that: The S100 further includes: Inserting a separator into the real-time data stream, and dividing the real-time data stream into the blocks with the separator as interval; The preset elements corresponding to the real-time data stream are traced back, and a storage order is determined. According to the storage order, the blocks are transferred to the data pipeline for storage.

4. The multi-source heterogeneous data sharing method for smart city according to claim 3 is characterized in that: The S200 includes: In the data pipeline, a transfer link of the blocks is determined, wherein the transfer link is: from a base layer to a feature layer, and then to a standard atlas; The blocks are divided into a basic data part and a characteristic data part, the basic data part is migrated to the basic layer, and the characteristic data part is migrated to the characteristic layer.

5. The multi-source heterogeneous data sharing method for smart city according to claim 4 is characterized in that: The S300 includes: Linking an additional layer in the data pipeline, if the sensitivity value is greater than a preset threshold, transferring the corresponding block to the additional layer; Integrate multiple authentication mechanisms into the additional layer.

6. The multi-source heterogeneous data sharing method for smart city according to claim 1 is characterized in that: The S400 includes: Configure the overall relationship between the root node and the block, determine the additional factors, wherein the additional factors at least include: location, common equipment and number of verifications, and integrate the additional factors into the call key; After the query permission is obtained, the data pipeline is activated, the query request of the user is subscribed, the query results are traversed, and the query results are pushed to the user.

7. The multi-source heterogeneous data sharing method for smart city according to claim 6 is characterized in that: The method further comprises: Based on the additional factors, a number of risk levels are determined, and a mapping between risk levels and digit thresholds is established; The calling key is integrated into the query request, and the additional factor is updated in real time.

8. A multi-source heterogeneous data sharing system for smart cities, characterized by: The system comprises: The transfer module is used to determine the source of multi-source heterogeneous data in the smart city, configure the relationship between the sources, define standard phrases, integrate the standard phrases and relationships, build a standard map, locate the IoT device located at the source, build a data pipeline, one end of the data pipeline is connected to the IoT device, and the other end is connected to the standard map, obtain the real-time data stream in the data pipeline, use the standard map to modify the real-time data stream, create a number block corresponding to the source one by one, and transfer the modified real-time data stream to the number block; A segmentation module, used for segmenting the data pipeline into a basic layer, a feature layer and a control layer, and segmenting the data blocks into the basic layer and the feature layer; A configuration module, used to set the sensitivity value of each number block in the feature layer, and arrange the number blocks in descending order according to the sensitivity value, divide the arranged number blocks into a number of intervals, and determine the digit threshold to configure the verification key of each number block; A judgment module is used to hang the basic layer and feature layer down to the control layer, embed a root node into the control layer, use the root node to receive a call key uploaded by a user, and judge whether the verification key and the call key are the same. If they are the same, the data pipeline is activated, and the query permission of the basic layer and the feature layer is opened to the user. If they are different, the verification key and the call key are compared to determine the correct number of digits, and judge whether the correct number of digits is greater than the digit threshold. If so, the data pipeline is activated, and the query permission of the basic layer is opened to the user. If not, a re-verification receipt is pushed to the user.

9. The multi-source heterogeneous data sharing system for smart cities according to claim 8 is characterized in that: The transfer module comprises: An alignment unit, configured to determine the degree of association between different sources, and align the sources according to preset elements, wherein the preset elements at least include: time and location; A fusion unit, used to use the standard graph to traverse the blocks, find out the blocks corresponding to the same standard phrase, fuse the found blocks, and transfer the fused blocks to the data pipeline; An inserting unit, used for inserting a delimiter into the real-time data stream, and dividing the real-time data stream into the blocks with the delimiter as interval; The storage unit is used to trace back the preset elements corresponding to the real-time data stream and determine the storage order, and transfer the blocks into the data pipeline for storage according to the storage order.

10. The multi-source heterogeneous data sharing system for smart cities according to claim 9, characterized in that: The segmentation module includes: A transfer unit, configured to determine, in the data pipeline, a transfer link of the blocks, wherein the transfer link is: from a base layer to a feature layer, and then to a standard atlas; The migration unit is used to divide the blocks into a basic data part and a characteristic data part, migrate the basic data part to the basic layer, and migrate the characteristic data part to the characteristic layer.

Citation Information

Patent Citations

  • Smart city data sharing method and system based on big data

    CN114138731A

  • Integrated management method and system for multi-source heterogeneous data of colleges and universities and storage medium

    CN116186359A

  • Resource integration data trusted sharing system for different smart communities

    CN116546095A

  • Encrypted data storage and query method based on block chain

    CN117009988A