A multi-element data management method and system
By calculating the data transmission priority and dynamically updating the key in a real-world 3D space, the problem of not being able to distinguish the differences in entity security levels in existing technologies is solved, enabling efficient and secure data transmission in real-world 3D scenes.
Patent Information
- Application Number
- CN202611448190.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-17
- Publication Date
- 2026-11-06
AI Technical Summary
In existing technologies, when data transmission in real-world 3D scenes employs a full-data encryption strategy with one-to-ten-thousand encryption, it is impossible to distinguish the security level differences between different entities in 3D space, resulting in insufficient protection of sensitive data and posing security risks.
By collecting data from the real-world 3D space, the basic transmission rate, data volume, and importance of the corresponding entity for each data point are obtained. The transmission priority is calculated, and the key is dynamically updated based on the entity's status and attack frequency. Different keys are used for data transmission.
It effectively enhances the protection capabilities of sensitive spatial data throughout its entire lifecycle, ensures data security, reduces security risks through dynamic key updates, and optimizes system resource utilization efficiency.
Smart Images
Figure CN123055451A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data processing, and specifically to a multi-source data management method and system. Background Technology
[0002] With the rapid development of big data, artificial intelligence, and the Internet of Things (IoT) technologies, 3D reality scene construction has become a core infrastructure driving the iterative evolution of digital cities and smart societies. However, while data is experiencing explosive growth, the secure management and efficient utilization of multi-source heterogeneous data in 3D reality scenes are facing severe challenges. Furthermore, existing data management methods lack effective encryption protection and access control for sensitive spatial data, leading to risks of leakage, tampering, and illegal copying of high-value 3D models, geographic information, and IoT sensing data throughout the entire process of collection, transmission, storage, and application. Therefore, encryption is necessary for the data transmission process in collected 3D reality scenes.
[0003] When encrypting data transmission in a real-world 3D scene using the existing one-to-ten-thousands full-data encryption strategy, it is impossible to distinguish the security level differences of different entities in the 3D space. This results in insufficient protection of sensitive data during data transmission, which can easily lead to security risks. Summary of the Invention
[0004] This invention provides a multi-data management method and system to solve the problem that existing full-data encryption strategies using one-key encryption for tens of thousands of data points can easily lead to security risks when encrypting data transmission in real-world 3D scenes.
[0005] To achieve the above objectives, the present invention provides the following technical solution: Data is collected from the real-world 3D space for data transmission, and the basic transmission rate, data volume, corresponding entity, and importance of each collected data are obtained. Based on the basic transmission rate, the importance of the corresponding entity, and the data volume of each piece of data collected, the transmission priority of each piece of data is obtained. When a piece of data is not transmitted, its state is set to "not transmitted". When an entity is not activated, its state is set to "inactive". When data transmission has not started, the state of all entities is "inactive". After collecting each piece of data, based on the transmission priority of all pieces of data collected within each inactive entity and the proportion of all pieces of data collected within it to all pieces of data in the "not transmitted" state, it is determined whether to activate each inactive entity after collecting each piece of data, and the key of the activated entity is obtained. When transmitting data, the data with the highest transmission priority is selected from the data in the state of pending transmission and whose corresponding entity is in the active state for transmission. The data to be transmitted each time is recorded as the data to be transmitted. Based on the acquisition time of the key of the entity corresponding to the data to be transmitted before each data to be transmitted, the sum of the data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, it is determined whether the key of the entity corresponding to the data to be transmitted should be updated before each data to be transmitted, and the transmission system is used for data transmission.
[0006] Furthermore, the specific calculation steps for acquiring data from the real-world 3D space to be transmitted, and obtaining the basic transmission rate, data volume, corresponding entity, and importance of each acquired data point, are as follows: Collect data from the real-world 3D space to be transmitted, obtaining multiple data points and the data volume of each collected data point; Obtain the type and entity corresponding to each piece of data collected; where the entity corresponding to the collected data is the entity in the real-world 3D space to be transmitted. Obtain the importance of the entity corresponding to each piece of data collected; Based on the type of each piece of data collected, the basic transmission rate of each piece of data is obtained.
[0007] Furthermore, the specific calculation steps for determining the transmission priority of each piece of collected data based on its basic transmission rate, the importance of the corresponding entity, and the data volume are as follows:
[0008] In the formula, Indicates the number of collections Data transmission priority Indicates the number of collections The amount of data in each data item Indicates the number of collections The basic transmission rate of each data item Indicates the number of collections The importance of each data point to the corresponding entity This represents the sigmoid function.
[0009] Furthermore, after collecting each piece of data, the specific calculation steps for determining whether to activate each entity in an inactive state after collecting each piece of data are as follows, based on the transmission priority of all data collected within each entity in an inactive state and the proportion of all data collected within that entity to all data in an inactive state: Get total collection The first data item The specific formula for calculating the activation necessity of an entity in an inactive state is as follows:
[0010] In the formula, Indicates total collection The first data item The necessity of activating entities that are inactive. Indicates the total collected The corresponding entity in the data is the first The average transmission priority of all data entries for an entity that is inactive. Indicates the total collected The number of data items in the data column whose status is pending transmission. Indicates the total collected The corresponding entity in the data is the first The number of data entities in an inactive state. It is an exponential function with the natural constant as its base. Represents the sigmoid function; Based on total collection The first data item Determine the activation necessity of each inactive entity and collect a total of [number] data. After the data entry, is the first... Activate entities that are inactive.
[0011] Furthermore, the data collected based on the total... The first data item Determine the activation necessity of each inactive entity and collect a total of [number] data. After the data entry, is the first... The specific calculation steps for activating entities that are inactive are as follows: Preset activation necessity threshold ,when At that time, in the acquisition of the first data point After the first data entry, activate the second... From an entity that is inactive, we get an entity that is active.
[0012] Furthermore, the specific calculation steps for determining whether the key of the entity corresponding to each piece of data to be transmitted should be updated before transmission, based on the sum of the acquisition time of the key of the entity corresponding to the last acquired key before transmitting each piece of data, the total data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, are as follows: The first The data to be transmitted in the next transmission is denoted as the th . The bar will transmit data; In the first Before transmitting the data, the last time the data is obtained. The time when the key corresponding to the entity transmitting the data is denoted as the [number]th [item]. The last update time of the key corresponding to the transmitted data; In the first Before transmitting the data, the last time the data is obtained. The key corresponding to the entity transmitting the data is denoted as the first key. The key will be used to transmit the data. Get the first Before transmitting the data, the first step is to check the... The specific formula for calculating the necessity of updating the key of the entity corresponding to the transmitted data is as follows:
[0013] In the formula, Indicates the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data. Indicates the first The time for transmitting data is related to the first... The interval between the latest update times of the key corresponding to the transmitted data. Indicates the first The key corresponding to the transmitted data will be used to encrypt the maximum amount of data that can be transmitted. Indicating in relation to the first The first step is to use the first step before transmitting the data. The sum of the data size of all data transmitted using the key corresponding to the transmitted data. This indicates that data will be transmitted from the first line to the second line. The frequency of abnormal attacks on the transmission system during the time period when data is being transmitted. This represents a logarithmic function with the natural constant as its base. Represents the sigmoid function; According to the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data is determined in the case of the first... Before transmitting the data, should the first step be to reacquire the data? The key will be transmitted to the entity corresponding to the data.
[0014] Furthermore, the statement based on the first Before transmitting the data, the first step is to check the data. The necessity of updating the key of the entity corresponding to the transmitted data is determined in the case of the first... Before transmitting the data, should the first step be to reacquire the data? The specific calculation steps for the key corresponding to the entity transmitting the data are as follows: Preset update necessity threshold ,like Then in the case of the first Before transmitting the data, reacquire the first... The key will be transmitted to the entity corresponding to the data. like Then in the case of the first Before transmitting the data, the first step is not to reacquire the data. The key will be transmitted to the entity corresponding to the data.
[0015] Furthermore, the specific calculation steps for data transmission are as follows: If in the case of the first Before transmitting the data, reacquire the first... The key corresponding to the entity transmitting the data will be used, using the newly acquired key. The key for the entity corresponding to the transmitted data will be used for the first... The data will be transmitted. In the first Before transmitting the data, the last time the data is obtained. The key corresponding to the entity transmitting the data is denoted as the first key. The key will be used to transmit the data. If in the case of the first Before transmitting the data, the first step is not to reacquire the data. The key corresponding to the entity transmitting the data will be used in the first step. The key corresponding to the transmitted data will be used for the first... The data will be transmitted.
[0016] A second aspect of the present invention provides a multi-source data management system, which includes a data acquisition module, an entity activation module, and a data transmission module, wherein: Data acquisition module: Acquires data from the real-world 3D space to be transmitted, and obtains the basic transmission rate, data volume, corresponding entity, and importance of each piece of data. Entity Activation Module: Based on the basic transmission rate of each piece of data, the importance of the corresponding entity, and the data volume, the transmission priority of each piece of data is obtained; when a piece of data is not transmitted, its state is set to "not transmitted"; when an entity is not activated, its state is set to "not activated," and when data transmission has not started, the state of all entities is "not activated"; after each piece of data is collected, based on the transmission priority of all pieces of data collected within each entity in the "not activated" state and the proportion of all pieces of data collected within that entity to all pieces of data in the "not transmitted" state, it is determined whether to activate each entity in the "not activated" state after collecting each piece of data, and the key of the entity in the "activated" state is obtained; Data transmission module: When transmitting data, it selects the data with the highest transmission priority from the data in the state of pending transmission and whose corresponding entity is in the active state for transmission; it records the data to be transmitted each time as the data to be transmitted; based on the acquisition time of the key of the entity corresponding to the data to be transmitted before each data to be transmitted, the sum of the data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, it determines whether the key of the entity corresponding to the data to be transmitted should be updated before transmitting each data to be transmitted, and then uses the transmission system to transmit the data.
[0017] The beneficial effects of the technical solution of the present invention are: This invention employs different keys for different entities when transmitting data within a real-world 3D space. This effectively overcomes the shortcomings of traditional one-key-to-many strategies, which cannot distinguish the differences in security levels of entities. It significantly enhances the protection capabilities of sensitive spatial data throughout its entire lifecycle, ensuring the security of high-value 3D models, geographic information, and IoT sensing data during acquisition, transmission, and storage. Furthermore, through a dynamic key update mechanism, keys are dynamically updated while ensuring security, reducing security risks and optimizing system resource utilization efficiency. This provides secure, controllable, efficient, and reliable data management support for intelligent applications in real-world 3D space. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a flowchart illustrating the steps of a multi-source data management method according to an embodiment of the present invention. Detailed Implementation
[0020] To further illustrate the technical means and effects adopted by the present invention to achieve its intended purpose, the following, in conjunction with the accompanying drawings and preferred embodiments, details the specific implementation, structure, features, and effects of a multi-source data management method and system proposed according to the present invention. In the following description, different "one embodiment" or "another embodiment" do not necessarily refer to the same embodiment. Furthermore, specific features, structures, or characteristics in one or more embodiments can be combined in any suitable form.
[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Example
[0022] This invention provides a multi-source data management method, specifically as follows: Figure 1 As shown, it includes: Step S001: Collect data from the real-world 3D space to be transmitted, and obtain the basic transmission degree, data volume, corresponding entity, and importance of each piece of data.
[0023] Specifically, data from the real-world 3D space to be transmitted is collected using sensors, resulting in multiple data points. The data volume, corresponding type, and corresponding entity of each collected data point are then obtained. The method of collecting data from the real-world 3D space to be transmitted using sensors is existing known technology and will not be elaborated upon in this embodiment. Furthermore, obtaining the corresponding type, corresponding entity, and data volume of each data point are also existing known technologies and will not be elaborated upon in this embodiment. In this embodiment, the type of each data point reflects the scene in which the data was generated. And if a data point reflects the first data point in the real-world 3D space... Information about a building indicates that the corresponding entity for that data is the building. .
[0024] Furthermore, the importance of each entity within the real-world 3D space to be transmitted is obtained, thus acquiring the importance of the entity corresponding to each piece of collected data. The method for obtaining the importance of each entity within the real-world 3D space to be transmitted is a well-known existing technology and will not be elaborated upon in this embodiment.
[0025] Furthermore, based on the type of each collected data point, the basic transfer rate of each data point is obtained, and the value range of the basic transfer rate of each data point is [0.1, 1]. Data of the same type have the same basic transfer rate. A higher basic transfer rate for a data type indicates that the data of that type is more important to the real-world 3D space. The method for obtaining the basic transfer rate of each data type is a well-known existing technology and will not be described in detail in this embodiment.
[0026] At this point, multiple data points within the real-world 3D space to be transmitted have been acquired.
[0027] Step S002: Based on the basic transmission rate of each piece of data, the importance of the corresponding entity, and the amount of data, obtain the transmission priority of each piece of data; when a piece of data is not transmitted, set its state to "not transmitted"; when an entity is not activated, set its state to "inactive", and when data transmission has not started, the state of all entities is "inactive"; after collecting each piece of data, based on the transmission priority of all pieces of data collected within each inactive entity and the proportion of all pieces of data collected within it to all pieces of data in the "not transmitted" state, determine whether to activate each inactive entity after collecting each piece of data, and obtain the key of the activated entity.
[0028] It should be noted that when transmitting data within the real-world 3D space, since it is impossible to collect all the data in an instant, there may be a situation where data is being collected continuously on one side and transmitted continuously on the other side.
[0029] It should be further explained that, since the collected data cannot be transmitted all at once, the priority of each data is calculated during data transmission, and data with higher priority is transmitted first.
[0030] It's important to further clarify that, based on the scenario in which the data was generated—that is, based on the type of data—the data itself carries a basic transmission rate. For example, data that triggers a threshold alarm has a higher basic transmission rate, while data collected periodically in a regular manner has a lower basic transmission rate. The basic transmission rate of data largely determines its transmission priority. Therefore, the transmission priority of each piece of data is calculated based on its basic transmission rate.
[0031] It's important to further explain that during data transmission, the larger the amount of data in a single piece of data, the longer the transmission time, and the more likely it is to block the queue, preventing higher-priority data from being transmitted in line. Conversely, the smaller the amount of data in a single piece of data, the shorter the transmission time. Therefore, data with less information is prioritized for transmission. Thus, the transmission priority of each piece of data is calculated based on its information content.
[0032] It should be further clarified that currently, when transmitting data, the same key is used to transmit data for all entities within the 3D scene. That is, currently, after data acquisition, the same key is used to transmit data for different entities, leading to a situation where one key corresponds to tens of thousands of entities, and making it impossible to distinguish the security levels of different entities in 3D space. Therefore, this invention uses different keys to transmit data within different entities. Furthermore, the more important an entity, the higher the priority of transmitting its data. Therefore, the transmission priority of each piece of data is calculated based on the entity corresponding to each data point.
[0033] It should be further explained that currently, different keys are used for transmission to different entities. To better protect the transmission process, the keys should be updated periodically. To conserve resources, an entity should be activated after a significant amount of data has been collected. This involves the entity generating a key and initiating the transmission of its information. Therefore, during data transmission, the activation of each entity is determined first based on the amount of data collected. If the untransmitted data within an entity has a higher priority, that entity should be activated. Thus, based on data from two dimensions, the activation of each entity is determined, and then the data within the activated entities is transmitted.
[0034] Specifically, the first collected data... The specific formula for calculating the transmission priority of each data item is as follows:
[0035] In the formula, Indicates the number of collections Data transmission priority Indicates the number of collections The amount of data in each data item Indicates the number of collections The basic transmission rate of each data item is set to a value of [value]. ; Indicates the number of collections The importance of each data point to the corresponding entity The sigmoid function is used for normalization in this embodiment. The method for obtaining the data volume for each data point is a well-known technique and will not be elaborated upon in this embodiment.
[0036] It should be noted that while smaller amounts of data can be transmitted quickly, larger amounts of data may block the queue during transmission, causing delays. The larger the value, the more likely the data is to be collected. The lower the transmission priority of each data item, the faster it can be transmitted. To represent an inverse proportional relationship; As a molecule, it is used to represent the first [unit / molecule] collected. The higher the importance of the entity corresponding to the data item, the higher the importance of the data item collected. The higher the priority of each data transmission, the better; It is used to represent the first collection. The higher the base transfer rate of each data entry, the better. The more data items, the higher the priority for transmission.
[0037] Furthermore, if the collected first If the first piece of data has not been transmitted, set its status to "pending transmission"; if the collected data is the first piece of data... If a piece of data has been transmitted or is being transmitted, its status is changed from pending transmission to transmitted. Note that a piece of data cannot be in both pending and transmitted states simultaneously.
[0038] Furthermore, before data is transmitted, all entities are inactive; when an entity is activated, its state becomes active.
[0039] Furthermore, after each data point is collected, it is determined whether each entity in an inactive state should be activated. The specific steps are as follows: Furthermore, a total of [number] samples were collected. The first data item The specific formula for calculating the activation necessity of an entity in an inactive state is as follows:
[0040] In the formula, Indicates total collection The first data item The necessity of activating entities that are inactive. Indicates the total collected The corresponding entity in the data is the first The average transmission priority of all data entries for an entity whose state is inactive; Indicates the total collected The number of data items in the data column whose status is pending transmission. Indicates the total collected The corresponding entity in the data is the first The number of data entities in an inactive state. As an exponential function with the natural constant as its base, this embodiment uses it to represent an inverse proportional relationship; This represents the sigmoid function, used in this embodiment for normalization. The total number of samples collected... The data points totaled [number] collected from the real-world 3D space where data was to be transmitted. The first data point, i.e., when the first data point was collected... After collecting data, a total of [number] data points were collected. The status of each data item.
[0041] It should be noted that, A larger value indicates a larger total amount collected. The corresponding entity in the data is the first The data within entities in the inactive state generally have a higher overall priority, further illustrating that the first... Data within an entity that is currently inactive needs to be transmitted first; in this case, the entity inactive should be activated. The entity in the inactive state, for the collected... Data within an entity that is inactive is transmitted; The larger the value, the more data was collected. Most of the data that was not transmitted in the data entries were the first ones. Data within an entity that is currently inactive is activated at this point. The entity in the inactive state begins to process the first entity. Transmitting data within an entity that is inactive has a high cost-effectiveness and saves key resources. It is used to indicate that when the first When 40% of the data within an entity in an inactive state constitutes the data that has not been transmitted, it is considered that the transmission of the first inactive entity begins. Transmitting data within an entity that is inactive has a high cost-effectiveness ratio; The function is in If the value is less than 0, output a positive number.
[0042] Furthermore, a preset activation necessity threshold is established. ,when At that time, in the acquisition of the first data point After the first data entry, activate the second... From an inactive entity, an active entity is obtained. Furthermore, upon activating an entity, its key is simultaneously acquired. In this embodiment, the activation necessity threshold... The design references spatial interaction data from historical operation phases. Specifically, by collecting grid data flow information from the transmission of data within the real-world 3D scene during historical phases, this step calculates the activation necessity of each inactive entity after each data point is collected in each historical phase. Combined with the actual successful activation of spatial entities in each historical phase, phases that generated effective mapping without causing system overload are selected, and the activation necessity corresponding to these phases is extracted. The value is then used. Finally, the average value of the entity activation necessity calculated during this phase is set as the threshold. In this embodiment, the threshold is... In other embodiments The value depends on the complexity of the specific real-world 3D scene.
[0043] At this point, the activation of several entities in the pending activation state has been completed.
[0044] Step S003: When transmitting data, select the data with the highest transmission priority from the data in the state of pending transmission and the corresponding entity in the state of active for transmission; record the data to be transmitted each time as the data to be transmitted; based on the acquisition time of the key of the entity corresponding to the data to be transmitted before each data to be transmitted, the sum of the data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, determine whether the key of the entity corresponding to the data to be transmitted should be updated before transmitting each data to be transmitted, and use the transmission system to transmit data.
[0045] It should be noted that, currently, during data transmission, after the data encryption processing queue is allocated based on the limited data transmission capacity, an independent key update strategy is set to prevent the overall data transmission security from being threatened due to the leakage of a single key. If the key of the entity corresponding to the data has not been updated for a long time, and the amount of data encrypted using that entity's key is large, then updating the key of the entity corresponding to the data will be considered. Simultaneously, the frequency of recent system attacks will be considered; a higher frequency indicates a higher potential threat to the system in the near future, thus requiring consideration of updating the key of the entity corresponding to the data.
[0046] Specifically, after activating an entity, its key is simultaneously obtained. When selecting data for transmission, the data with the highest transmission priority is selected from the data in the "pending transmission" state and whose corresponding entity is in the "activated" state. If the number of data items corresponding to the highest transmission priority among all data items satisfying the above conditions at the same time is more than one, then the data item with the least amount of data is selected for transmission. Obtaining an entity's key is a well-known existing technique and will not be elaborated upon in this embodiment.
[0047] Furthermore, the first The data to be transmitted in the next transmission is denoted as the th . The bar will transmit data.
[0048] Furthermore, in the case of the first Before transmitting the data, the last time the data is obtained. The time when the key corresponding to the entity transmitting the data is denoted as the [number]th [item]. The last update time of the key corresponding to the transmitted data.
[0049] Furthermore, in the case of the first Before transmitting the data, the last time the data is obtained. The key corresponding to the entity transmitting the data is denoted as the first key. The key will be used to transmit the data.
[0050] Furthermore, obtain information about the first Before transmitting the data, the first step is to check the... The specific formula for calculating the necessity of updating the key of the entity corresponding to the transmitted data is as follows:
[0051] In the formula, Indicates the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data. Indicates the first The time for transmitting data is related to the first... The interval between the latest update times of the key corresponding to the transmitted data. Indicates the first The key corresponding to the transmitted data will be used to encrypt the maximum amount of data that can be transmitted. Indicating in relation to the first The first step is to use the first step before transmitting the data. The sum of the data size of all data transmitted using the key corresponding to the transmitted data. This indicates that data will be transmitted from the first line to the second line. The frequency of abnormal attacks on the transmission system during the time period when data is being transmitted. This represents a logarithmic function with the natural constant as its base. The sigmoid function is used for normalization in this embodiment. Obtaining the frequency of abnormal attacks on the transmission system within a certain period is a known technique and will not be elaborated upon in this embodiment. Furthermore, after obtaining each key, the maximum amount of data that each key can encrypt and transmit is also obtained; this is a known technique and will not be elaborated upon in this embodiment.
[0052] It should be noted that, Indicates the first Before transmitting the data, if the first... If the key corresponding to the entity transmitting the data has not been updated for a long time, in order to reduce the risk of leakage, the key for the entity transmitting the data will be updated. The greater the likelihood that the key corresponding to the entity transmitting the data will be updated; The larger the value, the more significant the th . The more data transmitted using the key corresponding to the transmitted data, the more necessary it is to reduce the risk of leakage. The greater the likelihood that the key corresponding to the entity transmitting the data will be updated; The larger the value, the higher the transmission time from the start of using the transmission system to the completion of the [number of transmissions]. The more attacks the transmission system receives in the period preceding the next transmission, the more important it is to reduce the risk of leakage. The greater the likelihood that the key corresponding to the entity transmitting the data will be updated, the higher the probability; an exponential function is used for smoothing. right The influence of the logarithmic function; It is to prevent when When it is 0, It is used to prevent when When it is 0, This makes it possible at this time The result is always 0.
[0053] Furthermore, set an update necessity threshold. ,like Then in the case of the first Before transmitting the data, reacquire the first... The key will be transmitted to the entity corresponding to the data, and then the newly acquired key will be used to access the next data. The data will be transmitted. If Then in the case of the first Before transmitting the data, the first step is not to reacquire the data. The key for the entity corresponding to the transmitted data will be used subsequently. The key corresponding to the transmitted data will be used for the first... The data will be transmitted. Threshold. The threshold is set based on historical attack response data during data transmission. By collecting encrypted transmission records and attack frequency data from historical periods, the necessity of updating the key of the entity corresponding to the transmitted data during each transmission in each historical period is calculated. Considering the actual risk of key leakage or proactive security defense triggering in each historical period, the periods in which key updates were actually performed and threats were successfully blocked are selected, and the necessity of updating the key of the entity corresponding to the transmitted data in these periods is extracted. The average value of the calculated key update necessity within these periods is set as the threshold. In this embodiment, the threshold... In other embodiments The value depends on the specific data sensitivity level and security environment. Updating the key is a well-known technique and will not be described in detail in this embodiment. Similarly, using the key to transmit data is a well-known technique and will not be described in detail in this embodiment.
[0054] This concludes the embodiment.
[0055] Another embodiment of the present invention provides a multi-data management system, which includes a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, it implements the above-described method steps S001 to S003.
Claims
1. A multi-source data management method, characterized in that, The method includes the following steps: Data is collected from the real-world 3D space for data transmission, and the basic transmission rate, data volume, corresponding entity, and importance of each collected data are obtained. Based on the basic transmission rate, the importance of the corresponding entity, and the data volume of each piece of data collected, the transmission priority of each piece of data is obtained. When a piece of data is not transmitted, its state is set to "not transmitted". When an entity is not activated, its state is set to "inactive". When data transmission has not started, the state of all entities is "inactive". After collecting each piece of data, based on the transmission priority of all pieces of data collected within each inactive entity and the proportion of all pieces of data collected within it to all pieces of data in the "not transmitted" state, it is determined whether to activate each inactive entity after collecting each piece of data, and the key of the activated entity is obtained. When transmitting data, the data with the highest transmission priority is selected from the data in the state of pending transmission and whose corresponding entity is in the active state for transmission. The data to be transmitted each time is recorded as the data to be transmitted. Based on the acquisition time of the key of the entity corresponding to the data to be transmitted before each data to be transmitted, the sum of the data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, it is determined whether the key of the entity corresponding to the data to be transmitted should be updated before each data to be transmitted, and the transmission system is used for data transmission.
2. The multi-source data management method according to claim 1, characterized in that, The specific calculation steps for acquiring data from the real-world 3D space to be transmitted, and obtaining the basic transmission degree, data volume, corresponding entity, and importance of each acquired data point, are as follows: Collect data from the real-world 3D space to be transmitted, obtaining multiple data points and the data volume of each collected data point; Obtain the type and entity corresponding to each piece of data collected; where the entity corresponding to the collected data is the entity in the real-world 3D space to be transmitted. Obtain the importance of the entity corresponding to each piece of data collected; Based on the type of each piece of data collected, the basic transmission rate of each piece of data is obtained.
3. The multi-source data management method according to claim 1, characterized in that, The specific calculation steps for determining the transmission priority of each piece of data based on its basic transmission rate, the importance of the corresponding entity, and the data volume are as follows: ； In the formula, Indicates the number of collections Data transmission priority Indicates the number of collections The amount of data in each data item Indicates the number of collections The basic transmission rate of each data item Indicates the number of collections The importance of each data point to the corresponding entity This represents the sigmoid function.
4. The multi-source data management method according to claim 1, characterized in that, After collecting each piece of data, the specific calculation steps for determining whether to activate each entity in an inactive state after collecting each piece of data are as follows: based on the transmission priority of all data collected within each entity in an inactive state and the proportion of all data collected within that entity to all data in an inactive state. Get total collection The first data item The specific formula for calculating the activation necessity of an entity in an inactive state is as follows: ； In the formula, Indicates total collection The first data item The necessity of activating entities that are inactive. Indicates the total collected The corresponding entity in the data is the first The average transmission priority of all data entries for an entity that is inactive. Indicates the total collected The number of data items in the data column whose status is pending transmission. Indicates the total collected The corresponding entity in the data is the first The number of data entities in an inactive state. It is an exponential function with the natural constant as its base. Represents the sigmoid function; Based on total collection The first data item Determine the activation necessity of each inactive entity and collect a total of [number] data. After the data entry, is the first... Activate entities that are inactive.
5. The multi-source data management method according to claim 4, characterized in that, The data collected based on the total The first data item Determine the activation necessity of each inactive entity and collect a total of [number] data. After the data entry, is the first... The specific calculation steps for activating entities that are inactive are as follows: Preset activation necessity threshold ,when At that time, in the acquisition of the first data... After the first data entry, activate the second... From an entity that is inactive, we get an entity that is active.
6. The multi-source data management method according to claim 1, characterized in that, The specific calculation steps for determining whether the key of the entity corresponding to each piece of data to be transmitted should be updated before transmission, based on the sum of the acquisition time of the key of the entity corresponding to the last acquired key before each piece of data to be transmitted, the total amount of data transmitted with that key, and the frequency of attacks on the transmission system, are as follows: The first The data to be transmitted in the next transmission is denoted as the th . The bar will transmit data; In the first Before transmitting the data, the last time the data is obtained. The time when the key corresponding to the entity transmitting the data is denoted as the [number]th [item]. The last update time of the key corresponding to the transmitted data; In the first Before transmitting the data, the last time the data is obtained. The key corresponding to the entity transmitting the data is denoted as the first key. The key will be used to transmit the data. Get the first Before transmitting the data, the first step is to check the... The specific formula for calculating the necessity of updating the key of the entity corresponding to the transmitted data is as follows: ； In the formula, Indicates the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data. Indicates the first The time for transmitting data is related to the first... The interval between the latest update times of the key corresponding to the transmitted data. Indicates the first The key corresponding to the transmitted data will be used to encrypt the maximum amount of data that can be transmitted. Indicating in relation to the first The first step is to use the first step before transmitting the data. The sum of the data size of all data transmitted using the key corresponding to the transmitted data. This indicates that data will be transmitted from the first line to the second line. The frequency of abnormal attacks on the transmission system during the time period when data is being transmitted. This represents a logarithmic function with the natural constant as its base. Represents the sigmoid function; According to the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data is determined in the case of the first... Before transmitting the data, should the first step be to reacquire the data? The key will be transmitted to the entity corresponding to the data.
7. The multi-source data management method according to claim 6, characterized in that, The basis for the first Before transmitting the data, the first step is to check the... The necessity of updating the key of the entity corresponding to the transmitted data is determined in the case of the first... Before transmitting the data, should the first step be to reacquire the data? The specific calculation steps for the key corresponding to the entity transmitting the data are as follows: Preset update necessity threshold ,like Then in the case of the first Before transmitting the data, reacquire the first... The key will be transmitted to the entity corresponding to the data. like Then in the case of the first Before transmitting the data, the first step is not to reacquire the data. The key will be transmitted to the entity corresponding to the data.
8. The multi-source data management method according to claim 1, characterized in that, The specific calculation steps for data transmission are as follows: If in the case of the first Before transmitting the data, reacquire the first... The key corresponding to the entity transmitting the data will be used, using the newly acquired key. The key for the entity corresponding to the transmitted data will be used for the first... The data will be transmitted. In the first Before transmitting the data, the last time the data is obtained. The key corresponding to the entity transmitting the data is denoted as the first key. The key will be used to transmit the data. If in the case of the first Before transmitting the data, the first step is not to reacquire the data. The key corresponding to the entity transmitting the data will be used in the first step. The key corresponding to the transmitted data will be used for the first... The data will be transmitted.
9. A multi-data management system, characterized in that, The system includes the following modules: Data acquisition module: Acquires data from the real-world 3D space to be transmitted, and obtains the basic transmission rate, data volume, corresponding entity, and importance of each piece of data. Entity Activation Module: Based on the basic transmission rate of each piece of data, the importance of the corresponding entity, and the data volume, the transmission priority of each piece of data is obtained; when a piece of data is not transmitted, its state is set to "not transmitted"; when an entity is not activated, its state is set to "not activated," and when data transmission has not started, the state of all entities is "not activated"; after each piece of data is collected, based on the transmission priority of all pieces of data collected within each entity in the "not activated" state and the proportion of all pieces of data collected within that entity to all pieces of data in the "not transmitted" state, it is determined whether to activate each entity in the "not activated" state after collecting each piece of data, and the key of the entity in the "activated" state is obtained; Data transmission module: When transmitting data, it selects the data with the highest transmission priority from the data in the state of pending transmission and whose corresponding entity is in the active state for transmission; it records the data to be transmitted each time as the data to be transmitted; based on the acquisition time of the key of the entity corresponding to the data to be transmitted before each data to be transmitted, the sum of the data volume of all data transmitted with that key, and the frequency of attacks on the transmission system, it determines whether the key of the entity corresponding to the data to be transmitted should be updated before transmitting each data to be transmitted, and then uses the transmission system to transmit the data.