Portable secure storage device and storage method thereof

Abstract

The invention discloses a portable secure storage device and a storage method thereof, and relates to the technical field of data storage, a storage node function module is embedded in the portable secure storage device, and when the storage node function module is activated and connected to a distributed file system constructed based on a main storage server and a plurality of terminals, the storage node function module is used for storing the data. Automatically serving as a newly added storage node of the distributed file system; the portable secure storage device carries a client program and adopts a file block storage technology; when the distributed file system carries out data balancing on the newly-added storage node, data blocks related to the authenticated user are preferentially synchronized to the newly-added storage node, the synchronized data size accounts for the first set data proportion, and the remaining data with the second set data proportion is distributed in other storage nodes; and the main storage server keeps a complete data copy. On the premise of ensuring data security, a more efficient and convenient data storage scheme is provided.

Description

Technical Field

[0001] The present application relates to the technical field of data storage, and in particular to a portable secure storage device and a storage method thereof. Background Art

[0002] With the rapid development of information technology, the demand for data storage by individuals and enterprises is growing. Traditional centralized storage methods have many limitations, such as single point failure, poor scalability, and insufficient data security. In order to solve these problems, distributed file systems came into being.

[0003] However, the existing distributed file systems still have shortcomings in data security and network resource utilization. For example, data is usually stored in the form of complete files on each node. Once a node is illegally accessed, the security of the entire file will be threatened. In addition, traditional network disk files are stored on the Internet, and the data is downloaded through the Internet. If the file is large in capacity, the transmission process takes a long time, which is extremely inconvenient for users. Caching files to computers also loses the flexibility of network disks, and data consistency cannot be guaranteed when used through USB flash drives. In addition, large-scale data transmission will take up a lot of network bandwidth, affecting the overall performance of the system.

[0004] To sum up, there is an urgent need to develop a more efficient and convenient data storage solution while ensuring data security. Summary of the invention

[0005] In order to provide a more efficient and convenient data storage solution while ensuring data security, the present application provides a portable secure storage device and a storage method thereof.

[0006] In the first aspect, the invention objective of the present application is achieved by adopting the following technical solutions: A portable secure storage device, including but not limited to a USB flash drive, wherein the portable secure storage device has a storage node function module embedded therein, and when the storage node function module is activated and connected to a distributed file system constructed based on a main storage server and multiple terminals, the storage node function module automatically serves as a newly added storage node of the distributed file system; The portable secure storage device is equipped with a client program and adopts file block storage technology, allowing the user to enter personal account information for identity authentication and access; when the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the synchronized data volume accounts for a first set data ratio of the total data volume of the authenticated user, and the remaining data of the second set data ratio is distributed in other storage nodes of the distributed file system; The primary storage server maintains a complete copy of the data.

[0007] By adopting the above technical solution, a secure network disk constructed by a distributed storage file system (FS) with a main storage server and multiple terminals is provided; the storage form of the portable secure storage device also includes a mobile hard disk, a solid-state hard disk, a smart storage card, etc.; the present invention enables users to access most of their personal data in an offline state and quickly obtain the remaining data when the network is connected, which significantly reduces the demand for network bandwidth when downloading files or processing data. In addition, since the portable secure storage device adopts block storage technology, when the portable secure storage device is not connected to the network or is not logged in by a legitimate user, it is impossible to directly read or display any complete file content, and the existence of the file block must be identified by designated software, thereby improving data security-the user needs to enter personal account information through the client program for identity authentication to ensure that only legitimate users can access the stored data, and the data blocks are dispersedly stored in the distributed file system according to a set ratio (for example, 90% and 10%). Even if a storage node is lost or damaged, it can be retrieved through other nodes. Point recovery data improves the fault tolerance and security of data. At the same time, the main storage server retains a complete copy of the data to ensure that the integrity of the data is not affected, and at the same time provides a disaster recovery mechanism; optimizes the utilization of network resources, that is, through the data preloading function, for example, the present invention preferentially synchronizes the data blocks related to the authenticated user to the new storage node, so that the user can access most of the personal data in an offline state, reducing the amount of data transmission when online. By caching 90% of the data blocks locally, the user only needs to download the remaining 10% of the data from the network, which significantly reduces the pressure of network transmission and improves data access efficiency. The user can access most of the synchronized data in an offline state and can switch seamlessly between different devices. He only needs to log in to the client program to access personal data, which enhances the flexibility of cross-platform use. Finally, by dynamically adding storage nodes to join the distributed file system, the storage capacity and expansion capability of the distributed storage system are increased. By automatically balancing data, the rationality of the load distribution of the distributed storage system can also be ensured.

[0008] In a preferred example of the present application: the storage form of the portable secure storage device also includes a mobile hard disk, a solid-state hard disk, a smart memory card, a wireless storage device or a dongle; the sum of the first setting data proportion and the second setting data proportion is 100%.

[0009] By adopting the above technical solution, a variety of storage forms are adopted (mobile hard disk, solid-state hard disk, smart memory card, wireless storage device or encryption dongle), and these storage devices each have different characteristics and advantages; for example, the mobile hard disk and solid-state hard disk provide large-capacity storage, which is suitable for backing up large amounts of data; the smart memory card is easy to embed in various devices and has high flexibility; the wireless storage device supports remote access and facilitates sharing; the encryption dongle focuses on data security; by integrating these storage forms into a portable secure storage device, users can choose the most suitable storage form according to specific needs, thereby improving the applicability and flexibility of the storage device, and the sum of the first setting data proportion and the second setting data proportion is 100%, ensuring the integrity and decentralized storage of the data.

[0010] In a preferred example of the present application: the first setting data accounts for 90%, and the second setting data accounts for 10%.

[0011] By adopting the above technical solution, 90% of the data blocks of the authenticated user are synchronized on the portable secure storage device, and the remaining 10% of the data blocks are distributed to other storage nodes. This not only improves the security of the data, but also ensures that the user can access most of the data in an offline state, reducing dependence on the network.

[0012] In the second aspect, the invention objective of the present application is achieved by adopting the following technical solutions: A storage method of a portable secure storage device is applied to the portable secure storage device as described above, the method comprising: When the storage node function module embedded in the portable secure storage device is activated and connected to a distributed file system based on a main storage server and multiple terminal components, it automatically serves as a new storage node of the distributed file system; The portable secure storage device is equipped with a client program and uses file block storage technology, allowing the user to enter personal account information for identity authentication and access; When the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the synchronized data volume accounts for a first set data proportion of the total data volume of the authenticated user, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system; Maintaining a complete copy of the data on the primary storage server; Obtaining the storage capacity and currently used capacity of the portable secure storage device, and calculating the available storage space; According to the available storage space and the total amount of data of the authenticated user, the first set data ratio and the second set data ratio are adjusted to optimize the preset data synchronization strategy; The adjusted first set data ratio and the second set data ratio are input into the data balancing algorithm of the distributed file system to generate a final data synchronization plan.

[0013] By adopting the above technical solution, based on identity authentication and encryption, only legal users can access the stored data. Combined with the data blocks, they are stored in a distributed file system in a ratio of 90% and 10%. Even if a storage node is lost or damaged, data can be restored through other nodes, which improves the fault tolerance and security of the data. Through data preloading, users can access most of their personal data when offline, reducing the amount of data transmission when online. By caching 90% of the data blocks locally, users only need to download the remaining 10% of the data from the network, which significantly reduces the pressure on network transmission. At the same time, dynamically adding storage nodes to the distributed file system is conducive to increasing the storage capacity and expansion capabilities of the system.

[0014] In a preferred example of the present application: when the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the amount of synchronized data accounts for a first set data proportion of the total amount of authenticated user data, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system, specifically including: When the distributed file system performs data balancing on a newly added storage node, based on the personal account information of the authenticated user, the personal account information of the authenticated user is obtained, and information of all data blocks related to the user is obtained, including identification, size and priority of the data blocks; Associating the identifier, size and priority of the data block to generate a data block priority list; According to the data block priority list, the high-priority data blocks are preferentially synchronized to the newly added storage node until the first set data proportion is reached; For the remaining data blocks, they are distributed to other storage nodes of the distributed file system according to their priorities and distribution strategies.

[0015] By adopting the above technical solution, high and low priority calculations and applications are implemented to ensure that the user's most frequently used and most important data is synchronized to the portable secure storage device. By synchronizing high-priority data blocks to the portable secure storage device, the user can access most of the data in an offline state, reducing dependence on the network. The system can automatically balance data to ensure that the load of each storage node is reasonably distributed, thereby improving the stability and performance of the overall system.

[0016] In a preferred example of the present application, according to the data block priority list, the high-priority data blocks are preferentially synchronized to the newly added storage node until the first set data proportion is reached, specifically including: inputting the data block priority list into a data synchronization model; Extracting the size information of each data block, and calculating the number of data blocks required to be synchronized based on the size information of each data block and the first set data ratio; Synchronize the data blocks to the newly added storage nodes in order of priority from high to low until the first set data proportion is reached; and / or, The step of inputting the adjusted first set data proportion and second set data proportion into the data balancing algorithm of the distributed file system to generate a final data synchronization plan specifically includes: Inputting the adjusted first set data proportion and second set data proportion into a data balancing algorithm; Inputting the available storage space of the portable secure storage device and the total data volume information of the authenticated user into a data balancing algorithm; generating the synchronization priority and target storage node of each data block according to the data balancing algorithm; Associate the synchronization priority of each data block with the target storage node information to generate the final data synchronization plan; The final data synchronization plan is sent to each storage node of the distributed file system.

[0017] By adopting the above technical solution, the data block priority list is input into the data synchronization model to synchronize the data blocks in order from high to low priority, so that data blocks with higher priorities are synchronized to the portable security storage device in priority to data blocks with lower priorities, thereby improving the accuracy and efficiency of data synchronization. Combined with the data balancing algorithm, the first set data ratio and the second set data ratio are adjusted to ensure the effective use of storage resources. According to the available storage space of the portable security storage device and the total data volume information of the authenticated user, the synchronization priority and target storage node of each data block are generated, thereby achieving a reasonable distribution of data among the various storage nodes and avoiding the problem of overload of a certain node.

[0018] In a preferred example of the present application: the method further includes: According to a historical operation data set of the portable secure storage device, identifying and acquiring historical data transmission efficiency data and working status information under multiple usage scenarios, wherein the working status information covers multiple working mode intervals corresponding to different security levels; The portable secure storage device is associated with a unique device identifier, and based on the device identifier, a historical control data set of the storage device in each usage scenario is obtained, and combined with a preset initial security management model, training is performed with security performance and data transmission efficiency as optimization goals to obtain an optimized security control model; Analyze and determine data transmission correlation factors and safety factors between storage devices in various usage scenarios based on historical operation data sets of portable secure storage devices; In the optimized security control model, based on the data transmission correlation factors, safety factors and security parameter adjustment strategies corresponding to the historical control data sets of all usage scenarios, the optimal data transmission efficiency threshold and safety performance index of the portable security storage device in each working mode range are determined to generate the optimal security control strategy; The data transmission efficiency management and security performance regulation of the portable security storage device are performed according to the optimal security control strategy.

[0019] By adopting the above technical solution, the optimized security control model is conducive to improving data transmission efficiency. By obtaining working status information of multiple working mode intervals corresponding to different security levels, it ensures that the most appropriate security mode can be selected in different usage scenarios. By analyzing and determining the data transmission correlation factors and safety factors between the storage devices of each usage scenario, a scientific basis is provided for formulating the optimal security control strategy. Combined with the historical control data sets under each usage scenario, personalized security parameter adjustment strategies are formulated for different devices and usage scenarios, which improves the accuracy and effectiveness of management. Through optimized data transmission efficiency and security performance, users can obtain fast and secure data access experience in different usage scenarios.

[0020] In a preferred example of the present application, the identification and acquisition of historical data transmission efficiency data and working status information in multiple usage scenarios based on the historical operation data set of the portable secure storage device specifically includes: According to the historical operation data set of the portable secure storage device, historical task information performed by the storage device in each usage scenario and the corresponding data transmission volume are obtained; According to the historical task information of the storage device in each usage scenario and the corresponding data transmission volume, a plurality of historical operation time intervals are obtained; Based on the device identifier and in combination with the plurality of historical operation time intervals, historical task information and corresponding data transmission volumes of the storage device in each usage scenario are classified to obtain historical data transmission efficiency data of the storage device; Based on historical data transmission efficiency data in multiple usage scenarios and preset working status determination criteria, working status information of the storage device in each usage scenario is determined.

[0021] By adopting the above technical scheme, multiple historical operation time intervals are divided according to historical task information and data transmission volume, which ensures the time continuity and integrity of the data and improves the accuracy of data transmission efficiency evaluation. Based on the historical data transmission efficiency data in multiple usage scenarios and the preset working status judgment criteria, the working status information of the storage device in each usage scenario is accurately determined, ensuring the accuracy and reliability of working status identification. Through in-depth analysis of historical operation data sets, the data transmission efficiency and working status in different usage scenarios are identified, which provides a scientific basis for personalized management. Based on accurate working status information, the operating parameters and strategies of the storage device can be dynamically adjusted to meet the needs of different users and scenarios, thereby improving the accuracy and effectiveness of management.

[0022] In a preferred example of the present application: the data transmission associated factors include storage medium read and write efficiency factors, data processing efficiency factors, interface transmission efficiency factors and external interference factors; The step of analyzing and determining the data transmission correlation factor and safety factor between the storage devices in each usage scenario based on the historical operation data set of the portable secure storage device specifically includes: According to the historical operation data set of the portable secure storage device, the data transmission rate, data processing volume and external interference status of the storage device in each usage scenario are obtained; In combination with the data transmission paths, data processing procedures and external interference factors between various usage scenarios, the efficiency value of the data transmission correlation factor of the storage device in each usage scenario is calculated and determined; Based on the data transmission rate, data processing volume, external interference conditions and efficiency values ​​of data transmission related factors in each usage scenario, a comprehensive assessment is made to determine the safety factor between each usage scenario.

[0023] By adopting the above technical scheme, combined with the data transmission path and data processing flow between various usage scenarios, the comprehensiveness and accuracy of data transmission efficiency evaluation are ensured, and the storage medium read and write efficiency factor, data processing efficiency factor, interface transmission efficiency factor and external interference factor are comprehensively considered to comprehensively evaluate the safety factor in each usage scenario. Based on the comprehensive evaluation of the safety factor, the operating parameters and strategies of the storage device can be dynamically adjusted to adapt to the needs of different users and scenarios, thereby improving the accuracy and effectiveness of management. The optimized safety factor evaluation and management strategy ensure smooth switching in different usage scenarios, thereby improving the stability of the system and user satisfaction.

[0024] In a preferred example of the present application: the data transmission association factor also includes a storage medium aging factor and an interface stability factor, and the method further includes: The data transmission correlation factor of the portable secure storage device in each usage scenario is constrained and calculated and optimized based on the following formula: E eff =D trans / T proc ×(1+a stor ×A stor +a ptor ×A ptor +a intf ×A intf +a ext ×A ext ) Among them, E eff Indicates the data transmission efficiency of the storage device; D trans is the amount of data transmitted in a specific time interval; T proc is the total processing time of the time interval; a stor is the influence coefficient of storage medium aging factor; a ptor is the influence coefficient of data processing efficiency factor; a intf is the influence coefficient of the interface stability factor; a ext is the influence coefficient of external interference factors; A stor A is the actual measured value or estimated value of the storage medium aging factor; ptor is the actual measured value or estimated value of the data processing efficiency factor; A intf is the actual measured value or estimated value of the interface stability factor; A ext is the actual measured value or estimated value of the external interference factor; A is a constant coefficient used to adjust the model accuracy.

[0025] By adopting the above technical scheme, the storage medium aging factor and the interface stability factor are introduced, various factors affecting the data transmission efficiency are comprehensively considered, and the data transmission efficiency is constrained and optimized based on the formula to ensure the scientific nature and reliability of the data transmission efficiency evaluation. The storage medium aging factor, data processing efficiency factor, interface stability factor and external interference factor are comprehensively considered to comprehensively evaluate the safety factor in each usage scenario. The efficiency value of the data transmission associated factor of the storage device in each usage scenario is determined by calculation, ensuring the scientific nature and reliability of the safety factor evaluation.

[0026] In summary, the present application includes at least one of the following beneficial technical effects: 1. Significantly reduces the demand for network bandwidth when downloading files or processing data. Because the portable secure storage device uses block storage technology, when the portable secure storage device is not connected to the network or is not logged in by a legitimate user, it cannot directly read or display any complete file content. The user needs to enter personal account information through the client program for identity authentication to ensure that only legitimate users can access the stored data. The data blocks are dispersed and stored in the distributed file system according to the set ratio. Even if a storage node is lost or damaged, the data can be restored through other nodes, which improves the fault tolerance and security of the data. At the same time, the main storage server retains a complete copy of the data to ensure that the integrity of the data is not affected, and a disaster recovery mechanism is provided. system; optimize network resource utilization, that is, through the data preloading function, for example, the present invention preferentially synchronizes the data blocks related to the authenticated user to the new storage node, so that the user can access most of the personal data in the offline state, reducing the amount of data transmission when online, reducing the pressure of network transmission, and improving data access efficiency. The user can access most of the synchronized data in the offline state, and can seamlessly switch between different devices. Only need to log in to the client program to access personal data, which enhances the flexibility of cross-platform use. Finally, by dynamically adding storage nodes to the distributed file system, the storage capacity and expansion capability of the distributed storage system are increased. By automatically balancing data, the rationality of the load distribution of the distributed storage system can also be ensured; 2. The optimized security control model is conducive to improving data transmission efficiency. By obtaining the working status information of multiple working mode intervals corresponding to different security levels, it ensures that the most appropriate security mode can be selected in different usage scenarios. By analyzing and determining the data transmission correlation factors and safety factors between storage devices in each usage scenario, it provides a scientific basis for formulating the optimal security control strategy. Combined with the historical control data sets in each usage scenario, personalized security parameter adjustment strategies are formulated for different devices and usage scenarios, which improves the accuracy and effectiveness of management. Through optimized data transmission efficiency and security performance, users can obtain fast and secure data access experience in different usage scenarios. 3. Combined with the data transmission paths and data processing processes between various usage scenarios, the comprehensiveness and accuracy of the data transmission efficiency evaluation are ensured. The storage medium read and write efficiency factor, data processing efficiency factor, interface transmission efficiency factor and external interference factor are comprehensively considered to comprehensively evaluate the safety factor in each usage scenario. Based on the comprehensive evaluation of the safety factor, the operating parameters and strategies of the storage device can be dynamically adjusted to meet the needs of different users and scenarios, thereby improving the accuracy and effectiveness of management. The optimized safety factor evaluation and management strategy ensure smooth switching in different usage scenarios, thereby improving the stability of the system and user satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is an application example diagram of a portable secure storage device in one embodiment of the present application; Figure 2 is a flow chart of a storage method of a portable secure storage device in one embodiment of the present application; Figure 3 is a flowchart of step S3 in a storage method of a portable secure storage device in one embodiment of the present application; Figure 4 This is another flow chart of a storage method of a portable secure storage device in one embodiment of the present application. DETAILED DESCRIPTION

[0028] The present application is further described in detail below in conjunction with the accompanying drawings.

[0029] In one embodiment, if Figure 1 As shown, Figure 1 This is an application example diagram of a portable secure storage device of the present application, and a comparison is made between the traditional network disk storage method and the network disk storage method of the present application. The present application discloses a portable secure storage device, the storage form of which includes a USB flash drive, a mobile hard disk, a solid-state hard disk, a smart storage card, a wireless storage device or a dongle; the portable secure storage device is embedded with a storage node function module, and when the storage node function module is activated and connected to a distributed file system built on a main storage server and multiple terminals, it automatically acts as a new storage node of the distributed file system.

[0030] The portable secure storage device is equipped with a client program and adopts file block storage technology, allowing the user to enter personal account information for identity authentication and access, thereby improving the security of data storage and use; when the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the synchronized data volume accounts for a first set data proportion of the total data volume of the authenticated user, and the remaining data of a second set data proportion is distributed in other storage nodes of the distributed file system; the sum of the first set data proportion and the second set data proportion is 100%, and in this embodiment, the first set data proportion is 90%, and the second set data proportion is 10%.

[0031] The main storage server maintains a complete 100% copy of the data, ensures that the integrity of the data is not affected, and provides a disaster recovery mechanism; optimizes the use of network resources, namely through the data preloading function. For example, the present invention preferentially synchronizes the data blocks related to the authenticated user to the new storage node, so that the user can access most of the personal data in an offline state, reduces the amount of data transmission when online, reduces the pressure of network transmission, and improves data access efficiency. The user can access most of the synchronized data in an offline state and can switch seamlessly between different devices. Personal data can be accessed by logging into the client program, which enhances the flexibility of cross-platform use. Finally, by dynamically adding storage nodes to the distributed file system, the storage capacity and expansion capability of the distributed storage system are increased. By automatically balancing data, the rationality of the load distribution of the distributed storage system can also be ensured.

[0032] In one embodiment, if Figure 2 As shown, a storage method for a portable secure storage device is provided, and the storage method for a portable secure storage device is applied to a portable secure storage device.

[0033] A storage method of a portable secure storage device comprises the following steps: S1: When the storage node function module embedded in the portable secure storage device is activated and connected to a distributed file system based on a main storage server and multiple terminal components, it automatically serves as a new storage node of the distributed file system.

[0034] In this embodiment, the portable secure storage device has a built-in storage node functional module. When the module is activated and connected to the distributed file system, it automatically becomes a new storage node of the system.

[0035] Specifically, the activation and connection functions of the storage node functional module are realized through hardware design and software programming. After the module is activated, a connection is established with the main storage server and other terminals through a network protocol (such as TCP / IP).

[0036] S2: A portable secure storage device equipped with a client program and using file block storage technology, allowing users to enter personal account information for authentication and access.

[0037] In this embodiment, a client program is developed to implement user identity authentication and file block storage functions. The client program can be an independent application program or embedded in the operating system of the storage device.

[0038] Specifically, the user starts the client program and enters personal account information for identity authentication. After successful authentication, the user can access the data stored in the device.

[0039] S3: When the distributed file system performs data balancing on the newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the amount of synchronized data accounts for the first set data proportion of the total data amount of the authenticated user, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system.

[0040] Specifically, the data block information of the authenticated user is obtained, and a data block priority list is generated, and then the data blocks are synchronized from high to low priority until a first set data proportion is reached, and the remaining data blocks are synchronized to other storage nodes according to the priority and distribution strategy.

[0041] S4: A complete copy of the data is maintained on the primary storage server.

[0042] In this embodiment, the data in the distributed file system is synchronized to the primary storage server regularly to ensure that the data copy on the primary storage server is up to date.

[0043] S5: Obtain the storage capacity and currently used capacity of the portable secure storage device, and calculate the available storage space.

[0044] Specifically, the storage information of the storage device is obtained through the operating system or special management software, that is, the total storage capacity of the storage device is read, and the available storage space is calculated by reading the current used capacity.

[0045] S6: According to the available storage space and the total amount of data of the authenticated user, the first set data ratio and the second set data ratio are adjusted to optimize the preset data synchronization strategy.

[0046] In this embodiment, the available storage space and the total amount of data of the authenticated user are obtained, and the first set data ratio and the second set data ratio are adjusted according to the current storage situation to generate a new data synchronization strategy. The data synchronization strategy of this embodiment needs to support dynamic adjustment and real-time monitoring functions.

[0047] S7: Input the adjusted first set data ratio and the second set data ratio into the data balancing algorithm of the distributed file system to generate a final data synchronization plan.

[0048] In this embodiment, a data balancing algorithm is used to achieve reasonable distribution of data and reasonable distribution of synchronous explicit packet data on each storage node.

[0049] In one embodiment, if Figure 3As shown, in step S3, when the distributed file system performs data balancing on the newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the amount of synchronized data accounts for the first set data proportion of the total amount of authenticated user data, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system, specifically including: S31: When the distributed file system performs data balancing on the newly added storage node, based on the personal account information of the authenticated user, the personal account information of the authenticated user is obtained, and the information of all data blocks related to the user is obtained, including the identification, size and priority of the data blocks.

[0050] In this embodiment, user account information and related data block information are obtained through database query and data indexing technology.

[0051] S32: Associating the identifier, size and priority of the data block to generate a data block priority list.

[0052] In this embodiment, a data structure (such as a hash table) is created to store data block information, the identification, size and priority information of each data block is added to the data structure, the data blocks are sorted according to priority, and a data block priority list is generated, wherein the data structure needs to support efficient insertion, deletion and search operations, and the sorting algorithm can select efficient algorithms such as quick sort and merge sort.

[0053] S33: According to the data block priority list, the high-priority data blocks are preferentially synchronized to the newly added storage nodes until a first set data proportion is reached.

[0054] In this embodiment, the data synchronization algorithm and the network transmission protocol are used to implement the priority synchronization of the data blocks.

[0055] Specifically, select the data block with the highest priority from the data block priority list, synchronize the selected data block to the newly added storage node through a network transmission protocol (such as HTTP, FTP, SCP, etc.), record the synchronized data block information, calculate the amount of synchronized data, and repeat these steps until the first set data ratio is reached.

[0056] S34: The remaining data blocks are distributed to other storage nodes of the distributed file system according to their priorities and distribution strategies.

[0057] In this embodiment, unsynchronized data blocks are selected from a data block priority list, and appropriate storage nodes are selected according to a distribution strategy (such as polling, random, load balancing, etc.). The selected data blocks are synchronized to the selected storage nodes through a network transmission protocol. The distribution strategy needs to consider the load conditions of each storage node to avoid overloading a certain node.

[0058] In one embodiment, in step S33, according to the data block priority list, high-priority data blocks are preferentially synchronized to the newly added storage node until a first set data proportion is reached, specifically including: S331: Input the data block priority list into the data synchronization model.

[0059] Specifically, the data block priority list is delivered in a structured manner, such as JSON format.

[0060] S332: extracting size information of each data block, and calculating the number of data blocks required to be synchronized based on the size information of each data block and the first set data ratio.

[0061] Specifically, the data block priority list is traversed, the size information of each data block is extracted, the total data volume of the authenticated user is calculated, and the total size of the data blocks that need to be synchronized is calculated based on the first set data ratio, and the data block priority list is continued to be traversed, and the data block sizes are accumulated until the calculated total size is reached.

[0062] S333: Synchronize the data blocks to the newly added storage nodes in order of the data block priorities from high to low, until a first set data proportion is reached.

[0063] In this embodiment, a network transmission protocol is used to synchronize the selected data blocks to the newly added storage node, and the synchronized data block information is recorded to calculate the amount of synchronized data. When performing data transmission, a timeout mechanism can be set to prevent long periods of no response during the data transmission process.

[0064] In one embodiment, in step S7, the adjusted first set data ratio and the second set data ratio are input into the data balancing algorithm of the distributed file system to generate a final data synchronization plan, which specifically includes: S71: Inputting the adjusted first set data proportion and second set data proportion into a data balancing algorithm.

[0065] In this embodiment, the data balancing algorithm includes a load balancing algorithm or a dynamic adjustment algorithm.

[0066] S72: Input the available storage space of the portable secure storage device and the total data volume information of the authenticated user into the data balancing algorithm.

[0067] S73: Generate synchronization priority and target storage node for each data block according to the data balancing algorithm.

[0068] S74: Associating the synchronization priority of each data block with the target storage node information to generate a final data synchronization plan.

[0069] S75: Send the final data synchronization plan to each storage node of the distributed file system.

[0070] Specifically, the final data synchronization plan is converted into a network transmission format, such as JSON or XML, and the synchronization plan is sent to each storage node using a network communication protocol. It is confirmed that each storage node has received the synchronization plan and started to execute it.

[0071] In one embodiment, if Figure 4 As shown, a storage method of a portable secure storage device also includes: S10: Identify and obtain historical data transmission efficiency data and working status information under multiple usage scenarios based on a historical operation data set of the portable secure storage device, where the working status information covers multiple working mode intervals corresponding to different security levels.

[0072] In this embodiment, the historical operation data set refers to the operation records of the storage device in different usage scenarios, including task type, task time, data transmission rate, data processing volume and external interference conditions, etc.; the working status information refers to the working mode and security level of the storage device in different usage scenarios, such as high-speed mode, energy-saving mode, high-security mode, medium-security mode, etc.

[0073] S20: The portable secure storage device is associated with a unique device identifier, and based on the device identifier, a historical control data set of the storage device in each usage scenario is obtained, and combined with a preset initial security management model, training is performed with security performance and data transmission efficiency as optimization goals to obtain an optimized security control model.

[0074] Specifically, the historical control data set refers to the control commands and operation results of the storage device in different usage scenarios, including data transmission commands and security control commands; the initial security management model is a preset security management model that contains basic security policies and performance indicators; the historical control data set is trained through a machine learning algorithm to generate an optimized security control model.

[0075] S30: Analyze and determine data transmission correlation factors and safety factors between storage devices in various usage scenarios based on historical operation data sets of the portable secure storage device.

[0076] In this embodiment, the data transmission correlation factor refers to the factor that affects the data transmission efficiency, and the safety factor is an indicator for measuring the security of data transmission, including the reliability of data transmission, anti-interference ability and data encryption strength.

[0077] Specifically, data transmission records for each usage scenario are extracted from the historical operation data set, and the data transmission records are analyzed to determine data transmission-related factors, such as storage medium read and write efficiency factor, data processing efficiency factor, interface transmission efficiency factor, external interference factor, etc. The safety factor for each usage scenario is calculated to evaluate the security of data transmission.

[0078] S40: In the optimized security control model, based on the data transmission correlation factors, safety factors and security parameter adjustment strategies corresponding to the historical control data sets of all usage scenarios, the optimal data transmission efficiency threshold and safety performance index of the portable security storage device in each working mode range are determined to generate the optimal security control strategy.

[0079] In this embodiment, the optimal data transmission efficiency threshold and safety performance index refer to the optimal data transmission efficiency and safety performance standards determined by the optimization model within each working mode range; the optimal safety control strategy is the optimal safety control strategy generated according to the optimization model, which is used to guide the operation of the storage device.

[0080] S50: managing the data transmission efficiency and regulating the security performance of the portable secure storage device according to the optimal security control strategy.

[0081] For example, assume that a large enterprise uses a portable secure storage device to manage employees' personal data and important files; employees often need to move between different office locations and need to quickly and securely access data stored in the system; in order to improve data access efficiency and security, the enterprise decides to adopt the above storage method for data management and security control, which includes historical data collection, data association and model training, data transmission correlation factor and safety factor analysis, optimal security control strategy generation, and strategy execution and monitoring. Based on this, employees can quickly and securely access important data files when working on the move, thereby improving work efficiency; at the same time, data security and access efficiency are effectively guaranteed, ensuring the enterprise's data management needs.

[0082] In one embodiment, in step S10, based on the historical operation data set of the portable secure storage device, historical data transmission efficiency data and working status information in multiple usage scenarios are identified and acquired, specifically including: S101: According to a historical operation data set of a portable secure storage device, historical task information executed by the storage device in various usage scenarios and corresponding data transmission volume are obtained.

[0083] Specifically, historical operation logs of the portable secure storage device are collected, including information such as task type, task time, and data transmission volume, and the log data is parsed to extract historical task information and corresponding data transmission volume in each usage scenario.

[0084] S102: Divide the storage device into multiple historical operation time intervals according to historical task information and corresponding data transmission volume in each usage scenario.

[0085] Specifically, the historical task information is arranged in chronological order, and multiple time intervals are divided according to the changes in the frequency of tasks and the amount of data transmission. The division of time intervals is achieved through time series analysis and data segmentation technology.

[0086] S103: Based on the device identification and in combination with a plurality of historical operation time intervals, historical task information and corresponding data transmission volumes of the storage device in each usage scenario are classified to obtain historical data transmission efficiency data of the storage device.

[0087] Specifically, data classification and statistical analysis techniques are used to calculate data transmission efficiency: first, historical task information and data transmission volume are classified into corresponding usage scenarios according to device identification, and then the data transmission volume in each usage scenario is counted, and indicators such as average transmission speed and maximum transmission speed are calculated. The calculation results are then summarized to form historical data transmission efficiency data.

[0088] S104: Determine the working status information of the storage device in each usage scenario according to the historical data transmission efficiency data in multiple usage scenarios and a preset working status determination criterion.

[0089] Specifically, first define preset working status judgment criteria, such as data transmission speed threshold and error rate threshold, and use a rule engine or decision tree algorithm to judge the working status of the storage device based on historical data transmission efficiency data, so as to record the judgment result in the working status information, including working mode (such as high-speed mode, energy-saving mode) and security level (such as high security, medium security, low security).

[0090] For example, suppose an educational institution uses a portable secure storage device to manage students' test scores and personal data. Teachers and administrators often need to move between multiple locations such as classrooms, offices, and remote offices, and need to quickly and securely access the data stored in the device. In order to optimize data transmission efficiency and improve data security, the institution decides to use the above storage method for data management and status monitoring.

[0091] Specific implementation steps: Step 1: Historical data collection: Educational institutions collect historical operation logs of portable secure storage devices, record information such as the type, start time, end time, and data transmission volume of each task, use log parsing tools to parse the log data, and extract historical task information and corresponding data transmission volume under various usage scenarios (such as classrooms, offices, and remote offices).

[0092] Step 2: Time interval division: Arrange the historical task information in chronological order, and use time series analysis methods (such as sliding window method and fixed time interval method) to divide multiple historical operation time intervals according to the changes in task frequency and data transmission volume.

[0093] Step 3: Data classification and efficiency calculation: According to the device identification, the historical task information and data transmission volume are classified into the corresponding devices.

[0094] Combined with multiple historical operation time intervals, historical task information and data transmission volume are classified into different usage scenarios, and the data transmission efficiency in each usage scenario is calculated, including the average transmission rate, maximum transmission rate, minimum transmission rate, etc.

[0095] Step 4: Determine the working status: Define preset working status judgment criteria, for example: high-speed mode: average transmission rate greater than 10MB / s, error rate less than 1%. Energy-saving mode: average transmission rate less than 5MB / s, error rate less than 2%; high security mode: high data encryption strength, no security incidents during transmission; medium security mode: medium data encryption strength, occasional security incidents during transmission, and then compare the historical data transmission efficiency data under each usage scenario with the preset judgment criteria to determine the working status information of the storage device under each usage scenario based on the comparison results.

[0096] In one embodiment, if Figure 2 As shown, in step S30, based on the historical operation data set of the portable security storage device, the data transmission correlation factor and safety factor between the storage devices in each usage scenario are analyzed and determined, specifically including: S301: Based on the historical operation data set of the portable security storage device, the data transmission rate, data processing volume and external interference conditions of the storage device in each usage scenario are obtained.

[0097] In this embodiment, data transmission related factors include storage medium read and write efficiency factor, data processing efficiency factor, interface transmission efficiency factor and external interference factor; data transmission rate refers to the transmission speed of the storage device during the data transmission process, usually in bytes / second (Byte / s); external interference conditions refer to the external interference conditions encountered by the storage device during the data transmission process, such as electromagnetic interference, network congestion, etc.

[0098] S302: Calculate and determine the efficiency value of the data transmission correlation factor of the storage device in each usage scenario in combination with the data transmission path, data processing flow and external interference factors between each usage scenario.

[0099] In this embodiment, the data transmission path refers to the data transmission path of the storage device in different usage scenarios, including the network topology and the transmission protocol; the data processing flow refers to the data processing flow of the storage device in different usage scenarios, including data reading, processing and writing steps; the external interference factor refers to the external interference factor that the storage device may encounter in different usage scenarios, such as electromagnetic interference and network congestion; the efficiency value refers to the efficiency value of each data transmission association factor in different usage scenarios, which is used to evaluate the efficiency of data transmission.

[0100] Specifically, a mathematical model such as linear regression or multivariate regression is used to calculate the efficiency values ​​of data transmission related factors, including storage medium read and write efficiency factors, data processing efficiency factors, interface transmission efficiency factors and external interference factors.

[0101] S303: Based on the data transmission rate, data processing volume, external interference conditions and efficiency values ​​of data transmission related factors in each usage scenario, comprehensively evaluate and determine the safety factor between each usage scenario.

[0102] In this embodiment, the safety factor is determined by a comprehensive evaluation model and a decision tree algorithm; the comprehensive evaluation model needs to consider multiple factors to ensure the comprehensiveness and accuracy of the evaluation, and the decision tree algorithm can be used for classification and prediction to help determine the safety factor.

[0103] For example, assume that a medical institution uses a portable secure storage device to manage patients' medical records and personal data. Doctors and nurses often need to move between different departments within the hospital, home visits, and telemedicine, and need to quickly and securely access the data stored in the device. In order to optimize data transmission efficiency and improve data security, the institution decides to use the above storage method for data management and status monitoring. The specific implementation steps are as follows: Step 1: Historical data collection: Medical institutions collect historical operation logs of portable secure storage devices, recording information such as the type, start time, end time, data transmission rate, data processing volume, and external interference conditions of each task.

[0104] Use log parsing tools to parse log data, extract data transmission rate, data processing volume and external interference conditions in various usage scenarios (such as within the hospital, home visits, and telemedicine), and collect data by extracting data from historical force operation logs using log parsing tools and storing them in a database.

[0105] Step 2: Data transmission path and processing flow analysis: Analyze the data transmission paths between various usage scenarios, including the local area network within the hospital, the mobile network during home visits, the Internet during telemedicine, etc.; analyze the data processing flow under each usage scenario, including data reading, processing and writing steps; identify external interference factors in each usage scenario, such as electromagnetic interference within the hospital, network congestion during home visits, etc.

[0106] Step 3: Efficiency value calculation: Combined with the above information, mathematical models (such as linear regression, multivariate regression) are used to calculate the efficiency values ​​of data transmission related factors of storage devices under various usage scenarios, including storage medium read and write efficiency factors, data processing efficiency factors, interface transmission efficiency factors and external interference factors.

[0107] Step 4: Safety factor assessment: First, the data transmission rate, data processing volume and external interference conditions in each usage scenario are combined with the efficiency value of the data transmission correlation factor, and then a comprehensive evaluation model (such as hierarchical analysis method, fuzzy comprehensive evaluation method) is used to evaluate the data transmission efficiency and security in each usage scenario. Then, based on the evaluation results, the safety factor between each usage scenario is determined, including the security and reliability of data transmission.

[0108] This application dynamically adjusts the security control strategy based on the safety factor assessment results, thereby improving the security and anti-attack capabilities of the data. Doctors and nurses can obtain fast and secure data access experience in different usage scenarios, thereby improving work efficiency and patient satisfaction.

[0109] Furthermore, the data transmission correlation factor also includes a storage medium aging factor and an interface stability factor. The data transmission correlation factor of the portable secure storage device in each usage scenario is constrained and calculated and optimized based on the following formula: E eff =D trans / T proc ×(1+a stor ×A stor +a ptor ×A ptor +a inyf ×A intf +a ext ×A ext ) Among them, E eff Indicates the data transmission efficiency of the storage device; D trans is the amount of data transmitted in a specific time interval; T proc is the total processing time of the time interval; a stor is the influence coefficient of storage medium aging factor; a ptor is the influence coefficient of data processing efficiency factor; aintf is the influence coefficient of the interface stability factor; a ext is the influence coefficient of external interference factors; A stor A is the actual measured value or estimated value of the storage medium aging factor; ptor is the actual measured value or estimated value of the data processing efficiency factor; A intf is the actual measured value or estimated value of the interface stability factor; A ext is the actual measured value or estimated value of the external interference factor; A is a constant coefficient used to adjust the model accuracy.

[0110] It should be understood that the serial numbers of the steps in the above embodiments do not imply a sequence of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0111] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0112] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the features thereof may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A portable secure storage device, characterized in that: Including but not limited to the form of a USB flash drive, the portable secure storage device is embedded with a storage node function module, and when the storage node function module is activated and connected to a distributed file system built based on a main storage server and multiple terminals, it automatically serves as a new storage node of the distributed file system; the portable secure storage device is equipped with a client program and adopts file block storage technology, allowing the user to enter personal account information for identity authentication and access; When the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the synchronized data volume accounts for a first set data proportion of the total data volume of the authenticated user, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system; The primary storage server maintains a complete copy of the data.

2. A portable secure storage device according to claim 1, characterized in that: The storage form of the portable secure storage device also includes a mobile hard disk, a solid state hard disk, a smart memory card, a wireless storage device or a dongle; the sum of the first setting data proportion and the second setting data proportion is 100%.

3. A portable secure storage device according to claim 2, characterized in that: The first setting data accounts for 90%, and the second setting data accounts for 10%.

4. A storage method of a portable secure storage device, characterized in that: Applied to a portable secure storage device as claimed in any one of claims 1 to 3, the method comprising: When the storage node function module embedded in the portable secure storage device is activated and connected to a distributed file system based on a main storage server and multiple terminal components, it automatically serves as a new storage node of the distributed file system; The portable secure storage device is equipped with a client program and uses file block storage technology, allowing the user to enter personal account information for identity authentication and access; When the distributed file system performs data balancing on a newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the synchronized data volume accounts for a first set data proportion of the total data volume of the authenticated user, and the remaining data of the second set data proportion is distributed in other storage nodes of the distributed file system; Maintaining a complete copy of the data on the primary storage server; Obtaining the storage capacity and currently used capacity of the portable secure storage device, and calculating the available storage space; According to the available storage space and the total amount of data of the authenticated user, the first set data ratio and the second set data ratio are adjusted to optimize the preset data synchronization strategy; The adjusted first set data ratio and the second set data ratio are input into the data balancing algorithm of the distributed file system to generate a final data synchronization plan.

5. A storage method for a portable secure storage device according to claim 4, characterized in that: When the distributed file system performs data balancing on the newly added storage node, the data blocks related to the authenticated user are synchronized to the newly added storage node first, and the amount of synchronized data accounts for a first set data ratio of the total amount of authenticated user data, and the remaining data of the second set data ratio is distributed in other storage nodes of the distributed file system, specifically including: When the distributed file system performs data balancing on a newly added storage node, based on the personal account information of the authenticated user, the personal account information of the authenticated user is obtained, and information of all data blocks related to the user is obtained, including identification, size and priority of the data blocks; Associating the identifier, size and priority of the data block to generate a data block priority list; According to the data block priority list, the high-priority data blocks are preferentially synchronized to the newly added storage node until the first set data proportion is reached; For the remaining data blocks, they are distributed to other storage nodes of the distributed file system according to their priorities and distribution strategies.

6. A storage method for a portable secure storage device according to claim 5, characterized in that: The step of synchronizing the high-priority data blocks to the newly added storage node in priority according to the data block priority list until the first set data proportion is reached specifically includes: inputting the data block priority list into a data synchronization model; Extracting the size information of each data block, and calculating the number of data blocks required to be synchronized based on the size information of each data block and the first set data ratio; Synchronize the data blocks to the newly added storage nodes in order of priority from high to low until the first set data proportion is reached; and / or, The step of inputting the adjusted first set data proportion and second set data proportion into the data balancing algorithm of the distributed file system to generate a final data synchronization plan specifically includes: Inputting the adjusted first set data proportion and second set data proportion into a data balancing algorithm; Inputting the available storage space of the portable secure storage device and the total data volume information of the authenticated user into a data balancing algorithm; generating the synchronization priority and target storage node of each data block according to the data balancing algorithm; Associate the synchronization priority of each data block with the target storage node information to generate the final data synchronization plan; The final data synchronization plan is sent to each storage node of the distributed file system.

7. A storage method for a portable secure storage device according to claim 4, characterized in that: The method further comprises: According to a historical operation data set of the portable secure storage device, identifying and acquiring historical data transmission efficiency data and working status information under multiple usage scenarios, wherein the working status information covers multiple working mode intervals corresponding to different security levels; The portable secure storage device is associated with a unique device identifier, and based on the device identifier, a historical control data set of the storage device in each usage scenario is obtained, and combined with a preset initial security management model, training is performed with security performance and data transmission efficiency as optimization goals to obtain an optimized security control model; Analyze and determine data transmission correlation factors and safety factors between storage devices in various usage scenarios based on historical operation data sets of portable secure storage devices; In the optimized security control model, based on the data transmission correlation factors, safety factors and security parameter adjustment strategies corresponding to the historical control data sets of all usage scenarios, the optimal data transmission efficiency threshold and safety performance index of the portable security storage device in each working mode range are determined to generate the optimal security control strategy; The data transmission efficiency management and security performance regulation of the portable security storage device are performed according to the optimal security control strategy.

8. A storage method for a portable secure storage device according to claim 7, characterized in that: The identifying and acquiring historical data transmission efficiency data and working status information in multiple usage scenarios based on the historical operation data set of the portable secure storage device specifically includes: According to the historical operation data set of the portable secure storage device, historical task information performed by the storage device in each usage scenario and the corresponding data transmission volume are obtained; According to the historical task information of the storage device in each usage scenario and the corresponding data transmission volume, a plurality of historical operation time intervals are obtained; Based on the device identifier and in combination with the plurality of historical operation time intervals, historical task information and corresponding data transmission volumes of the storage device in each usage scenario are classified to obtain historical data transmission efficiency data of the storage device; Based on historical data transmission efficiency data in multiple usage scenarios and preset working status determination criteria, working status information of the storage device in each usage scenario is determined.

9. The storage method of a portable secure storage device according to claim 7, characterized in that: The data transmission related factors include storage medium read and write efficiency factor, data processing efficiency factor, interface transmission efficiency factor and external interference factor; The step of analyzing and determining the data transmission correlation factor and safety factor between the storage devices in each usage scenario based on the historical operation data set of the portable secure storage device specifically includes: According to the historical operation data set of the portable secure storage device, the data transmission rate, data processing volume and external interference status of the storage device in each usage scenario are obtained; In combination with the data transmission paths, data processing procedures and external interference factors between various usage scenarios, the efficiency value of the data transmission correlation factor of the storage device in each usage scenario is calculated and determined; Based on the data transmission rate, data processing volume, external interference conditions and efficiency values ​​of data transmission related factors in each usage scenario, a comprehensive assessment is made to determine the safety factor between each usage scenario.

10. A storage method for a portable secure storage device according to claim 9, characterized in that: The data transmission association factor also includes a storage medium aging factor and an interface stability factor, and the method further includes: The data transmission correlation factor of the portable secure storage device in each usage scenario is constrained and calculated and optimized based on the following formula: E eff =D trans / T proc ×(1+a stor ×A stor +a ptor ×A ptor +a intf ×A intf +a ext ×A ext ) Among them, E eff Indicates the data transmission efficiency of the storage device; D trans is the amount of data transmitted in a specific time interval; T proc is the total processing time of the time interval; a stor is the influence coefficient of storage medium aging factor; a ptor is the influence coefficient of data processing efficiency factor; a intf is the influence coefficient of the interface stability factor; a ext A is the influence coefficient of external interference factors; stor A is the actual measured value or estimated value of the storage medium aging factor; ptor is the actual measured value or estimated value of the data processing efficiency factor; A intf is the actual measured value or estimated value of the interface stability factor; A ext is the actual measured value or estimated value of the external interference factor; A is a constant coefficient used to adjust the model accuracy.

Images