1439 results about "Data recovery" patented technology

A system and methods for implementing adversarial-robust compression and reconstruction using a vector quantized variational autoencoder (VQ-VAE) with secure latent space management. The system provides comprehensive protection against adversarial attacks through multi-channel threat detection, adaptive defensive parameters, and coordinated response mechanisms. Input data is continuously monitored for potential threats, and defensive parameters are dynamically adjusted based on detected threat levels. The system implements bounded constraints and hierarchical projections to maintain latent space security while preserving compression efficiency. Multi-stage reconstruction with progressive validation ensures reliable data recovery even under adversarial conditions. The system coordinates defensive responses across all compression and reconstruction processes, implementing various recovery mechanisms when security violations are detected. This approach enables robust compression and reconstruction of time-series data while maintaining protection against various forms of adversarial manipulation.

The invention relates to the technical field of data storage, in particular to a dynamic data distribution storage method and system for an RAID (redundant array of independent disks), and the method comprises the following steps: based on the access frequency of data blocks in a disk, recording the access frequency and timestamp of each data block, carrying out heat rating on the data blocks, and determining thresholds of hot data and cold data. According to the method, the dynamic distribution of data storage is effectively optimized by analyzing the access frequency of the data blocks, and the performance and the economic efficiency of a storage system are remarkably improved by migrating the frequently accessed data to the cache disk and migrating the less accessed data to the low-cost storage; according to the method, unnecessary occupation of high-performance storage resources is reduced, the operation cost is also reduced, heat rating is performed on the data blocks, and the storage positions of the data blocks are correspondingly adjusted, so that the data processing speed is higher, meanwhile, the data security is improved, when a hard disk fails, data recovery is faster, and the service continuity is ensured.

The invention discloses a data reconstruction method and device, a storage medium and a program product, and relates to the technical field of data storage, and the method comprises the following steps: reconstructing an initial redundant array of independent disks according to a hard disk state of the initial redundant array of independent disks to obtain a target redundant array of independent disks; after the reconstruction of the initial redundant array of independent disks is completed, establishing a mapping relation between the initial redundant array of independent disks and the target redundant array of independent disks, and storing the mapping relation based on metadata to obtain corresponding target metadata, and recovering the target redundant array of independent disks to the initial redundant array of independent disks according to the target metadata. When the disk fails or restores to normal for data reconstruction, the corresponding data can be directly written back according to the mapping condition between the blocks, additional check block calculation is not needed, and the data recovery speed is increased.

Methods and systems for managing a data processing system are disclosed. The data processing system may provide computer-implemented services and may include in-band hardware resources that operate as specified by operation data of the data processing system while providing the services. However, if the operation data becomes unavailable to the data processing system, then the data processing system may be unable to provide the desired services. Therefore, to increase the likelihood of providing the desired services, the operation data may be managed using distributed backup and recovery processes. To decrease security risk associated with operation data backup and recovery, the distributed processes may be performed using out-of-band components of the data processing system, bypassing in-band hardware components that may be more vulnerable to being compromised (e.g., by a malicious party). The out-of-band management of the operation data may reduce the likelihood of interruptions in providing the desired services.

The invention discloses a wireless network high-reliability transmission method based on double-link redundancy, which relates to the technical field of wireless communication, and comprises the following steps: establishing double communication links, and collecting link quality data of the double communication links; performing weighting operation on the link quality data according to a preset weighting coefficient to obtain a first link score and a second link score, and judging the first link score and the second link score; issuing an original data packet and a backup data packet of the original data packet to the dual communication link according to a judgment result, and collecting a data transmission state in a receiving time window; and when it is monitored that the original data packet is lost in the receiving time window, extracting a backup data packet of the original data packet for data recovery, and recalculating the link score of the original data packet. Through organic combination of multi-dimensional link quality evaluation, link selection of weighted calculation, double-link parallel transmission and rapid data recovery, the network resource utilization efficiency is improved while the data transmission reliability is guaranteed.

The present application discloses a data management method, apparatus and system for a distributed storage system, and an electronic device. The method comprises: traversing all storage paths in a target distributed storage cluster, and acquiring file storage information of the storage paths during traversal; on the basis of the file storage information, calculating a redundancy policy score of each storage path, and on the basis of the redundancy policy score and a first redundancy policy score threshold, determining a storage policy adapted to the storage path; when it is determined that the storage policy adapted to the storage path is an erasure code storage policy, determining a data recovery mode of the storage path on the basis of the architecture information of the storage path; and when it is determined that the storage policy adapted to the storage path is a multi-copy storage policy, determining the number of copies of the storage path on the basis of a service importance degree of the storage path and the redundancy policy score.

The invention relates to a method and a system for storing and backing up electric power data of a data-in-data station based on use popularity, and belongs to the technical field of data-in-data stations, and the method comprises the following steps: classifying electric power business data into hot data, temperature data and cold data based on preset access frequency, time window and data volume index; according to a classification result and a business importance degree, storing hot data in an SSD cloud disk or a memory database, storing temperature data in a distributed column database, and compressing cold data and then archiving the cold data to an object storage or a tape library; dynamically configuring differentiated backup strategies for different types of data; automatic scheduling of storage and backup is realized through a cloud platform component, and hot switching of master and slave databases, OSS archived data recovery by a DataWorks tool and a remote multi-copy recovery mechanism are supported; and migrating data in advance in combination with a historical access prediction popularity trend, and triggering cold data compression and archiving when storage resources exceed 80%. The method is suitable for power industry scenes, the storage cost is optimized, and the data calling efficiency is improved.

The invention relates to the technical field of network and information security, in particular to a zero-trust multi-party security data exchange method, which comprises the following steps of: generating a zero-trust token and a capability authorization bill and constructing context description data; authentication encryption is performed on the plaintext fragment, attribute-based encryption is performed on the data one-time key, and a policy bearing ciphertext container is assembled; in the trusted execution environment, authentication decryption is completed through a one-time secret key of data recovery through joint challenge and threshold deblocking, or strategy migration and transfer are achieved through proxy re-encryption; and aggregating the decryption event and the forwarding event by vector commitment, generating a time anchor, and mapping the time anchor into a next round of random base. According to the invention, fine-grained authorization of the key layer, no plaintext transfer, event-level verifiable auditing and rapid revocation are realized.

The invention discloses a data transmission method, and relates to the technical field of data transmission, and the method comprises the steps: obtaining the target network state data of target equipment, and determining the real-time packet loss rate of the target equipment at a preset moment according to the target network state data; obtaining target operation data of target equipment, and determining a predicted packet loss rate of the target equipment according to the target operation data, the target network state data and the real-time packet loss rate; and performing redundancy coding on a to-be-transmitted data packet according to the predicted packet loss rate to obtain a target transmission data packet, and transmitting the target transmission data packet to the target device. According to the invention, the redundancy coding degree of the to-be-transmitted data can be dynamically adjusted according to the predicted packet loss rate, data recovery can be effectively carried out under different network conditions, the retransmission frequency of the data packet can be reduced, and the transmission efficiency of the data packet can be improved.

The invention discloses a solid-state storage hard disk data recovery method and system, and relates to the technical field of data processing, the method comprises the following steps: carrying out difference analysis on historical log state characteristics and health state characteristics stored in a solid-state hard disk, and identifying a data loss event of the solid-state hard disk based on a difference analysis result; constructing a data recovery mechanism based on the data loss abnormal event, and performing recovery processing on lost data of the solid state disk based on the data recovery mechanism; and verifying and evaluating the recovered data, and optimizing the data recovery mechanism according to a verification and evaluation result. According to the method, differentiated technical means such as metadata restoration, backtracking reasoning and data engraving are combined, classification positioning, cause recognition and structured restoration of lost data are achieved, and the pertinence, accuracy and automation degree of data restoration are effectively improved.

The invention discloses an intelligent traffic data storage method, system and device based on the Internet of Things and a medium, and relates to the technical field of electric digital data processing, and the method comprises the steps that an edge node packages received data and inserts the data into a local directed acyclic graph account book; dividing the verified data into Level-0 fragments according to a fixed duration window, and performing variable-length fragmentation based on a Rabin fingerprint algorithm; calculating Hash values of the variable-length fragments, and performing duplicate removal through a Bloom filter and a Hash index table in sequence; generating a local erasure block and a global erasure block for the deduplicated fragments, and storing complete copies of the key fragments on a plurality of storage nodes; and periodically checking a local erasure block and a complete copy, and triggering self-healing reconstruction when detecting that the fragment is lost. According to the method, the technical problems of high delay of distributed write-in consistency, high storage redundancy, complex cross-node time sequence correction, slow data recovery, poor system expansibility and the like are solved.

The embodiment of the invention provides a data processing method and device, a storage medium and electronic equipment, and relates to the technical field of computers.The method comprises the steps that in response to a wrong disk recovery request of a storage system, a recovery method corresponding to a wrong disk is determined; the number of the staggered disks is at least one; performing data recovery on the wrong disk by utilizing a recovery method to obtain a data recovery result; each stripe in the storage system is divided into a first local check group, a second local check group and a global check group; the global check group comprises a global check disk, a first data disk part and a second data disk part; the first local check group comprises a first local check disk, a first data disk part and a global check disk; and the second local check group comprises a second local check disk, a second data disk part and a global check disk. Therefore, a grouping mode of the first local check group, the second local check group and the global check group is provided, at least one wrong disk can be recovered by using the recovery method corresponding to the wrong disk, and the fault-tolerant capability is improved.

The invention relates to the technical field of computers, and discloses a data management method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining target data of a disk array; grouping the target data to obtain corresponding grouped data under each preset category; writing the grouped data into the corresponding storage positions; after the storage fault corresponding to the disk array is recovered, data to be recovered are obtained in the storage position according to the preset reading sequence, the data to be recovered are utilized to recover the data of the disk array, and the data to be recovered are contained in the target data. The problems that when RAID data are stored, write-in operation needs to be repeatedly carried out, so that storage space loss is caused, and the storage process is very time-consuming due to log introduction are solved.

The invention provides an information resource multi-level data recovery method and system and a medium, and the method comprises the steps: generating a snapshot header for each snapshot, which comprises a snapshot ID, a previous snapshot hash value, a current snapshot hash value and an optional digital signature; meanwhile, hash calculation is carried out on all the blocks in the snapshot, and a Merkel tree is constructed to obtain a global hash value; when a new or updated block is detected, carrying out Hash calculation on the new or updated block, adding the new or updated block into a Merkel tree, generating a new snapshot Hash value, and writing the new snapshot Hash value into a snapshot head; and taking the hash value of the previous snapshot as a predecessor reference of the new snapshot to form chained association. In a multi-copy environment, when data recovery needs to be carried out, firstly, related snapshots are screened and determined through a snapshot index and a filter; then verifying the snapshot chain to ensure that the front and back references of each snapshot are correctly matched with the Merkel tree hash value; for block-level data, if copies are inconsistent, a correct version is discriminated through weighted consensus; and finally reconstructing the damaged block.

The embodiment of the invention provides a storage node upgrading method, system and device, a storage medium and electronic equipment, and relates to the field of computers.The method comprises the steps that node upgrading is conducted on a storage node in a first key value state in a storage cluster, and the first key value state is used for indicating that upgrading preparation of the storage node is completed; in the node upgrading process, under the condition that it is detected that the key value state of at least one storage node is changed from the first key value state to the second key value state, the at least one storage node is isolated from the storage cluster, and data recovery is conducted on the at least one storage node, the second key value state is used for indicating that upgrading of at least one storage node fails; and adding the at least one storage node after data recovery into the storage cluster again. According to the embodiment of the invention, the problem of relatively low upgrading efficiency of the storage node in related technologies is solved.

The invention provides a sparse array direction-of-arrival estimation method based on a local and global self-supervised network, and the method comprises the steps: 1, carrying out the signal processing: constructing any sparse array receiving signal, and carrying out the difference set virtual array extension, and obtaining the difference set virtual array measurement data; constructing a neural network training data set according to the measurement data; 2, establishing a local and global feature extraction network; step 3, establishing an ANM (Atomic norm Minimization) self-supervised network; and step 4, performing meshless signal recovery and DOA (direction of arrival) estimation, realizing label-free self-supervision data recovery, and finally performing DOA estimation by using the recovered meshless data. The new scheme provided by the invention has meshless recovery performance, solves the problem of base mismatching of a traditional neural network method, and has more accurate recovery and estimation performance.

The invention discloses a row-level data recovery method and device for a damaged file of a GoldenDB database, and the method comprises the following steps: S1, scanning a to-be-recovered GoldenDB data file, and recognizing and caching all data pages; s2, on the basis of metadata of the data pages, cluster index leaf node pages containing user data are screened out from the cached data pages; s3, for each screened leaf node page, analyzing an internal record organization structure of the leaf node page, and performing row-level data recovery; the row-level data recovery comprises the steps of traversing user records according to a virtual record pointer, and performing cross check and recovery on a traversal path in combination with a page directory slot so as to extract and mark the user records one by one; and S4, outputting all the recovered row-level data.

The invention discloses a dynamic switching distributed file storage system based on an elastic data network, and the system comprises a multi-network architecture module which is used for deploying a plurality of independent network channels, and each network channel independently transmits data; the client elastic data network access module is used for accessing and storing data according to the data network and the priority, and automatically switching and recovering when the network fails; the intelligent data transmission module is used for selecting an optimal data transmission path; the data recovery module is used for calling the intelligent data transmission module and selecting an optimal path according to the network use condition; the network fault automatic detection and recovery module is used for detecting and processing network channel or path abnormity, detecting master and salve when a fault occurs, acquiring network health state data, and switching master and slave according to the network health state data; the data security processing module is used for encryption and verification; and the cache optimization module is used for collecting data access frequency data and heat dynamic data.

The invention discloses an archive electronic information data recovery method, which relates to the technical field of archive management and data recovery, and comprises the following steps: obtaining original archive data, extracting first data and generating second data according to format characteristics, generating a version sequence of the data object based on the structured metadata, matching the third data and the encrypted data block which is not extracted in the first data as fourth data according to a preset strategy, performing decryption, generating fifth data according to a format feature, if the first data has the unextracted non-encrypted damaged data block, generating supplementary repair data, and if the first data has the unextracted non-encrypted damaged data block, generating the supplementary repair data. The first data, the third data, the fifth data and the repair data are integrated according to the hierarchical identifier, the association between the catalogue and the metadata is reconstructed, a complete file is generated, and a three-in-one system is formed by constructing a structured metadata version sequence, repairing heterogeneous data in a graded manner and fusing block chain dual verification and is suitable for file recovery.

The invention relates to the technical field of solid state disks, and provides a solid state disk data storage security test method and device, and the method comprises the steps: generating original test data of a solid state disk in a preset test environment; performing a simulation attack on the solid state disk according to a preset strength grade and preset duration, and obtaining a data block after the simulation attack of the original test data after the simulation attack is finished; recovering the data block after the simulation attack based on the verification data, and obtaining a primary data recovery rate, a secondary data recovery rate and a data error rate of the data block after the simulation attack in the recovery process; calculating a data storage security score of the solid state disk according to the primary data recovery rate, the secondary data recovery rate and the data error rate; and determining a data storage security level of the solid state disk according to the data storage security score. According to the method, the data storage security of the solid state disk under various complex environments and security threats can be comprehensively, systematically and deeply evaluated.

The invention relates to the technical field of data transmission, and discloses a flight data transmission method and system based on wireless communication and a storage medium. The method comprises the following steps: carrying out edge calculation noise reduction and data fusion processing on multi-source sensing flight data to obtain preprocessed transmission data; performing distributed cache node fragmentation and data synchronization processing on the preprocessed transmission data to obtain multi-source communication data; performing WiFi, 4G / 5G and satellite communication resource bidding and bandwidth allocation processing on the multi-source communication data to obtain priority network data; performing hierarchical network coding and transmission redundancy processing on the priority network data to obtain coded transmission data; and carrying out cloud edge cooperative decoding and data recovery processing on the coded transmission data to obtain transmission flight data. According to the invention, reliable transmission of flight data in a complex flight environment is realized, and the technical problems that an existing single communication mode is liable to be interfered and data transmission is unstable are solved.

The invention relates to the technical field of unmanned aerial vehicle detection, in particular to an unmanned aerial vehicle flight data high-precision anomaly detection and data recovery method. Comprising the following steps that S1, a multiple regression model based on TCN-KANs is constructed, the TCN-KANs model comprises an input layer, three residual blocks and a KAN layer, the residual blocks extract features through a convolution layer and residual connection, nonlinear change is carried out on the input features, a potential mode is extracted, final output is generated, and the KAN layer serves as a final output layer of TCN-KANs; s2, minimizing an error between a predicted value and a real value; s3, calculating a residual error according to a prediction result of the model, carrying out smoothing processing on the residual error, and analyzing statistical characteristics of the residual error to determine an abnormal threshold value; and S4, during real-time flight monitoring and operation control of the unmanned aerial vehicle, generating a recovery value for data recovery after abnormality is detected through the model.

The invention discloses a data recovery test method, which comprises the following steps of: performing fault injection on a storage system to enable the storage system to enter a recovery state; determining a target test scene in the recovery state, and performing a performance recovery test on the storage system in the target test scene; estimating a target duration for the storage system to enter a stable state in the performance recovery test process; after waiting for the target duration, collecting target performance data of the storage system for verification, and determining a test result of the target test scene according to a verification result; and determining a data recovery test result according to the test result of each target test scene. By applying the technical scheme provided by the invention, more efficient and accurate data recovery performance testing can be realized for the storage system. The invention also discloses a data recovery test device, electronic equipment and a computer readable storage medium, which also have the above technical effects.

The invention discloses a self-adaptive adjustment method of an eye pattern center point, terminal equipment and a storage medium, and relates to the technical field of communication. The method comprises the steps of controlling a clock data recovery function to be in a locking state under the condition that an eye pattern center point adjustment condition is triggered; determining a left boundary threshold value and a right boundary threshold value of the center point of the current eye pattern; when it is determined that the center point position of the center of the current eye pattern deviates according to the left boundary threshold value and the right boundary threshold value of the center point of the current eye pattern, the equalization parameter is adjusted according to the deviation condition; and under the condition that the adjustment stopping condition is met, controlling the clock data recovery function to be in a normal working state. Thus, the eye pattern center can be adjusted when the operating environment temperature is high or at a certain period, so that the eye pattern center can be kept at the center position of the eye pattern in the long-time operating process of hardware equipment, signals of a receiving end are enhanced and repaired, the integrity of the signals of the receiving end is guaranteed, and the reliability of a link is improved.

An illustrative method includes accessing, by a controller operating within a global control plane, a recovery policy that specifies parameters for generating recovery data associated with one or more resources of a first cluster comprising a first one or more containers, wherein the first cluster comprises a first local control plane separate from the global control plane; determining, by the controller and based on the recovery policy, a second cluster comprising a second one or more containers, wherein the second cluster comprises a second local control plane separate from the global control plane; and generating, by the controller and with respect to the second cluster, the recovery data associated with the one or more resources of the first cluster.

The invention relates to the technical field of data processing, in particular to a cloud database data compression method based on an adaptive quantization algorithm. The method comprises the following steps of: 1, regarding to-be-compressed original data in a cloud database as a matrix, dividing the data into a plurality of non-overlapped data blocks according to predefined statistical characteristics, and calculating a mean value and a variance of each data block; 2, defining the complexity of each data block, and calculating the self-adaptive quantization step length of each data block according to the mean value and variance of each data block; step 3, performing non-uniform adaptive quantization on each data item in each data block to obtain a quantized value; and 4, establishing a probability model for a quantization result of each data block, calculating a coding length, obtaining a compression ratio, and carrying out entropy coding. The quantization step size of the data block is dynamically adjusted to be matched with the local characteristic of the data, so that the quantization error is reduced, and the data recovery precision is improved.

Implementations of the present specification provide a data writing, data recovery, and data reading method, and a corresponding secure disk apparatus. The data writing method includes following: User data blocks are first written into a write cache, and a plurality of user data blocks identified by LBAs are read from the write cache under a certain condition. For each user data block, an HBA is allocated to the user data block, authenticated encryption is performed on the user data block to generate an encrypted data block and authentication information, and first metadata corresponding to the user data block is generated, where the first metadata is organized in a form of a KV pair and includes the LBA, the HBA, and the authentication information. A plurality of write commands for the plurality of user data blocks are submitted to a host disk for the disk to store the encrypted data block based on the corresponding HBA. In addition, the first metadata corresponding to each user data block is further written into a first metadata table maintained by using an LSM tree. Then, a synchronization operation command is sent to the LSM tree and the host disk for the LSM tree and the host disk to complete data write persistence.

The invention relates to the technical field of fire alarm, and discloses a self-adaptive threshold fire-fighting buzzer alarm method and system based on fuzzy logic, and the method comprises the following steps: S1, environment data collection; s2, data preprocessing; s3, performing fuzzy processing; s4, performing fuzzy reasoning and alarm threshold calculation; s5, optimizing an alarm threshold value; s6, real-time feedback and dynamic adjustment: according to the real-time fire suppression result and the environment change data, adjusting an alarm threshold to form a dynamic feedback mechanism; s7, applying a fire propagation model; and S8, alarm execution. By adopting distributed data storage, redundant backup, encryption technology and automatic data management, efficient and safe data processing, reliable data recovery and accurate alarm decision are realized, and the response speed and stability of the system are improved.

The invention discloses a power distribution network construction method, system and device based on digital twinning and a storage medium, and relates to the technical field of power systems, and the method comprises the steps: collecting the operation link data of a power distribution network; constructing a power distribution network digital twinborn model based on the power distribution network operation link data; optimizing the prediction and decision-making capability of the digital twin model of the power distribution network, and performing evaluation and verification; the optimized power distribution network digital twinborn model is used for carrying out full-life-cycle dynamic simulation on the power distribution network; in the dynamic simulation process of the whole life cycle of the power distribution network, the operation state of the power grid is analyzed in real time, an optimal scheduling scheme is provided, the state of power grid equipment is monitored in real time, fault hidden dangers are found, fault causes are diagnosed, and a repair scheme is provided. The method further comprises the steps of encrypting sensitive data, backing up important data regularly, establishing a perfect data recovery mechanism and implementing strict access authority management. According to the invention, the operation efficiency, reliability, safety and intelligent level of the power distribution network can be improved.

The invention provides a fast recovery method for hadoop cluster data, which relates to the technical field of erasure codes, and comprises the following steps of: calculating an importance score of a data block to be recovered, determining a target copy number based on a nonlinear copy number adjustment function, calculating a load weight in combination with network topology information, and selecting candidate nodes; and predicting a node fault probability by using a long short-term memory network, calculating a migration priority based on the importance score and the fault probability, and selecting an optimal target node to execute data recovery. According to the invention, the intelligence and differentiation of the data recovery process are realized, and the data recovery efficiency and reliability are improved.