168 results about "Disk space" patented technology

The invention provides a hard disk testing method, a hard disk fault early warning method and a hard disk fault early warning device, which can be applied to the technical field of storage equipment. The hard disk testing method comprises the following steps: processing a to-be-tested hard disk to enable the to-be-tested hard disk to reach a steady state condition; executing an advanced formatting operation on the to-be-tested hard disk reaching the steady state condition to obtain the to-be-tested hard disk after the advanced formatting operation is completed; based on a plurality of preset overwriting proportions, testing operation is executed on the to-be-tested hard disk after the advanced formatting operation is completed, performance testing data are obtained, and the overwriting proportions are proportions of the overwriting area space in the to-be-tested hard disk space after the advanced formatting operation is completed; according to the performance test data corresponding to the multiple preset overwriting proportions, a performance test result is obtained, and the performance test result represents the performance recovery capability of the to-be-tested hard disk after the advanced formatting operation is completed.

The invention relates to the technical field of wind power plant network operation and maintenance, in particular to a method and related equipment for monitoring alarm information, and the method comprises the steps: inputting basic information of a physical machine and a virtual machine, including an equipment model, an IP address, a deployment position and specified field information; a resource binding threshold value is set, and the resource binding threshold value covers the space utilization rate of a CPU, a memory and a disk; monitoring resource use conditions in real time, performing natural language processing on alarm information, and extracting key features; matching the key features with historical data by using a preset classification model, dividing alarm levels and allocating the alarm levels to corresponding processing queues in combination with a resource threshold exceeding degree; and pushing alarm information to the contact person through a multi-mode notification channel according to the alarm level.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The invention provides a data processing method and a related device, which can be applied to a database flash-back scene. The method comprises the steps of receiving a first flashback instruction, and recording a first page to a flashback log before the first page in a database is modified for the first time in a target period in response to the first flashback instruction. And receiving a second flash-back instruction, and in response to the second flash-back instruction, restoring the database to a state at a specified moment based on the flash-back log and the redo log of the database. In the application, the first page is recorded in the flash-back log only before the first page is modified for the first time in the target period. In other words, for the first page with the modification operation, only one initial page is recorded in the target period, and the subsequent modification version in the target period is not recorded, so that the overhead of the disk space can be effectively reduced.

Managing resources in a VM cluster; allocation of resources among competing VMs. Assigning VMs to real devices, responsive to needs for resources: processor usage, disk I / O, network I / O, memory space, disk space. Assigning VMs responsive to needs for cluster activity: network response latency, QoS. Using predictive models of resource usage by VMs. Transferring VMs, improving utilization. Failing-soft onto alternative VM resources. Providing a resource buffer for collective VM resource demand. Transferring VMs to a cloud service that charges for resources.

One or more embodiments in the present description relate to the technical field of databases. Provided are a data processing method and apparatus. The method is applied to a database based on a combination of a log structure and a tree storage structure. In the solution provided in the present description, the method comprises: acquiring the volume of data to be deleted recorded in an incremental sorted string table (SSTable) of a target partition; and if the volume of said data recorded in the incremental SSTable reaches a first volume threshold value, combining the incremental SSTable into a baseline SSTable of the target partition, so as to delete said data. By means of the solution provided in the present description, data to be deleted can be deleted from a target partition in a timely manner, thereby optimizing the query performance of a database, and reducing unnecessary occupancy of a disk space by said data.

The invention discloses a file lock management method and device for a distributed file system, equipment and a medium, and is applied to the technical field of computers, and the method comprises the following steps: after receiving a first file access request initiated by a client to a first access node, constructing first file lock information according to an identification parameter in the access request, persistently storing the first file lock information to a shared disk space and caching the first file lock information to a local first access node; the access node is a mounting node for the client to access the distributed file system; switching the mounting node from the first access node to a second access node, and clearing the first file lock information locally cached by the first access node; and after a second file access request initiated by the client to the second access node is received, querying the first file lock information in the shared disk space based on the identification parameter in the access request so as to locally reconstruct the file lock cache at the second access node. According to the method and the device, the problem of file lock loss and residue in a distributed cluster access node switching scene is solved.

The invention belongs to the technical field of space management, and discloses a virtual disk space management method and system based on block reconstruction. Comprising the steps of obtaining real-time block state data of a qcow2 mirror image in a virtual machine operation environment, and performing candidate block extraction and bidirectional state comparison matrix construction according to the real-time block state data; calculating a void confidence score of each candidate block according to the bidirectional state comparison matrix in combination with the real-time block state data; performing hierarchical sorting and continuous block address field screening according to the void confidence score to obtain a to-be-reconstructed void section; the qcow2 mirror image is divided into a plurality of reconstruction units, a micro-granularity read-write lock is applied for the reconstruction units containing to-be-reconstructed cavity segments, cavity punching operation is executed after the read-write lock is obtained, and L2 mapping table entries are synchronously updated; the I / O request delay change rate of the virtual machine is monitored in real time, and the execution rate of the block reconstruction operation is dynamically adjusted based on the I / O request delay change rate; the storage resource utilization rate and the service stability of the virtual machine are improved.

The present application relates to a dynamic file mounting method, system, computer device, and readable storage medium. The method comprises: invoking a proxy device to create n Samba users associated with a virtual machine, each Samba user being configured with corresponding user information; sending file mounting information associated with the virtual machine to the proxy device; and upon receiving the file mounting information, creating a virtual machine mounting directory based on the file mounting information and linking the file to be mounted to the corresponding virtual machine mounting directory. This application solves the problems of prolonged virtual machine creation time when copying large files, and the waste of disk space caused by repeated copying of the same file by different virtual machines. Dynamic mounting is achieved, and the creation time of large file mounting is shortened, while significantly saving disk space.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: setting the state of a logic disk through employing a logic disk operation request sent by a host, and determining a corresponding authentication code and an encryption code under the condition that the encryption and decryption functions of the logic disk are enabled; receiving a data writing request sent by the host, and determining a target logic disk corresponding to the writing position and target data to be written; authenticating the data writing request by using the authentication code of the target logic disk; under the condition that the authentication is passed and the current state of the target logic disk is encryption and decryption starting, encrypting the target data by using an encryption code of the target logic disk to obtain target encrypted data; and writing the target encrypted data into a hard disk space having a mapping relationship with the target logic disk in the redundant array of independent disks. According to the method and the device, the reliability and the security of data stored on the hard disk without an encryption function can be ensured.

Third party applications are deployed as “containerized applications” on one or more wireless AP devices. The containerized applications are confined to a pre-allocated segregated disk space within a file system of a wireless AP device. The containerized applications have access to standard Linux services as well as access to advanced features provided by an AP.

The invention belongs to the technical field of computer storage, and particularly discloses an encryption difference compressed data restoration method and device based on similarity perception. According to the method and the device, the differential data block and the reference block which are subjected to aggregation storage are read from the continuous disk space at one time; in the data recovery process, pipelining processing is carried out on a difference decoding task and an erasure code decoding task; and performing data restoration according to the size of the data slice, the difference data block and the reference block by executing the pipelined difference decoding task and the pipelined erasure code decoding task. According to the mode, the whole aggregation storage data block containing the differential data block and the reference block is read from the continuous disk space, compared with respective reading, one-time extra disk overhead can be reduced, then the differential decoding task and the erasure code decoding task are subjected to pipelining processing, and the decoding efficiency is improved. And data recovery is carried out by executing the decoding task, so that the data recovery performance of the encryption difference compression system can be effectively improved.

The invention relates to the field of data access, and particularly provides an MPT-based block chain database system, a data access method, a terminal and a medium, the system comprises a native MPT storage engine used for realizing an MPT node structure in a disk and a memory, and the node structure comprises branch nodes, extension nodes and leaf nodes; the asynchronous I / O module is used for realizing non-blocking disk operation based on Linux iouring; the file system bypass module is used for supporting direct access to the block device; the versioning concurrency control module is used for realizing lock-free reading through an immutable Trie structure and atomic pointer updating; and the dynamic compression module is used for dynamically adjusting a historical data retention strategy according to the disk space utilization rate. The MPT structure storage engine is realized, basic data support is provided for a high-performance block chain system, serialization overhead is eliminated, and storage efficiency is improved.

The application discloses a mirror backup method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: starting a mirror warehouse service, and constructing a node local warehouse; acquiring a node label, acquiring a node mirror corresponding to the node label from a complete mirror warehouse, and saving the node mirror to the node local warehouse; if it is detected that polling backup of a target mirror is required, acquiring the target mirror from the complete mirror warehouse, and saving the target mirror to the node local warehouse; the target mirror is a mirror which does not exist in the node local warehouse and the number of backup is less than two; the method adopts a non-consistent distributed backup mechanism to backup the mirror, all the mirrors have at least two backups in the cluster, when any node is abnormal, all the mirrors in the cluster can be guaranteed, the high availability of the cluster is guaranteed, and the bandwidth and disk space occupied by mirror transmission and storage can be reduced.

The application discloses a resource prediction method and device, equipment and a readable storage medium, which can be applied to the field of artificial intelligence technology, and the method comprises the steps of obtaining metadata corresponding to a target task; based on the metadata, a preset task classification tree is used to classify the target task, and a target classification result is obtained; a corresponding relationship between different types of tasks and different resource prediction models is stored in the preset task classification tree; a resource prediction model corresponding to the target classification result is called to predict the resources of the target task, and a prediction target data is obtained; the prediction target data comprises the number of CPUs, the number of GPUs, the size of memory and the disk space. In this way, the resource prediction model corresponding to the target task is determined based on the preset task classification tree, and then the resources are predicted, thereby improving the accuracy of resource prediction.

The application discloses a GC mechanism processing method and device and medium, and is suitable for the technical field of solid state disks. When the RGW service is started, a GC main thread, a queue and a work thread are created, wherein the GC main thread starts the GC mechanism; garbage data obtained by the GC main thread traversing a storage pool is stored in the queue; and the queue sends the garbage data to the work thread in a de-queue mode so that the work thread deletes the garbage data. The method uses the thread division mode, the GC main thread starts the GC mechanism, when the GC mechanism is started, garbage collection is processed, the main thread is responsible for traversing the garbage data, and the work thread deletes the garbage data, thereby effectively improving the processing speed of the GC mechanism, relieving the pressure of only executing garbage collection through a single thread at present, and guaranteeing the stability of the system. Meanwhile, the multiple threads execute the deletion of the garbage data, high concurrency is realized, and available disk space is released.

A novel software updating method is provided. A target file is divided into segments, where some segments are updated by patching, while other segments are updated by archiving. The segmentation of the update allows very large files such as DYLD shared caches to be patched in-place, i.e., by using free space available within the file to perform patching rather than requiring enough free space on disk to store both the new version and the old version of the file. The segmentation of the update also allows each segment to be updated individually by the most optimal update method (copy, patch, or archive) so that the size of the update file can be minimized.

The application discloses a data backup system and method, a storage medium and an electronic device, and relates to the field of financial technology. The system comprises: a ledger database, which is used to acquire information of a database group and generate a backup strategy corresponding to the database group; a backup management platform, which is used to acquire the backup strategy, execute a backup task of the database group through a backup database in the case that a backup mode is remote backup, and backup data generated by the backup task to a distributed object storage system; and the distributed object storage system, which is used to receive the data generated by the backup task. Through the application, the problems of large occupation of built-in SSD storage disk space by backup data and difficult management of backup data in the related art are solved.

An Oracle database big table data deletion method with small disk space occupation comprises the following steps: firstly, selecting a data table to be deleted in an Oracle database, and then carrying out paging query to obtain data of each page; the method comprises the following steps: firstly, screening data of each page to obtain data meeting conditions, then carrying out deletion operation, monitoring execution time of the deletion operation, if the deletion operation is completed within a preset time threshold, continuing to process data of a next page, and if the deletion operation is overtime, checking whether deadlock occurs or not; if the deadlock exists, terminating the deletion operation of the current page, waiting for a preset time length, and then performing the deletion operation of the current page; if the deadlock does not exist, skipping the current page, and continuing to delete the data of the next page; and repeating the above steps on other target data tables in the Oracle database in sequence to perform data deletion until all the data meeting the conditions are deleted, and ending the method. When a large amount of data is deleted, the efficiency is high.

A method and system for leveraging file-system metadata for direct to cloud object storage optimization. Under cloud object storage architecture, any unstructured data may be managed and stored in the cloud as objects. Objects thus provide an elastic, scalable format through which unstructured data may be maintained for a variety of purposes, including those directed to data backup, archiving, and / or disaster recovery. Cloud object storage, however, tends to be costly—mainly stemming from factors, such as the frequency of read and write operations (also referred to as runtime costs) applied to, as well as the allocation of disk space (also referred to as storage costs) consumed by, any number of objects configured to store file backup copies. In addressing at least the aforementioned, embodiments disclosed herein optimize cloud object storage utilization through the intelligent grouping and object storing of data based on file attribute similarities.

The invention provides a host data set space allocation control method, device and equipment, a computer readable storage medium and a computer program product, and can be applied to the technical field of financial science and technology. The method comprises the following steps: receiving a data set creation request; obtaining the maximum distributable space size of a target disk group to which the target disk volume belongs; under the condition that the sum of the size of the first disk space and the size of the second disk space is larger than the maximum distributable space size, adjusting prompt information is generated and output, and the adjusting prompt information comprises at least one of the following information: an adjusting suggestion for the size of the first disk space and / or the size of the second disk space; recommending target alternative disk volume information; and executing corresponding adjustment operation according to confirmation feedback of the user on the adjustment prompt information, and triggering creation of the data set based on the adjusted parameters. According to the scheme, the risks of data set space depletion, job interruption and consequent complex data rollback operation caused by the fact that the secondary distribution requirement cannot be met can be reduced.

This invention discloses a data storage method and device based on a block storage engine. The data storage method includes: dividing a logical block of the block storage engine into multiple first logical units; dividing a second logical unit according to the capacity of the first logical units; dividing the physical disk space into physical mapping units with fixed capacities according to the capacity of the logical blocks; allocating corresponding physical mapping units according to the capacity of the logical blocks and storing physical data in the physical mapping units; forming the physical storage address of the physical data and the metadata corresponding to the physical storage address based on the first address mapping relationship between the logical blocks and the physical mapping units, the second address mapping relationship between the first logical units and the physical mapping units, and the physical address of each physical mapping unit. The data storage method based on the block storage engine provided by this invention effectively reduces the amount of metadata in address mapping in a distributed block storage engine.

The application discloses a disk testing method, device and equipment for a virtual machine environment and a medium. The method comprises the following steps: configuring a test environment according to a test instruction, configuring a corresponding virtual storage space in the disk space of the test environment according to a protocol rule, allocating system resources to the storage unit of the virtual storage space, and mounting the storage unit to the created virtual machine. The virtual machine runs a test script corresponding to the test instruction to perform performance testing on the storage unit and obtain a corresponding test result. Through the above method, the virtual storage space containing multiple independent storage units can be configured, and the non-system resources of the storage unit are allocated. Then, the virtual machine mounting the storage unit executes the test instruction and performs performance testing on the storage unit, thereby improving the efficiency of performance testing on the virtual function of the NVMe disk in the virtual machine environment.

The invention discloses a message storage and query method and system based on multiple levels of detail, a medium and electronic equipment, and the method comprises the steps: storing a message in a memory according to multiple levels of detail, and storing the message in a disk according to multiple levels of detail when the memory occupation exceeds a preset threshold; when the message is stored in the disk, splitting the message into a plurality of files according to timestamps, and storing the message with the same ID in a continuous disk space according to multiple detail levels; when the message is queried, the message is retrieved from the memory according to the query request, and if the message does not exist in the memory, the message is queried from the disk; and when the message in the disk is queried, positioning the position of the message in the disk according to the ID and the multi-level-of-detail level, and reading the message to output a query result. According to the invention, the message is stored in the memory in the form of multiple levels of detail, and when the occupied memory exceeds the set threshold, the message is stored in the disk in the form of multiple levels of detail, so that the memory occupation is low, and the system performance is improved.

The application provides a file transmission method, an electronic device and a storage medium, and relates to the technical field of intranet security protection. According to the write parameters of a to-be-written file, an index file operation interface is called to determine whether an index file of the to-be-written file exists, if yes, according to the operation state of the to-be-written file in the index file and the write parameters of the to-be-written file, it is determined whether the index file of the to-be-written file is updated, when the to-be-written file is a large file or a small file, the index file operation interface is called according to the total size of the to-be-written file to update the storage location information in the index file where the to-be-written file is located, the updated index file records the real storage location information of the to-be-written file, and the real storage location information of the to-be-written file has the characteristics of high utilization of the disk space occupied by different data files, the write efficiency of the to-be-written file is improved, and the high-performance transmission requirement of the one-way import system is met.

The present application provides a method and device for file processing, the method comprising: calculating a hash value corresponding to a first file, determining whether a second file exists in a pre-created first global hash index directory based on the hash value corresponding to the first file, and if the second file exists in the first global hash index directory, replacing the first file with a hard link to the second file; and / or when a third file is uploaded, obtaining a hash value corresponding to the third file, determining whether a fourth file exists in a pre-created second global hash index directory based on the hash value corresponding to the third file, and if the fourth file exists in the second global hash index directory, creating the third file and hard linking the third file to the fourth file, which can save disk space and is simpler to implement.

The invention discloses an information processing method and device based on a storage system, equipment and a medium, and relates to the technical field of data processing, and the method comprises the following steps: in response to an information writing command, writing target information in a preset data block based on a preset data structure, determining a target address of the target information in the preset virtual disk according to an initial address of a target object corresponding to the target information in the preset virtual disk, the disk space capacity corresponding to the target object and the number of nodes; and if the preset storage space of the preset data block is full, writing the first information in the preset data block into the bottom layer of the storage system based on the target address until the target information is completely written into the bottom layer of the storage system. By setting the preset data block with the preset storage space and the fixed data structure, all the target information is written into the bottom layer in batches, the problem that the data writing efficiency is low due to the fact that the data size is too large is solved, and meanwhile the problem that the information is covered due to the fact that the written data size is too large and the frequency is high can be solved.

The embodiment of the invention provides a hard disk sharing method, device and equipment for a heterogeneous system and a storage medium, and the method comprises the steps that a non-real-time system of the heterogeneous system mounts a virtual hard disk of each real-time system of the heterogeneous system to a corresponding directory of a physical hard disk, and the non-real-time system manages the physical hard disk; any real-time system sends connection request information to the non-real-time system before accessing the virtual hard disk of the real-time system, and after the connection request passes verification of the non-real-time system, the real-time system performs access operation on the virtual hard disk of the real-time system. According to the technical scheme, the function that multiple real-time systems share the physical hard disk is achieved, it is avoided that a single real-time system occupies the hard disk exclusively, the size of the hard disk space capable of being used by each real-time system can be flexibly configured, and the purpose of hard disk quota is achieved.

The application provides an object storage method and device. In the method, each storage block in a storage device corresponds to usage state information belonging to the storage block. When storing an object, a determined bucket name for storing the object to be stored, an object name of the object to be stored, an object version number of the object to be stored, and a data size of the object to be stored are obtained. A target data disk for uploading the object to be stored is determined according to the bucket name, the object version number, and the data size. Object data of the object to be stored is flushed into the target data disk according to the usage state information corresponding to the target data disk. An index disk for storing object metadata of the object to be stored is determined according to the bucket name, and the object metadata of the object to be stored is flushed into the index disk. It can be seen that the technical solution provided by the embodiment can improve the system storage performance and further reduce the disk space overhead.