1198 results about "Garbage collection" patented technology

Techniques are described for enabling concurrent cross-region replications and garbage collection while maintaining consistency and data integrity among file systems. In some embodiments, techniques for garbage collection fencing utilize a system-level garbage fencing key (GC fencing key) and one or more job-level GC fencing keys in a source file system that perform one or more cross-region replications with one or more target file systems, one replication and one job-level GC fencing key per target file system. In some embodiments, one job-level GC fencing key in a source file system and one job-level GC fencing key in a source file system together provide garbage fencing for a cross-region replication. In certain embodiments, the metadata information in a GC fencing key can inform, instruct, or be used to configure garbage collectors to skip garbage collection for a range of snapshots in a file system.

The invention discloses a garbage collection method and device, equipment and a storage medium, and relates to the technical field of electrical digital data processing.The method comprises the steps that when metadata of a cache pool is updated, internal object abstracts corresponding to the metadata are put into a garbage collection queue; according to the water level condition of the data pool and the disk utilization rate of the object storage device of the data pool, the single-round execution task number of the garbage collection queue is determined; according to the number of single-round execution tasks of the garbage collection queue and the garbage collection priorities of the internal objects, the internal objects are selected to execute garbage collection, so that effective data in the internal objects are aggregated into new internal objects, and the internal objects subjected to garbage collection are deleted, namely, the situation that the water level of the current data pool is too high, and the garbage collection efficiency is improved is avoided. And the overlarge disk utilization rate of the object storage equipment is avoided, and the two are balanced, so that the influence on other businesses is avoided as far as possible on the basis of ensuring the normal recovery of the garbage.

The invention discloses a material supply and resource recovery collaborative scheduling method and system, and belongs to the technical field of logistics scheduling, and the method comprises the steps: obtaining a material supply instruction and a garbage recovery instruction, carrying out the image recognition of a building garbage picture, obtaining the garbage attribute, and generating a demand instruction library; the method comprises the following steps: establishing a feature knowledge base, setting a spatial clustering method, carrying out spatial clustering and time window screening, carrying out geographic coordinate analysis and time sequence sorting on material demand points and recovery points, generating an initial task pool, setting a loading matching method, and generating a material supply and recovery loading schematic diagram according to building material and garbage attributes; a circulation path is planned, a path planning method is set, an ant colony algorithm is used for initial path planning, a monitoring feedback method is set, data are returned in real time, the running state of the vehicle is monitored, and an alarm is given out immediately once abnormity is found; and the sorted and regenerated aggregate data is synchronized to a building material database, a resource feedback method is set, a reverse transportation task is identified, and a material supply and resource recovery closed loop is formed.

The invention belongs to the technical field of vehicle scheduling, and discloses a garbage transport vehicle regional scheduling method and system, which can dynamically evaluate the vehicle workload by sensing the states of a vehicle team and a collection point in real time, identify transferable tasks and appropriate receiving vehicles and calculate the task transfer cost when the load imbalance condition is found and processed, and can realize the regional scheduling of garbage transport vehicles. A reasonable task transfer scheme can be determined; therefore, the problem caused by disconnection of the static plan and the actual situation is avoided, and the efficiency and quality of garbage collection operation are improved.

The invention discloses an unmanned cleaning ship for salvaging garbage and a control method of the unmanned cleaning ship. The unmanned cleaning ship comprises a ship body, a garbage collecting device, a multi-mode sensing system, an intelligent control system and a water quality purifying device. The multi-mode sensing system senses the surrounding environment and transmits comprehensive environment information to the intelligent control system. The intelligent control system dynamically plans a navigation path according to the water surface garbage position, the obstacle data, the real-time ship body position, the historical cleaning efficiency and the energy storage state; according to the garbage type identification result, the distribution density and the storage cabin capacity state, the working state of the garbage collection device is adjusted in a self-adaptive mode; controlling the working state of the water purification device according to the water quality parameters, the flow velocity and the water temperature data. By integrating the multifunctional module and the intelligent control system, comprehensive perception, intelligent decision making and multifunctional treatment of the water area environment are achieved, the water area cleaning efficiency and quality are improved, and an innovative solution is provided for sustainable treatment of the water area environment.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

The invention provides a memory management method and a memory controller, which are applied to a storage device configured with a memory module, the memory module is provided with a plurality of chips, each chip is provided with a plurality of planes, and each plane is provided with a plurality of entity blocks. The method comprises the following steps: acquiring a chip enabling number of a memory module; selecting a target allocation method from a plurality of allocation methods according to the chip enabled number, the plurality of allocation methods including a first allocation method based on a plurality of chips and a second allocation method based on a plurality of planes; and dividing the plurality of entity blocks into a plurality of super blocks based on a target allocation method. Thus, the allocation strategy of the super blocks is optimized through the target allocation method, the utilization rate of the entity blocks in the memory module is improved, and meanwhile the garbage collection efficiency is improved.

The invention relates to the technical field of data storage and management, and discloses a self-adaptive storage capacity adjusting method and system for an industrial-grade solid state disk. The method and the system can intelligently analyze and predict future storage requirements by collecting key performance indexes and user data access modes of the solid state disk in real time, remarkably improve the efficiency of storage management, and can automatically identify behavior modes of storage use and formulate corresponding storage strategies through a machine learning algorithm, thereby improving the efficiency of storage management. According to the self-adaptive method, hot data is ensured to be quickly accessed, cold data is reasonably migrated, so that the utilization rate of storage space is optimized, in addition, the storage performance is further improved and the risk of data loss or damage is reduced by adopting a garbage collection algorithm and a TRIM command, and the self-adaptive method not only improves the response speed and the reliability of storage equipment, but also reduces the maintenance cost, and is suitable for popularization and application. And a more efficient and flexible storage solution is provided for enterprises.

The invention discloses an urban garbage collection and transportation scheduling method and system based on path optimization, and relates to the technical field of urban garbage collection and transportation and intelligent scheduling optimization, and the method comprises the steps: collecting multi-source original data, carrying out the standardization and time-space registration, and generating the structured observation data of vehicles, roads and collection and transportation points; constructing a dynamic garbage quantity prediction model according to the structured observation data, and predicting garbage increment and liquid level trend of each collection and transportation point; generating a task package and establishing a mapping relation based on a dynamic garbage quantity prediction model result in combination with road passage, vehicle load and time window constraints; and constructing a multi-target path optimization model on the basis of the mapping relation and the constraint, outputting an optimal driving path of the vehicle, and converting a path optimization result into a scheduling instruction. According to the method, the task package is generated on the basis of the dynamic garbage quantity prediction result in combination with road traffic, vehicle load and time window constraints, hierarchical matching of task targets and vehicle resources is achieved, and therefore the reasonability of task allocation and operation feasibility are improved.

The invention provides a memory management method, a memory controller and an effective data positioning circuit unit. The method comprises the following steps: determining a plurality of candidate virtual blocks according to respective valid data count values of a plurality of virtual blocks; obtaining a mapping table bitmap corresponding to each candidate virtual block, determining a plurality of target virtual blocks based on the mapping table bitmaps, and generating a corresponding integrated mapping table bitmap; obtaining one or more sub-mapping tables according to the integrated mapping table bitmap; and generating an effective data table according to the physical address in the sub-mapping table and the physical address contained in the target virtual block. According to the method, the candidate objects for garbage collection are subjected to secondary screening in a hardware acceleration mode to determine the optimal target combination, and the mapping relation of the candidate objects is integrated to obtain the physical address of the corresponding effective data, so that the effective data table is made to improve the efficiency of garbage collection operation, and the reading burden of a storage device is reduced.

The embodiment of the invention provides a memory system, a memory controller, a garbage collection method and a storage medium. The method comprises the following steps: acquiring a first bitmap corresponding to a first source data block to an Nth bitmap corresponding to an Nth source data block; n is an integer greater than or equal to 2; obtaining a combined bitmap based on the first bitmap to the Nth bitmap; reading a page table item table according to the combined bitmap; and writing the effective data corresponding to the first source data block to the Nth source data block in the page table entry table into the target data block. According to the garbage collection method, garbage collection operation can be performed on a plurality of source data blocks. And merging the bitmaps corresponding to the plurality of source data blocks to obtain a merged bitmap. And the corresponding page table item table is read through the merged bitmap, so that response delay caused by repeatedly reading the page table item table among the source data blocks is avoided, and the processing efficiency of the whole garbage collection process is improved.

The invention discloses an SSD B + tree indexing method and system based on wear leveling, and relates to the technical field of database indexing structure optimizing.The method comprises the steps that B + tree logic nodes and SSD physical addresses are decoupled, and a dynamic node mapping table is introduced; replacing local updating with additional updating, and writing the new version of the node into a new position of the SSD; when a write-in address is allocated to the node, an allocation strategy considering a block wear state is adopted, and write operation is guided to an area with relatively light wear; during garbage collection, high-wear blocks are preferentially treated to integrate wear. According to the method, the problems of writing hot spots and unbalanced abrasion of the B + tree on the SSD are effectively solved on the database software level, the service life of the SSD can be remarkably prolonged while the high performance of the B + tree is kept, and the method has very high universality and practical value.

The invention belongs to the technical field of garbage collection and transportation, and particularly relates to a hook arm garbage collection and transportation vehicle transportation route dynamic optimization system and method, the loading state of a garbage can is monitored through a sensor, and a collection and transportation instruction is automatically triggered when a preset threshold value is reached, so that garbage overflow is avoided, and meanwhile invalid scheduling is reduced. The intelligent scheduling system combines reinforcement learning and a Transform architecture, can comprehensively analyze real-time road condition information, dynamically calculates an optimal driving path, and timely adjusts the path according to traffic changes. Meanwhile, the system achieves cooperative scheduling of full-load vehicles and empty-box vehicles, ensures efficient connection of all links, effectively improves the response speed and execution efficiency of the clearance task, reduces the vehicle empty driving rate and energy consumption, achieves intelligent and fine management of the garbage clearance process, and improves the efficiency of the clearance task. The problem of low efficiency caused by information lag and fixed path in a traditional scheduling mode is solved.

The invention discloses a garbage collection optimization method and device, equipment and a medium. The invention relates to the technical field of solid state disks, which comprises the following steps that: a global invalid data bit chart is established in a host memory, each table item in the global invalid data bit chart corresponds to a physical block, and a bitmap bit in each table item corresponds to a physical page in the physical block; bit values corresponding to the bitmap bits comprise a first bit value and a second bit value; responding to a data updating event through an access acceleration engine so as to dynamically update the bit value of the corresponding physical page in the global invalid data bit graph; and when garbage collection is triggered, screening the physical page of which the bit value is the second bit value in a to-be-collected source physical block according to the global invalid data bit chart and the access acceleration engine to perform validity verification and data migration, and skipping the physical page of which the bit value is the first bit value. According to the invention, the garbage recycling efficiency is improved.

The invention discloses a composite stress test method and device for a solid state disk, equipment and a medium, and the method comprises the steps: loading a test configuration parameter, and building communication connection with a to-be-tested solid state disk which is preset in a preset test environment; performing performance baseline calibration and preprocessing on the to-be-tested solid state disk; executing a composite stress performance test, and dynamically coupling at least two of temperature stress, capacity occupation stress, power interruption stress, garbage collection induced stress and mixed load stress; synchronously acquiring test data and constructing a time sequence data warehouse; and performing intelligent deep analysis based on the time sequence data warehouse, wherein the intelligent deep analysis comprises performance consistency deep analysis and health degree and risk prediction analysis. According to the method, a real complex environment is simulated through the composite stress test, the problem that a traditional test method is single in scene is solved, meanwhile, the problem that data analysis is shallow is solved through intelligent deep analysis, and the reliability of the solid state disk can be comprehensively and accurately evaluated.

The present disclosure relates to the technical field of cleaning device and discloses a garbage collection system, including a landing assistance mechanism, a base station and a controller. The base station includes a holding section for a pool automatic cleaning device, a garbage collection device and a water flow guiding mechanism. In a case where the pool automatic cleaning device is located at the holding section, a filtering device of the pool automatic cleaning device is interconnected to the garbage collection device, and the controller is configured to control the water flow guiding mechanism to perform water spraying, so as to move garbage in the filtering device from the filtering device to the garbage collection device.

A host system having at least one processing device to execute instructions configured to implement a garbage collection manager, which can: compute, based on write commands sent from the host system to the memory sub-system according to a protocol of flexible direct placement (FDP) to store data of storage space tenants, an indicator of usage level of reclaim units in the memory sub-system; identify, in response to a determination that the indicator meets a condition, at least one reclaim unit in the memory sub-system having valid data; and communicate with the storage space tenants having the valid data in the at least one reclaim unit to cause the storage space tenants to perform operations that reduce garbage collection in the memory sub-system in reclaiming storage resources of the at least one reclaim unit.

A computing device having a host system coupled to a memory sub-system, the host system having at least one processing device configured to run a garbage collection manager and a plurality of storage space tenants. The garbage collection manager can: track a history of data storage instances of data being written, according to a protocol of flexible direct placement (FDP), to reclaim units in the memory sub-system by the plurality of storage space tenants; identify, based at least in part on the history, a reclaim unit as a candidate for accelerated invalidation of valid data remaining in the reclaim unit; determine, based at least in part on the history, estimates of expiration time of the valid data; and determine, based on the estimates, whether to perform operations to accelerate invalidation of the valid data remaining in the reclaim unit.

An apparatus and method of a storage device including a storage medium are provided. An apparatus may include a storage device comprising a storage medium, and a controller configured to provide a first over-provisioning (OP) pool of storage units of the storage medium for use by a first reclaim unit handle (RUH); provide a second OP pool of storage units of the storage medium for use by a second RUH, wherein the first OP pool and the second OP pool are distinct from each other; perform a first storage operation associated with the first RUH using the first OP pool; and perform a second storage operation associated with the second RUH using the second OP pool.

The invention discloses a separate memory transaction system based on a hierarchical block version chain, and belongs to the field of distributed transaction systems, the system enhances the elasticity of an array structure through chain extension, constructs a multi-version data management mechanism capable of dynamically extending, and realizes low-delay version batch processing reading with the assistance of lightweight block-level indexes. An asynchronous index updating mechanism is adopted, index consistency is guaranteed through sub-node block-level index updating and propagation, and synchronization overhead is reduced; a hybrid garbage collection strategy of transaction state perception is adopted, and an outdated version multiplexing and hotspot identification collection method is combined, so that a version structure is compressed, and remote data transmission redundancy is reduced. Besides, in order to adapt to a lock-free read-write concurrent environment, a version integrity verification mechanism based on a single-side RDMA primitive is introduced, and access consistency and atomicity between metadata and version data are ensured. According to the method, the transaction throughput capacity and the access delay stability can be remarkably improved under the high-concurrency TPC-C load, and good expandability and engineering practical value are achieved.

The invention relates to a hybrid architecture dynamic cache synchronization method based on a high-concurrency scene, and belongs to the technical field of computer Web application development. According to the method, a C + + dynamic link library is loaded when a JavaWeb application is started, and a cross-process cache storage space is constructed by utilizing a shared memory mechanism, so that data sharing among multiple instances is realized. And data interaction between Java and a C + + layer is completed by adopting a JNI interface, so that the Java garbage collection pressure is effectively reduced. Data consistency is guaranteed through an exclusive lock and read-write lock optimization mechanism, cross-instance update notification is realized in combination with event driving or message queues, and transaction type batch update is supported to ensure operation atomicity. A memory mapping file and an efficient data structure are innovatively adopted, the access efficiency is improved and the data copy overhead is reduced by combining a pre-allocation memory pool technology, the system throughput and the response speed are remarkably improved, the performance loss caused by memory fragments and lock competition is reduced, and the method is suitable for mainstream JavaWeb environments such as Spring frames and Tomcat servers.

The invention provides a garbage collection testing method and device, electronic equipment and a storage medium, and the method comprises the steps that a garbage collection triggering instruction from an external testing tool is received, and the garbage collection triggering instruction comprises a target identifier of to-be-collected data; in response to the garbage collection triggering instruction, starting garbage data collection operation on a data space corresponding to the target identifier; and after garbage collection is completed, a garbage collection completion signal is returned to the external test tool. By introducing a garbage collection mechanism actively triggered by an external test tool, the problems of uncontrollable test opportunity, limited scene coverage and the like caused by the fact that a traditional storage system GC test depends on internal condition triggering are effectively solved, a tester is allowed to accurately specify a target data space and trigger collection according to needs, and the test efficiency is improved. Redundant time consumption of automatic GC of a passive waiting system in a traditional method is avoided.

The invention relates to the technical field of solid state disks, and discloses a solid state disk data writing method and device.According to the solid state disk data writing method, a temporary standby space is constructed through a reserved standby block, and the standby space is started through comprehensive judgment of the firmware system resource state and the garbage collection module running state; when the idle blocks of the firmware system are insufficient or the garbage collection module runs to cause the shortage of write resources, a temporary write carrier can be quickly provided, and the write request of the Host end is prevented from being blocked or delayed; meanwhile, by monitoring the resource state of the free block in real time, data migration is completed in time and the standby block is released when the resources are sufficient, so that the continuity and the high efficiency of data writing are guaranteed, the standby block is ensured to return to a redundant backup role, the original bad block replacement function is not influenced, and the tail end writing performance and the operation stability of the solid state disk are effectively improved.

The invention discloses a particle management method for dynamic rendering, relates to the technical field of computers, and discloses a particle management method for dynamic rendering, which comprises the following steps: creating a particle object pool; distributing a preset number of first particle objects, and storing the first particle objects in the particle object pool; obtaining at least one first particle object from the particle object pool for dynamic rendering; and for a second particle object of which the life cycle ends in the dynamic rendering process, resetting the particle state of the second particle object, and returning the second particle object to the particle object pool as the first particle object. The particle object pool technology is adopted to optimize the particle creating and destroying process in the dynamic visual special effect rendering process, frequent creating and destroying of particle objects are avoided, the memory allocation frequency and the garbage collection pressure are effectively reduced, the calculated amount of dynamic rendering is reduced, the rendering performance is improved, and the rendering efficiency is improved. For example, the fluency of the rendered dynamic visual special effect is improved, and the user experience is better.

In some implementations, a controller may select a physical block, of a user data virtual block (VB), for a host write operation or a garbage collection operation. The user physical block previously stored user data. The user physical block has previously been programmed in accordance with triple-level cell (TLC) programming. The controller may determine that an average bit error rate (BER) of the user physical block exceeds an average BER of the VB. The controller may, based on determining that the average BER of the physical block exceeds the average BER of the user VB: swap, for the VB, the user physical block with a system physical block that is allocated for storing system data; swap, for the VB, the user physical block with a reserved physical block; or cause a program time, of the user physical block, to be increased.

The utility model relates to a drawer type parasitic wasp circulating feeding box which comprises a feeding layer box body with an opening in the upper end, an upper cover body capable of being pulled transversely is installed at the upper end of the feeding layer box body, a wasp releasing hole is formed in one side wall of the feeding layer box body, a blocking mechanism is installed on one side wall of the feeding layer box body, and a detachable filter screen is transversely arranged at the lower end of the feeding layer box body. And a garbage collection box body is detachably mounted at the lower end of the feeding layer box body and located on the lower side of the filter screen. The breeding box is compact in structure, not only facilitates breeding of parasitic wasps, but also facilitates replacement of breeding leaves and collection of garbage.

The invention discloses a garbage collection method, system and device for a multi-core CPU (Central Processing Unit) memory and a medium. The method comprises the following steps: acquiring a request instruction of a host; controlling a protocol layer CPU to apply for a target cache interval according to the request instruction; writing the target data into the target cache interval, and recording the target write-in data volume through the protocol layer CPU; under the condition that the target write-in data volume is greater than or equal to a write-in threshold value, the protocol layer CPU generates a garbage collection trigger signal, garbage target collection time and a target cache interval for stopping application; the garbage collection trigger signal is sent to an FTL layer CPU to start garbage collection and monitor the garbage collection state in real time; and when the garbage recycling state represents that the garbage recycling number is larger than or equal to the garbage target recycling number or the garbage recycling time is larger than or equal to the garbage target recycling time, garbage recycling is quitted. The timeliness and accuracy of garbage collection can be ensured, and the performance of a memory is improved.

An automatic surface garbage salvaging vessel relates to the technical field of water ecological environmental protection. The vessel comprises a hull for traveling on the water surface; a garbage lifting mechanism disposed at the front end of the hull for conveying garbage on the water surface to a garbage crushing mechanism at the rear via an inclined conveyor belt; a garbage crushing mechanism disposed at the hull and located at the rear of the garbage lifting mechanism for crushing the collected garbage and pushing it to a garbage compression mechanism at the rear; a garbage compression mechanism disposed at the hull and located at the rear of the garbage crushing mechanism for compressing the crushed garbage and, when the compressed garbage reaches a certain amount, pushing a portion of the compressed garbage to a garbage collection bin at the rear; and a garbage collection bin disposed at the hull and located at the rear of the garbage compression mechanism for collecting the compressed garbage. The present invention can reduce the space occupied by garbage by compressing the collected garbage, thereby increasing the total amount of garbage collected during each operation.

A computing device having a host system coupled to a memory sub-system. The host system runs a garbage collection manager and a plurality of storage space tenants. The garbage collection manager can: write, to the memory sub-system according to a protocol of flexible direct placement (FDP), data of the plurality of storage space tenants to a reclaim unit in the memory sub-system; identify, after a first portion of the data stored in the reclaim unit is invalidated, first storage space tenants having a second portion of the data remaining valid in the reclaim unit; communicate with the first storage space tenants to identify estimates of expiration time of the second portion; and select, based on the estimates, the reclaim unit for acceleration of invalidation of the second portion of the data.

A memory management method and a memory controller for executing virtual block mapping operations. The method performs initial virtual block mapping across multiple physical channels, then dynamically divides the channels into two groups when free blocks in a target channel fall below a threshold. By remapping blocks separately for each group, the method enables simultaneous garbage collection and host write operations across different channel groups, so as to improve operational efficiency of the storage device.