1621 results about "Garbage collection" patented technology

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

Techniques are described for enabling concurrent cross-region replications and garbage collection while maintaining consistency and data integrity among file systems. In some embodiments, techniques for garbage collection fencing utilize a system-level garbage fencing key (GC fencing key) and one or more job-level GC fencing keys in a source file system that perform one or more cross-region replications with one or more target file systems, one replication and one job-level GC fencing key per target file system. In some embodiments, one job-level GC fencing key in a source file system and one job-level GC fencing key in a source file system together provide garbage fencing for a cross-region replication. In certain embodiments, the metadata information in a GC fencing key can inform, instruct, or be used to configure garbage collectors to skip garbage collection for a range of snapshots in a file system.

The invention relates to the technical field of garbage disposal, and discloses a household garbage AI intelligent unmanned transport vehicle and a garbage disposal transport method.The transport vehicle comprises a garbage transport vehicle body, a data acquisition module, a path optimization module, a dynamic path adjustment module, a multi-vehicle collaborative scheduling module and an execution module; the method comprises the steps that a garbage transportation task is initialized, and garbage stations and the state of a transportation vehicle are collected; calculating an optimal path, and performing real-time adjustment based on dynamic data; by adopting multi-vehicle cooperative scheduling, path conflicts are avoided, and the transportation efficiency is optimized; garbage collection, transportation and delivery are completed, and transportation data are recorded. According to the method, efficient automation of garbage transportation is achieved through intelligent data collection, path optimization, dynamic adjustment and multi-vehicle cooperative scheduling, the optimal path is calculated through the variational method and the Euler-Lagrange equation, the driving route is dynamically adjusted in combination with the Hamilton-Jacobi-Bellman equation, multi-vehicle scheduling is optimized based on the differential game and the Nash equilibrium, and the efficiency of garbage transportation is improved. And high-efficiency transportation and no path conflict are ensured.

The invention discloses a garbage collection method and device, equipment and a storage medium, and relates to the technical field of electrical digital data processing.The method comprises the steps that when metadata of a cache pool is updated, internal object abstracts corresponding to the metadata are put into a garbage collection queue; according to the water level condition of the data pool and the disk utilization rate of the object storage device of the data pool, the single-round execution task number of the garbage collection queue is determined; according to the number of single-round execution tasks of the garbage collection queue and the garbage collection priorities of the internal objects, the internal objects are selected to execute garbage collection, so that effective data in the internal objects are aggregated into new internal objects, and the internal objects subjected to garbage collection are deleted, namely, the situation that the water level of the current data pool is too high, and the garbage collection efficiency is improved is avoided. And the overlarge disk utilization rate of the object storage equipment is avoided, and the two are balanced, so that the influence on other businesses is avoided as far as possible on the basis of ensuring the normal recovery of the garbage.

The invention relates to the technical field of garbage collection and transportation full scenes, and particularly discloses a garbage collection and transportation full scene data monitoring system which comprises a full scene data acquisition module, a dynamic collection and transportation queue generation module, a collection and transportation vehicle distribution module, a transfer station distribution feedback module and a database. Garbage collection full scene data is collected in real time through sensor groups of garbage cans, garbage collection vehicles and transfer stations, traffic road condition information is fused to construct a data network, regional demands are predicted based on historical data, a dynamic priority queue is generated in combination with a garbage amount exceeding threshold proportion, and a path is optimized through capacity matching and real-time road conditions, so that the real-time garbage collection is realized. And the congestion compensation duration is calculated, it is ensured that classified garbage is precisely matched with vehicle partitions, the transfer station capacity is dynamically calculated, and overload tasks are automatically distributed to adjacent stations. According to the method, the problems of data islands, static scheduling and mixed loading of a traditional system are solved, the resource efficiency and environmental protection benefits are remarkably improved, and the clearance efficiency and the service quality are improved.

The invention discloses a material supply and resource recovery collaborative scheduling method and system, and belongs to the technical field of logistics scheduling, and the method comprises the steps: obtaining a material supply instruction and a garbage recovery instruction, carrying out the image recognition of a building garbage picture, obtaining the garbage attribute, and generating a demand instruction library; the method comprises the following steps: establishing a feature knowledge base, setting a spatial clustering method, carrying out spatial clustering and time window screening, carrying out geographic coordinate analysis and time sequence sorting on material demand points and recovery points, generating an initial task pool, setting a loading matching method, and generating a material supply and recovery loading schematic diagram according to building material and garbage attributes; a circulation path is planned, a path planning method is set, an ant colony algorithm is used for initial path planning, a monitoring feedback method is set, data are returned in real time, the running state of the vehicle is monitored, and an alarm is given out immediately once abnormity is found; and the sorted and regenerated aggregate data is synchronized to a building material database, a resource feedback method is set, a reverse transportation task is identified, and a material supply and resource recovery closed loop is formed.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

The invention belongs to the technical field of vehicle scheduling, and discloses a garbage transport vehicle regional scheduling method and system, which can dynamically evaluate the vehicle workload by sensing the states of a vehicle team and a collection point in real time, identify transferable tasks and appropriate receiving vehicles and calculate the task transfer cost when the load imbalance condition is found and processed, and can realize the regional scheduling of garbage transport vehicles. A reasonable task transfer scheme can be determined; therefore, the problem caused by disconnection of the static plan and the actual situation is avoided, and the efficiency and quality of garbage collection operation are improved.

According to one embodiment, a controller of the memory system manages a plurality of zones using first information indicating (i) a correspondence between the zones and storage areas of a nonvolatile memory and (ii) a status of each of the zones. The status includes a first status indicating that data is written over an entire logical address range corresponding to a zone and a second status indicating that a zone is reset. In response to receiving a first command from a host device, the controller transmits to the host device a first list including information indicating a zone which is to be garbage collected. The zone is determined based on the first information.

The invention relates to the technical field of garbage treatment, in particular to a smart city-oriented garbage classification and recognition system, which comprises an image acquisition and restoration module, a multi-modal feature fusion module, a dynamic classification decision module and a classification result output module, wherein the image acquisition and restoration module is used for acquiring and restoring an image of a garbage throwing point and outputting a restored three-dimensional image; the multi-modal feature fusion module is used for fusing the extracted features into multi-modal fusion features through a space-time alignment algorithm; the dynamic classification decision module is used for classifying the parallel double-branch convolutional neural network integrated with the attention mechanism; and the classification result output module is used for triggering a control signal of the garbage recycling equipment. According to the intelligent urban garbage classification system, through collaborative design of multi-modal feature fusion and a parallel classification structure, accurate recognition of garbage materials and purposes in a complex environment is achieved, the recycling equipment can be automatically linked, and the overall intelligent level of the intelligent urban garbage classification system is improved.

The invention discloses an unmanned cleaning ship for salvaging garbage and a control method of the unmanned cleaning ship. The unmanned cleaning ship comprises a ship body, a garbage collecting device, a multi-mode sensing system, an intelligent control system and a water quality purifying device. The multi-mode sensing system senses the surrounding environment and transmits comprehensive environment information to the intelligent control system. The intelligent control system dynamically plans a navigation path according to the water surface garbage position, the obstacle data, the real-time ship body position, the historical cleaning efficiency and the energy storage state; according to the garbage type identification result, the distribution density and the storage cabin capacity state, the working state of the garbage collection device is adjusted in a self-adaptive mode; controlling the working state of the water purification device according to the water quality parameters, the flow velocity and the water temperature data. By integrating the multifunctional module and the intelligent control system, comprehensive perception, intelligent decision making and multifunctional treatment of the water area environment are achieved, the water area cleaning efficiency and quality are improved, and an innovative solution is provided for sustainable treatment of the water area environment.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

The invention provides a memory management method and a memory controller, which are applied to a storage device configured with a memory module, the memory module is provided with a plurality of chips, each chip is provided with a plurality of planes, and each plane is provided with a plurality of entity blocks. The method comprises the following steps: acquiring a chip enabling number of a memory module; selecting a target allocation method from a plurality of allocation methods according to the chip enabled number, the plurality of allocation methods including a first allocation method based on a plurality of chips and a second allocation method based on a plurality of planes; and dividing the plurality of entity blocks into a plurality of super blocks based on a target allocation method. Thus, the allocation strategy of the super blocks is optimized through the target allocation method, the utilization rate of the entity blocks in the memory module is improved, and meanwhile the garbage collection efficiency is improved.

The invention relates to the technical field of data storage and management, and discloses a self-adaptive storage capacity adjusting method and system for an industrial-grade solid state disk. The method and the system can intelligently analyze and predict future storage requirements by collecting key performance indexes and user data access modes of the solid state disk in real time, remarkably improve the efficiency of storage management, and can automatically identify behavior modes of storage use and formulate corresponding storage strategies through a machine learning algorithm, thereby improving the efficiency of storage management. According to the self-adaptive method, hot data is ensured to be quickly accessed, cold data is reasonably migrated, so that the utilization rate of storage space is optimized, in addition, the storage performance is further improved and the risk of data loss or damage is reduced by adopting a garbage collection algorithm and a TRIM command, and the self-adaptive method not only improves the response speed and the reliability of storage equipment, but also reduces the maintenance cost, and is suitable for popularization and application. And a more efficient and flexible storage solution is provided for enterprises.

The invention discloses an urban garbage collection and transportation scheduling method and system based on path optimization, and relates to the technical field of urban garbage collection and transportation and intelligent scheduling optimization, and the method comprises the steps: collecting multi-source original data, carrying out the standardization and time-space registration, and generating the structured observation data of vehicles, roads and collection and transportation points; constructing a dynamic garbage quantity prediction model according to the structured observation data, and predicting garbage increment and liquid level trend of each collection and transportation point; generating a task package and establishing a mapping relation based on a dynamic garbage quantity prediction model result in combination with road passage, vehicle load and time window constraints; and constructing a multi-target path optimization model on the basis of the mapping relation and the constraint, outputting an optimal driving path of the vehicle, and converting a path optimization result into a scheduling instruction. According to the method, the task package is generated on the basis of the dynamic garbage quantity prediction result in combination with road traffic, vehicle load and time window constraints, hierarchical matching of task targets and vehicle resources is achieved, and therefore the reasonability of task allocation and operation feasibility are improved.

The invention relates to a garbage collection operation method and device, computer equipment, a computer readable storage medium and a computer program product, and can be applied to the technical field of electronic equipment. The method comprises the steps that under the condition that it is detected that garbage collection operation needs to be conducted on a storage unit, an interrupt signal of a control unit is sent to a processing unit, and occupation of the storage unit is stopped; the processing unit is used for responding to the interrupt signal, acquiring the access authority of the storage unit, performing preset operation on the storage unit, and sending a control signal to the control unit after the preset operation is completed; the garbage recycling operation comprises multiple garbage recycling sub-operations; performing garbage collection operation on the storage unit in response to the control signal; and after the garbage collection sub-operation is completed once, skipping to the step of sending the interrupt signal of the control unit to the processing unit, and stopping the step of occupying the storage unit until the garbage collection operation is completed. By adopting the method, the real-time performance of the processing unit can be improved.

A sub-block-based storage device includes a memory device configured to include a plurality of memory blocks, a work memory storing instructions, and a memory controller communicatively coupled with the memory device and the work memory and configured to manage the plurality of memory blocks. Each block of the plurality of memory blocks includes a plurality of sub-blocks having different capacities. The memory controller is configured to execute the instructions to manage used sub-blocks which store valid data from among the plurality of sub-blocks, manage free sub-blocks which are empty from among the plurality of sub-blocks, select a garbage collection source block from the used sub-blocks, select candidate destination blocks by comparing a size of valid data stored in the garbage collection source block and each of sizes of the free sub-blocks, and select a garbage collection destination block from the candidate destination blocks.

The invention provides a garbage collection method and device for a storage device, a medium and computer equipment. The garbage collection method comprises the steps that a write-in command issued by a host and a GC operation command triggered by a system are cached through a cache actuator; the GC operation command is evaluated through a dynamic priority scoring model according to the invalid data proportion and the block wear proportion, the number of high-priority GC tasks can be adjusted through a dynamic adjustment coefficient of the dynamic priority scoring model, and bandwidth occupation of the GC operation command is restrained in a high-load scene. And the maximum bandwidth occupation of the GC operation command is kept in a low-load scene. The real-time bandwidth load of the I / O channel is monitored and processed, the execution number and the bandwidth occupancy rate of the high-priority GC tasks are cooperatively adjusted, the processing number of the high-priority tasks is considered, and the high load occupied by the resources of the GC tasks is effectively limited.

Embodiments of the present disclosure relate to a method, device and computer readable storage medium for data collection. The method includes: determining, based on a flag associated with at least some nodes in a tree representation in the backup system, whether a node in the tree representation is associated with a valid backup or an invalid backup; in response to determining that the node is associated with a valid backup, keeping the node and nodes referred to by the node; and in response to determining that the node is associated with an invalid backup, deleting the node.

The invention provides a memory management method, a memory controller and an effective data positioning circuit unit. The method comprises the following steps: determining a plurality of candidate virtual blocks according to respective valid data count values of a plurality of virtual blocks; obtaining a mapping table bitmap corresponding to each candidate virtual block, determining a plurality of target virtual blocks based on the mapping table bitmaps, and generating a corresponding integrated mapping table bitmap; obtaining one or more sub-mapping tables according to the integrated mapping table bitmap; and generating an effective data table according to the physical address in the sub-mapping table and the physical address contained in the target virtual block. According to the method, the candidate objects for garbage collection are subjected to secondary screening in a hardware acceleration mode to determine the optimal target combination, and the mapping relation of the candidate objects is integrated to obtain the physical address of the corresponding effective data, so that the effective data table is made to improve the efficiency of garbage collection operation, and the reading burden of a storage device is reduced.

The invention provides a wireless weighing transmission garbage can and a data transmission method, and relates to the technical field of weighing garbage cans, the garbage can comprises a weighing device, a data acquisition device wirelessly connected with the weighing device and mounted on a vehicle, and a cloud management platform for acquiring information of the data acquisition device; the weighing device comprises a garbage can body, a weighing plate, a bottom plate, a weighing control module and a weighing sensor, wherein the weighing plate and the bottom plate are sequentially installed at the bottom of the garbage can body, the weighing control module is installed on the weighing plate, and the weighing sensor is embedded into the weighing control module. The data acquisition equipment comprises a data acquisition control module for acquiring information of the weighing device, and a display for displaying the number and the position of the garbage can and the garbage weight; through a cloud management platform, a collection and transportation unit can accurately obtain the garbage weight of a garbage can at a collection and transportation point, garbage collection and transportation management is quantified, data can be temporarily stored by using a memory U5 in data acquisition equipment, it is ensured that the data is not lost when communication is interrupted, and the integrity of the data is improved.

Provided are a storage device, system, and method for performance enhancing measures for storage in which high-performance volumes reside. Indication is made of a volume configured in the arrays to have high-performance. An array is determined storing the indicated volume. A determination is made of storage devices in which the determined array resides. The storage devices are enabled to perform garbage collection on blocks of data having valid and invalid pages in the storage devices at a first garbage collection rate and a second garbage collection rate. The second garbage collection rate causes a storage device to perform garbage collection with respect to a greater number of blocks than the first garbage collection rate. A command is sent to the determined storage devices to garbage collect at the second garbage collection rate.

The utility model relates to the technical field of garbage collection, in particular to a self-loading and unloading garbage truck which comprises a mounting plate, a clamping plate is fixedly mounted on the mounting plate, a mounting groove is formed in the clamping plate, an electric push rod is fixedly mounted on the inner wall of the mounting groove, and a connecting plate is fixedly mounted at the output end of the electric push rod. A connecting column is fixedly installed on the connecting plate, and a rotating rod is rotationally installed on the connecting column. The driving gear and the driven gear are driven to rotate through the electric push rod, the connecting column, the rotating rod and the like, when the driving gear and the driven gear rotate, the two grippers rotate oppositely, then the garbage can is clamped, and after the garbage can is clamped by the grippers, garbage in the garbage can can be poured into the garbage truck in cooperation with a dumping device of the garbage truck. Manual carrying is replaced by clamping the garbage cans through the grabhooks, time and labor are saved, the situation that the garbage cans roll over due to the fact that the garbage cans are too heavy is avoided, and the dumping efficiency of the garbage cans is improved.

Embodiments of the present disclosure relate to a memory system, a memory controller, and a method for operating the same. Garbage collection is performed with regard to the memory device on the basis of a first amount of time and a second amount of time, the first amount of time being a period of time between triggering of first garbage collection and triggering of second garbage collection, and the second amount of time being an amount of time necessary to perform the second garbage collection. A ratio of the first amount of time to the second amount of time is determined as a target ratio value, and the second amount of time is determined to be equal to or longer than a minimum garbage collection operation time. Accordingly, efficient garbage collection can be performed, and the optimal time to perform garbage collection can be determined with regard to a configured performance drop value.

The embodiment of the invention provides a memory system, a memory controller, a garbage collection method and a storage medium. The method comprises the following steps: acquiring a first bitmap corresponding to a first source data block to an Nth bitmap corresponding to an Nth source data block; n is an integer greater than or equal to 2; obtaining a combined bitmap based on the first bitmap to the Nth bitmap; reading a page table item table according to the combined bitmap; and writing the effective data corresponding to the first source data block to the Nth source data block in the page table entry table into the target data block. According to the garbage collection method, garbage collection operation can be performed on a plurality of source data blocks. And merging the bitmaps corresponding to the plurality of source data blocks to obtain a merged bitmap. And the corresponding page table item table is read through the merged bitmap, so that response delay caused by repeatedly reading the page table item table among the source data blocks is avoided, and the processing efficiency of the whole garbage collection process is improved.

A method for garbage collection includes obtaining a request to perform garbage collection on a target table. The target table includes a plurality of pages. The method includes determining, based on the request, a garbage collection transaction identifier (ID) specifying a global minimum transaction ID for garbage collection. For each respective page of a first set of pages of the plurality of pages, the method includes retrieving, from a page transaction ID table, a respective page minimum transaction ID corresponding to the respective page. The page transaction ID table is different from the target table. The method also includes determining that the respective page minimum transaction ID is greater than the global minimum transaction ID and, based on determining that the respective page minimum transaction ID is greater than the global minimum transaction ID, skipping garbage collection of the respective page without accessing the respective page.

The invention discloses an SSD B + tree indexing method and system based on wear leveling, and relates to the technical field of database indexing structure optimizing.The method comprises the steps that B + tree logic nodes and SSD physical addresses are decoupled, and a dynamic node mapping table is introduced; replacing local updating with additional updating, and writing the new version of the node into a new position of the SSD; when a write-in address is allocated to the node, an allocation strategy considering a block wear state is adopted, and write operation is guided to an area with relatively light wear; during garbage collection, high-wear blocks are preferentially treated to integrate wear. According to the method, the problems of writing hot spots and unbalanced abrasion of the B + tree on the SSD are effectively solved on the database software level, the service life of the SSD can be remarkably prolonged while the high performance of the B + tree is kept, and the method has very high universality and practical value.

The invention provides a method for optimizing garbage collection efficiency, a storage device and electronic equipment. The method comprises the steps of monitoring whether a first recovery triggering condition is met or not in response to a data writing request of a host; executing advanced garbage collection at a first rate in response to meeting the first trigger condition; monitoring whether a second triggering condition is met; in response to a second trigger condition being satisfied, advanced garbage collection is performed at a second rate, where the second rate is greater than the first rate. According to the method disclosed by the invention, the GC process in advance can be entered to sort the data and release the blocks in advance according to the remaining number of the empty blocks, and the one-time programming data volume of the GC process can be changed according to the remaining number of the empty blocks, so that the partial writing speed cannot be reduced too low after the GC is started.