126 results about "Data placement" patented technology

The present invention discloses an artificial intelligence-based adaptive big data storage and retrieval optimization system and method designed to intelligently manage and optimize large-scale distributed data environments. The system integrates data acquisition, distributed storage, metadata processing, adaptive learning, and retrieval optimization units configured to work collaboratively for continuous self-optimization. The invention employs deep reinforcement learning and predictive neural network techniques to dynamically analyze system telemetry, workload behavior, and data access patterns in real time, enabling proactive adjustment of data placement, caching, replication, and compression parameters across distributed nodes. The metadata processing framework utilizes graph-based dependency modeling to maintain semantic and contextual relationships among datasets, facilitating intelligent and context-aware data retrieval. The retrieval optimization unit interprets user queries semantically and computes the optimal retrieval route using latency prediction models and dynamic routing techniques.

This disclosure provides techniques for managing memory which match per-data metrics to those of other data or to memory destination. In one embodiment, wear data is tracked for at least one tier of nonvolatile memory (e.g., flash memory) and a measure of data persistence (e.g., age, write frequency, etc.) is generated or tracked for each data item. Memory wear management based on these individually-generated or tracked metrics is enhanced by storing or migrating data in a manner where persistent data is stored in relatively worn memory locations (e.g., relatively more-worn flash memory) while temporary data is stored in memory that is less worn or is less susceptible to wear. Other data placement or migration techniques are also disclosed.

The invention provides a storage device, an electronic device, a data storage method and a storage medium, and relates to the technical field of data processing, the storage device comprises a CXL interface module, a dynamic memory module, a flash memory module and a flash memory controller module; wherein the dynamic memory module comprises a plurality of device side periodic regions, the flash memory module comprises a plurality of data placement units, and the device side periodic regions are in one-to-one correspondence with the data placement units; the CXL interface module is used for receiving host data from the host side periodic region and temporarily storing the host data in the equipment side periodic region corresponding to the host side periodic region in the dynamic memory module; the dynamic memory module is used for packaging the host data in the equipment side periodic region after preset time; and the flash memory controller module is used for storing the encapsulated host data into a data placement unit corresponding to the equipment side periodic region in the flash memory module. The storage device effectively improves the write amplification phenomenon.

A memory sub-system having a first memory configured as a non-volatile storage medium of the memory sub-system; and a second memory having an access speed faster than the first memory. A processing device of the memory sub-system is configured to: run a plurality of data placement handlers concurrently; allocate a plurality of data buffers from the second memory to the plurality of data placement handlers respectively; reserve a plurality of backup spaces from the first memory for the plurality of data placement handlers respectively; allocate accumulation buffers from the second memory; and arrange the data placement handlers to time share the accumulation buffers via usages of the backup spaces.

A ship docking assistance device includes a position azimuth information acquisition unit; a LIDAR; a map generation updating unit; a high-point acquisition unit; and a position azimuth estimation unit. The LIDAR acquires point-group data three-dimensionally indicating the environment around a ship. The map generation updating unit generates a map around the ship based on the point-group data. The high-point acquisition unit acquires, from within the point-group data, a high point having a prescribed height or more. The position azimuth estimation unit estimates the position and the azimuth of the ship through matching between the position of the high point acquired by the high-point acquisition unit and the position of the high point in the map. The map generation updating unit updates the map by placing the point-group data in the map using, as references, the position and the azimuth of the ship estimated by the position azimuth estimation unit.

The invention discloses a data processing method and device, electronic equipment and a readable storage medium, and relates to the technical field of data read-write.The method comprises the steps that after target data is determined, the data type and the operation frequency of the target data are obtained; determining a target data block according to the data type and the operation frequency, and distributing the target data block to a corresponding performance area in the target hard disk in advance according to the access frequency of the target data block; the data processing operation is executed based on the target data and the target data block, so that the problem that a write amplification effect exists in the data processing process can be solved, the data processing is executed based on the performance advantages of the target data block, the frequently written data is placed in an area with a smaller write amplification effect, and the data processing efficiency is improved. Therefore, the technical effects of reducing the write amplification effect based on flexible placement of the data, improving the data processing efficiency and prolonging the service life of the SSD are achieved.

In some embodiments, a method for die-level monitoring is provided. The method includes distributing user data throughout a plurality of storage nodes through erasure coding, wherein the plurality of storage nodes are housed within a chassis that couples the storage nodes. Each of the storage nodes has a non-volatile solid-state storage with non-volatile memory and the user data is accessible via the erasure coding from a remainder of the storage nodes in event of two of the storage nodes being unreachable. The method includes producing diagnostic information that diagnoses the non-volatile memory on a basis of per package, per die, per plane, per block, or per page, the producing performed by each of the plurality of storage nodes. The method includes writing the diagnostic information to a memory in the storage cluster.

Provided are systems, methods, and apparatuses for assisted cache data placement. In one or more examples, systems, methods, and apparatuses include assigning a first identifier to first data based on an aspect of the first data, the first data being data moved from a cache and assigning a second identifier to second data based on an aspect of the second data, the second data being moved to a storage device based on a policy of the cache. In one or more examples, systems, methods, and apparatuses include storing the first data in a first storage location of the storage device based on the first identifier and storing the second data in a second storage location of the storage device based on the second identifier.

To provide a medical work support system capable of detecting the abnormality of the position of a subject by a simple operation with a low load.SOLUTION: A medical work support system comprising: an image data acquisition unit that acquires image data captured in a state where a subject is placed on a bed; a placement region acquisition unit that acquires a placement region for placing the subject from the image data; a subject position data calculation unit that calculates position data of the subject from the image data; and an abnormality determination unit that determines an abnormality of a position of the subject based on the placement region acquired by the placement region acquisition unit and the position data of the subject.SELECTED DRAWING: Figure 1

The invention relates to managing data placement in a memory subsystem. A system includes a memory device and a memory subsystem controller operably coupled with the memory device, the memory subsystem controller to perform operations including: receiving a memory access command having one or more associated parameters from a host system; determining, using a hardware component of the memory subsystem controller, whether the one or more associated parameters conform to a current flexible data placement (FDP) configuration of the system; and in response to determining that the one or more associated parameters conform to the current FDP configuration of the system, executing the memory access command on an identified segment of the memory device.

This paper proposes a data layout method for a cloud-edge-device collaborative environment, and studies and designs a data placement strategy tailored to the characteristics of the cloud-edge-device environment and application requirements. The overall approach of the present invention is to analyze the node, network, and data characteristics of the cloud-edge-device environment, extract and calculate the key factors affecting data distribution, and construct a node-data model for subsequent analysis and use; establish an overall optimization objective with constraints to provide mathematical tools for data layout tasks; based on the node-data model, achieve rapid initial data layout, reduce the overhead of large-scale optimization calculations, and alleviate the storage pressure on nodes connected to the terminals collecting data; and perform data rearrangement and layout optimization based on the actual user needs.

Systems and methods are described herein for select content for bid-processing and content placement online placement resources. A computer in an RTB bidding process transmits the selected content to an identified online resource that satisfies the various (and often competing) goal objective thresholds and budget thresholds. The computer transmits the content to the identified online resource, which forwards or transmits the campaign content for display at a user interface of an end-user. The computer analyzes historical data to evaluate the performance of content campaigns against multiple user-selected performance goals and priorities to determine whether to bid for content placement at a given online resource. The computer may generate a blocklist to reject placements at underperforming online resources. The computer may perform optimization functions to determine optimal bid prices that balance the goal objective thresholds and budget threshold and determine whether to bid for the placement.

Methods and systems for providing computer implemented services are disclosed. To provide the services, control variables may be obtained and used to manage operation of the distributed system. The operation may be proactively managed by enforcing data placement standards throughout the system based, at least in part, on the control variables. The enforcement may be performed by identifying preferred placement locations based on the control variables, policies, and / or other factors.

The application provides a long-chain error correction code encoding and decoding method, a system and a readable storage medium, and the method comprises the following steps: S1, minimizing single error cross-cabinet recovery cost through quantization, selecting a suitable data grouping strategy and data placement strategy, and determining encoding parameters; S2, sequentially encoding each dimension of three-dimensional encoding; S3, recovering data by using a decoding algorithm, preferentially using low-dimensional encoding for check recovery, and calling high-dimensional encoding for check recovery of each dimension when recovery fails. The application makes a quantitative analysis on the single error cross-cabinet recovery cost, places the cabinet level strip based on the analysis result, so that the strip crosses fewer cabinets; meanwhile, in the decoding stage of the long-chain error correction code, low-dimensional encoding is preferentially used for check recovery, high-dimensional encoding is called when recovery fails, the network topology is fully considered, the cross-cabinet recovery cost is reduced as much as possible, and then the recovery performance is improved.

A device may include a first memory media, a second memory media, and at least one control circuit configured to receive placement information for data, store, in a portion of the first memory media, based on the placement information, the data, and store, in a portion of the second memory media, based on the placement information, the data. The at least one control circuit may be configured to receive a request to access, from the portion of the first memory media, the data, and access, based on the request, from the portion of the second memory media, the data. The at least one control circuit may be configured to modify, based on an allocation status, the portion of the first memory media to an available state.

A system can present computer storage resources as a consumer storage system, which abstracts resources as chunks in a chunkmanager, which abstracts resources in an uberstore, wherein the uberstore abstracts drives that implement a flexible data placement capability, and wherein the flexible data placement capability facilitates an effect of garbage collection that comprises deallocating data ranges that correspond to reclaim units that comprise groups of blocks. The system can, based on receiving a request to write to the consumer storage system, convert the request to the chunk manager and to the uberstore, and write data to the storage drives, comprising writing to groups of consecutive ubers of the uberstore to a same group of storage drives of the storage drives, via respective reclaim unit handles that correspond to the respective storage drives. The system can garbage collect chunks according to a chunk order and starting at an uber group boundary.

A method and apparatus for placing data in a hierarchical memory are disclosed. A computing device comprising a hierarchical memory composed of a first memory and a second memory, wherein the first memory has a faster access speed than the second memory but has a limited capacity, and the second memory has a slower access speed than the first memory but provides a larger capacity, and a method for placing a packet received through a network into the hierarchical memory comprises: a step of extracting layout information from the payload of the packet; a step of storing the layout information in a queue corresponding to the socket in which the packet was received; a step of determining a destination memory among the first memory or the second memory based on the size of a data field included in the layout information stored in the queue; a step of allocating a space corresponding to the size of the data field to the determined destination memory using a memory allocator; and a step of reading data from the socket in which the packet was received and storing it in the allocated space.

This invention provides a storage system and data placement method that can improve the performance of a storage system by efficiently operating multiple backend drives. [Solution] The storage system is constructed by having multiple storage nodes, each of which includes a storage control unit and is allocated multiple drives. The storage control unit reads and writes data to physical chunks in response to I / O requests from the host device. A drive has multiple physical chunks that are divided to store data. The storage control unit monitors the drive utilization rate for each of the multiple drives and, based on the drive utilization rates of the multiple drives, performs data relocation, moving data located in the physical chunks of the source drive to the physical chunks of the destination drive in order to equalize the drive utilization rates of the multiple drives.

A storage device may carve out redundant array of independent disks (RAID) and reduce write amplification when writing data to the RAID. The storage device includes multiple flexible data placement drives that are configured to execute RAID techniques. A controller on the storage device may receive data from a host. The controller obtains reclaim unit handles from the data to determine locations where the data is to be stored on the flexible data placement drives. During storage, the controller stripes the data in parallel across reclaim units within different reclaim groups and endurance groups across a single flexible data placement drive or multiple flexible data placement drives. The storage device leverages the write amplification of the flexible data placement drives to reduce a write amplification factor on the RAID.

The data management device (1) includes a standard data collection unit (14) that collects standard data, which has been set in advance as data that can be acquired as an analysis item for data analysis, from the production equipment (5) or an operation terminal (6) associated with the production equipment (5), a non-standard data collection unit (11) that collects non-standard data, which is data that includes data related to the production equipment (5) and is not the standard data, from the production equipment (5) or the operation terminal (6), and a data placement unit that stores the non-standard data and standard data as management items associated with the non-standard data in a data storage device.

The application provides an automatic tracing pricing execution method, device and server, relates to the technical field of computer application, and can obtain a tracing account range, then pull the pricing result data of the previous day of a tracing day back to a pricing result table for tracing, and place the position data of the tracing day in a preset position data table, so that after starting a pricing task engine, the tracing times of each FTP account within the tracing date range can be calculated according to the preset tracing date range and the tracing account range; and the tracing pricing task corresponding to each tracing time is sequentially submitted to the preset pricing engine for tracing pricing calculation through the pricing task engine. The whole tracing pricing process can realize process control, so that the risk and cost of tracing can be greatly reduced, and the efficiency of tracing is improved.

A data storage system includes a memory device and a controller. The memory device includes a set of planes and a wordline including a set of pages. The controller includes a first and second minimum write cache control buffer (mWCCBs), processor(s), and a memory. The memory includes instructions, that when executed the processor(s), cause the processor(s) to: determine that an amount of outstanding data of a data stream is not sufficient to occupy the set of planes; store a first portion of the outstanding data in the first mWCCB; release the first portion to the memory device; in coordination with the release of the first portion of the outstanding data, store a second portion of the outstanding data in the second mWCCB; release the second portion to the memory device; and write the first and second portions of the outstanding data to a subset of the set of pages.

A memory sub-system controller performs garbage collection on flexible data placement (FDP) compliant memory sub-systems, such as solid state drives (SSDs). The controller stores a set of data across a plurality of memory components of a set of memory components, a first of the plurality of components being configured to store data in a first set of regions using a first write cursor, and a second of the plurality of components being configured to store data in a second set of regions using a second write cursor. The controller programs data, received from a host system, in a first portion of the first set of regions using the first write cursor. The controller relocates previously programmed data from a second portion of the first set of regions to the first portion of the first set of regions using the first write cursor.

The present disclosure a method for data regulations-aware cloud storage and processing service allocation. Conventional approaches fail to address the technical problem of data placement for storage as well as processing, considering multiple criteria. Further, the conventional approaches fail to address compliance with data regulations, tier pricing policy for multiple Cloud Service Providers (CSPs) which impacts storage and processing center selection and constraint satisfaction. The present disclosure proposes a joint optimization model for the selection of storage and processing services from multiple cloud service providers, taking into practical consideration of data regulations and tiered pricing, which has not been addressed in the prior art. To solve this hard multi-objective combinatorial optimization problem, the present disclosure utilizes a cost-reduction-based algorithm for obtaining optimal solution.

Techniques can include: receiving writes from applications executing on hosts; recording, the writes in entries in a log; and flushing, from the log, the entries denoting the write operations, including: segregating content written by the write operations into streams, wherein each of the streams corresponds to one of a plurality of classes or types of data associated with one of a plurality of I / O profiles characterizing said each stream and said one class or type of data; and for each of the streams corresponding to one class or type of data associated with one I / O profile, persistently storing a corresponding portion of the content in one of a plurality of sub log structured systems (LSSs) used for only storing data of the one class or type that corresponds to said each stream.

A data storage system includes a memory device and a controller. The memory device includes a set of planes and a wordline including a set of pages. The controller includes a first and second minimum write cache control buffer (mWCCBs), processor(s), and a memory. The memory includes instructions, that when executed the processor(s), cause the processor(s) to: determine that an amount of outstanding data of a data stream is not sufficient to occupy the set of planes; store a first portion of the outstanding data in the first mWCCB; release the first portion to the memory device; in coordination with the release of the first portion of the outstanding data, store a second portion of the outstanding data in the second mWCCB; release the second portion to the memory device; and write the first and second portions of the outstanding data to a subset of the set of pages.

Embodiments of the present disclosure provide a data processing method, a data processing system, a data processing apparatus, a computing device, a computer readable storage medium, and a computer program product. The data processing method comprises: acquiring operation information of a storage service, and determining at least one storage component type corresponding to the storage service, wherein the storage service has a storage component corresponding to the storage service; on the basis of the operation information, collecting statistics about access information corresponding to the at least one storage component type, and on the basis of the access information, generating analysis data corresponding to the storage component; and according to a preset data processing strategy, and on the basis of the analysis data, performing data migration on storage data in the storage component, so as to obtain a migrated storage component. The present disclosure achieves the objective of better performing data placement according to the data popularity, improves the storage service performance, and reduces the storage cost, and can also provide a better storage service for a user.

A host may not have a large enough internal non-volatile memory to store generated data, such as video. In such situations, the host can store the data in an external data storage device, such as an external solid-state drive (SSD). However, if the storage rate of the external data storage device drops below the rate at which the host is generating and sending the data to the external data storage device, data loss can occur.To help avoid this situation, when a low storage rate is detected, the host can route a portion of data generated by the host to a non-volatile memory in the host for temporary storage and later transfer that data to the external data storage device when the storage rate increases.