Unlock instant, AI-driven research and patent intelligence for your innovation.

Convert data stream to array

An array and data storage technology, which is applied in the field of data processing, can solve problems such as the size limitation of the allocation array, and achieve the effect of multi-flexibility

Active Publication Date: 2021-07-20
HUAWEI TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Additionally, distributing the array in a flat, contiguous manner imposes a practical limit on the size of the distributing array

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Convert data stream to array
  • Convert data stream to array
  • Convert data stream to array

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] figure 1 A data storage device 10 comprising a memory module 100 and a memory management module 110 is shown. The memory management module 110 is configured to: allocate the storage space of the memory module 100 to a storage block; and allocate the storage block to an array, wherein the array includes at least one array element. The memory management module 110 is used to: in the first step, allocate the storage block k to the array to store array elements; when the storage space of the storage block k is full, in the second step, allocate the storage block k +1 for assigning the array to store array elements. The memory management module 110 is configured to reserve the array elements allocated in the first step in storage block k when the additional array elements allocated in the second step are stored in storage block k+1 , where the size of memory block k+1 is twice the size of memory block k.

[0078] figure 2 The use of physical storage space 200 in memory ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A data storage device (10) is provided, including a memory module (100) and a memory management module (110). The memory management module (110) is configured to: allocate the storage space (200) of the memory module (100) to a storage block (210); allocate the storage block to an array (220), wherein the array (220) includes at least one array element (230). The memory management module (110) is used for: assigning storage block k to the array in the first step to store array elements; when the storage space of the storage block k is full, storing Block k+1 is allocated to the array to store array elements. The memory management module (110) is configured to keep the array elements allocated in the first step in storage when the additional array elements allocated in the second step are stored in memory block k+1 In block k, the size of storage block k+1 is twice the size of storage block k.

Description

technical field [0001] The present invention relates to the field of data processing. In particular, the present invention relates to a data storage device and a method for managing data in the data storage device. Background technique [0002] Online stream processing is a part of big data processing. In general, it should interoperate with batch data parallel processing (chunked processing of streams). The stream should be converted to an array-like data structure (blocks) before batching. [0003] In many cases, the block size is not known in advance. This means that the array should be "appendable", i.e., should be able to grow very quickly, in other words, expand dynamically. [0004] In parallel data processing scenarios, arrays can be accessed in different ways: [0005] (a) Periodic access, which has to do with scalar reduction, array mapping, filtering, etc. [0006] (b) Occasional access in many scenarios, such as subarray slicing, permutation, other index ac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F12/02
CPCG06F12/023G06F2212/1024G06F2212/1044
Inventor 亚历山大·弗拉基米罗维奇·斯莱萨连科维克多·弗拉基米罗维奇·斯米尔诺夫张洪波
Owner HUAWEI TECH CO LTD