Object storage space data processing method and device, equipment and storage medium

Abstract

The invention provides an object storage space data processing method and device, equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: acquiring business range data and a business proportion, and creating an object storage pool; determining a plurality of data scale level parameters; determining a plurality of storage logic unit groups; determining a plurality of space waste rate data according to the plurality of storage logic unit groups and a preset logic unit space length increment; creating a storage space resource pool in the object storage pool; and dividing the storage space resource pool into a plurality of object storage spaces according to each data scale level parameter and the space waste rate data, and linking each object storage space to a preset business range data source. According to the application, the problem of overhead increase can be avoided while the write-in performance can be improved in some low-cost monitoring service application scenarios.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a method, apparatus, device and storage medium for processing object storage space data. Background Art

[0002] In real-time road monitoring, the images of passing vehicles captured by traffic checkpoints are uploaded in real time for analysis by relevant staff. The data of this type of business can generally be stored in object storage.

[0003] At present, in the existing technology, in order to prevent the write performance from dropping after a certain period of time, some common optimization measures have been added to the original design of object storage, such as adding certain metadata designs, integrating small objects, splitting large objects, and optimizing various storage engines to make the data stable.

[0004] However, the inventors have found that the prior art has at least the following technical problems: adding certain metadata will increase random reads and overhead, thereby causing the problem of being unsuitable for low-cost monitoring business application scenarios. Summary of the invention

[0005] The present application provides an object storage space data processing method, device, equipment and storage medium, which can improve the writing performance in some low-cost monitoring business application scenarios while avoiding the problem of increased overhead.

[0006] In a first aspect, the present application provides an object storage space data processing method, comprising:

[0007] Obtain business scope data and business proportions, and create an object storage pool;

[0008] Determining multiple data scale level parameters according to the business scope data and the business ratio;

[0009] Determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter;

[0010] Determine a plurality of space waste rate data according to a plurality of storage logical unit groups and a preset logical unit space length increment, wherein each of the space waste rate data corresponds to a data scale level;

[0011] Creating a storage space resource pool in the object storage pool;

[0012] According to each data scale level parameter and the space waste rate data, the storage space resource pool is divided into a plurality of object storage spaces, and each object storage space is linked to a preset business scope data source.

[0013] In a possible implementation, the business scope data includes multiple business object scope data divided by segments, and the business ratio includes the proportion of multiple business object scope data; accordingly, based on the business scope data and the business ratio, multiple data scale level parameters are determined, including: based on the proportion of the multiple business object scope data, multiple data scale level numbers are determined, wherein each data scale level number corresponds to one business object scope data; based on each business object scope data and the corresponding data scale level number, multiple data scale level parameters of the business object scope data are determined, wherein the data volume between every two adjacent data scale level parameters increases by an increment in a preset range increment correspondence relationship.

[0014] In a possible implementation, the determining of multiple space waste rate data based on multiple storage logical unit groups and preset logical unit space length increments includes: determining, based on a storage logical unit group among the multiple storage logical unit groups, a first logical space length of the storage logical unit group and a second logical space length of a previous storage logical unit group; and determining, based on the first logical space length, the second logical space length and the preset logical unit space length increment, space waste rate data corresponding to the storage logical unit group.

[0015] In a possible implementation, the space waste rate data corresponding to the storage logical unit group is determined according to the first logical space length, the second logical space length and the preset logical unit space length increment, and the calculation formula is:

[0016]

[0017] In the formula, w n is the space waste rate data corresponding to the nth storage logical unit group among the multiple storage logical unit groups, where n is a natural number greater than 0, and s n is the second logical space length of the nth storage logical unit group, s n-1 is the first logical space length of the n-1th storage logical unit group, and b is the preset logical unit space length increment.

[0018] In a possible implementation, creating a storage space resource pool in the object storage pool includes: obtaining free storage logical unit groups corresponding to all different scale level parameters in the object storage pool, and storing the free storage logical unit groups as a storage space resource pool.

[0019] In a possible implementation, the storage space resource pool is divided into multiple object storage spaces according to each data scale level parameter and the space waste rate data, including: according to each data scale level parameter and the space waste rate data, selecting an idle storage logical unit group from the storage space resource pool as an object storage space until the storage space resource pool is divided into multiple object storage spaces.

[0020] In a possible implementation, the method further includes: if it is determined that the business object range data meets the over-specification object condition, then in response to a preset space allocation request, allocating an over-specification object storage space in the object storage pool.

[0021] In a second aspect, the present application provides an object storage space data processing device, including:

[0022] The acquisition module is used to obtain business scope data and business proportions, and create an object storage pool;

[0023] A level determination module, which determines a plurality of data scale level parameters according to the business scope data and the business ratio;

[0024] A logical unit group determination module, used to determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter;

[0025] The logic unit group determination module is further used to determine a plurality of space waste rate data according to a plurality of storage logic unit groups and a preset logic unit space length increment, wherein each of the space waste rate data corresponds to a data scale level;

[0026] A space partitioning module, used to create a storage space resource pool in the object storage pool;

[0027] The space division module is also used to divide the storage space resource pool into multiple object storage spaces according to each data scale level parameter and the space waste rate data, and link each object storage space to a preset business scope data source.

[0028] In a third aspect, the present application provides an electronic device, including: at least one processor and a memory;

[0029] The memory stores computer-executable instructions;

[0030] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the object storage space data processing method described in the first aspect.

[0031] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the object storage space data processing method described in the first aspect is implemented.

[0032] The present application provides an object storage space data processing method, device, equipment and storage medium. First, the data scale level parameters are determined based on the acquired business scope data and business ratio, so as to divide the storage space in the created object storage pool according to the data scale level, and determine multiple storage logic unit groups for storing business objects. It also determines the space waste rate data by presetting the logical unit space length increment according to the storage logic unit combination, and uses it as a reference for dividing the storage space, so that the space waste rate of the divided storage space is as small as possible, and then creates a storage space resource pool in the object storage pool, divides this storage space resource pool into multiple object storage spaces, and links each object storage space to a preset business scope data source. Each preset business scope data source can quickly store business objects in the corresponding object storage space according to the link, reducing the time overhead of object space addressing allocation, without the need to improve hardware configuration, and is more suitable for low-cost business object storage application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0034] Figure 1 A schematic diagram of an application scenario of the object storage space data processing method provided in an embodiment of the present application;

[0035] Figure 2 A flowchart of the object storage space data processing method provided in the embodiment of the present application;

[0036] Figure 3 A schematic diagram of the object storage space architecture allocation provided in an embodiment of the present application;

[0037] Figure 4 A schematic diagram of the structure of an object storage space data processing device provided in an embodiment of the present application;

[0038] Figure 5 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0040] At present, in low-cost monitoring business application scenarios such as real-time road monitoring scenarios in smart transportation, object storage is gradually being promoted due to its good scalability and ease of use. While object storage is being promoted, some optimization measures are also added to the original design to prevent the write performance from dropping after a certain period of time. For example, adding certain metadata, that is, integrating small objects such as images less than 80kb, and splitting large objects such as images greater than 500kb and storing them in object storage space. Such modifications are effective for data stability. However, the inventors found that the addition of metadata also increases the metadata overhead, which will increase random reads, and thus greatly increase the hardware configuration requirements of the storage device, making the optimized object storage method unsuitable for low-cost monitoring business application scenarios.

[0041] To solve the above technical problems, the embodiments of the present application provide the following technical concepts for solving the problems: dividing the object storage space into different levels of size to facilitate fast writing of business objects, reducing the time overhead of object space addressing allocation, improving writing performance, and not increasing metadata overhead, making the optimized object storage suitable for low-cost monitoring business application scenarios.

[0042] Figure 1 A schematic diagram of an application scenario of the object storage space data processing method provided in an embodiment of the present application, such as Figure 1 As shown, it includes: a terminal 101, a server 102 and at least one front-end shooting device 103.

[0043] Among them, terminal 101 is used for staff to view the allocation of object storage space and input operation instructions for allocating storage space for oversized objects. Server 102 is used to receive business object range data transmitted from the cloud and other servers, and perform operations to allocate storage space. Server 102 can be a cloud server or a storage device cluster. Front-end shooting device 103 is used to take pictures as business object range data, and establish a link with the storage space of server 102 to store the taken pictures. The front-end shooting device can be a camera or a monitor.

[0044] Figure 2This is a flow chart of the object storage space data processing method provided in the embodiment of the present application. The execution subject of this embodiment can be Figure 1 The server 102 in the illustrated embodiment may also be other computer-related devices, and there is no particular limitation on this embodiment.

[0045] like Figure 2 As shown, the object storage space data processing method includes:

[0046] S201: Obtain business scope data and business proportion, and create an object storage pool.

[0047] In this embodiment, the business scope data may be at least one of picture data, video data or audio data. The business proportion may be the proportion of various data in the business scope data. The object storage pool may be a container for storing business objects.

[0048] S202: Determine multiple data scale level parameters according to the business scope data and business ratio.

[0049] In this embodiment, the data scale level parameter may be a specific level number corresponding to the business scope data, and each data scale level parameter corresponds to a storable data scale in a storage space. For example, if the business scope data is (50KB, 80KB), the corresponding data scale level parameters include level 1-56KB, level 2-64KB, level 3-72KB, and level 4-80KB. Level 1 stores business object data with a data size between 50KB and 56KB, and level 2 stores business object data with a data size between 56KB and 72KB.

[0050] Specifically, in an optional embodiment of the present application, the business scope data includes a plurality of business object scope data divided by segments, and the business proportion includes a proportion of the plurality of business object scope data. Accordingly, step S202 includes:

[0051] S202a: Determine multiple data scale level numbers according to the proportions of multiple business object scope data, wherein each data scale level number corresponds to one business object scope data.

[0052] In this embodiment, the multiple business object range data divided by segments may be multiple business object range data divided by segments according to object size. For example, the multiple business object range data divided by segments may include business object range data for (0, 128KB] segments, business object range data for (128KB, 256KB] segments, business object range data for (256KB, 512KB] segments, business object range data for (512KB, 1MB] segments, and out-of-specification business object range data for segments larger than 1MB.

[0053] In this embodiment, the proportion of multiple business object scope data can be the ratio of each business object scope data in the multiple business object scope data to all business object scope data. The number of data scale levels can represent the number of storage spaces occupied by each business object scope data. For example: the business scale corresponding to a storage device cluster is 500 camera accesses, the business scope data of the large image of the camera is (500K, 900KB), and the business scope data of the small image is (50KB, 80KB). The proportion of the small image is one-half, and the proportion of the large image is one-half, that is, the ratio between the small image and the large image is 1:1. However, it is stipulated that the object business scope data requires one small image and two large images. Correspondingly, when the number of scale data levels of the small image is 4, the number of scale data levels of the large image is 8.

[0054] S202b: Determine multiple data scale level parameters of the business object range data according to each business object range data and the corresponding number of data scale levels, wherein the data volume between every two adjacent data scale level parameters increases by an increment in a preset range increment correspondence.

[0055] In this embodiment, the preset range increment correspondence relationship can be an artificially formulated increment rule, for example: the business object range data of the (0, 128KB] segment is incremented by 8KB, the business object range data of the (128KB, 256KB] segment is incremented by 16KB, the business object range data of the (256KB, 512KB] segment is incremented by 32KB, and the business object range data of the (512KB, 1MB] segment is incremented by 64KB.

[0056] S203: Determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter.

[0057] In this embodiment, the storage logical unit group is a plurality of logical units that are continuous in the logical space, and the lengths of the storage logical unit groups corresponding to different data scale level parameters are different. For example, based on the above embodiment, according to the business scope data of the business scope data (50KB, 80KB) segment, four data scale level parameters are obtained, the length of the storage logical unit group corresponding to level 1 is 56KB, the length of the storage logical unit group corresponding to level 2 is 64KB, the length of the storage logical unit group corresponding to level 3 is 72KB, and the length of the storage logical unit group corresponding to level 4 is 80KB.

[0058] S204: Determine a plurality of space waste rate data according to a plurality of storage logical unit groups and a preset logical unit space length increment, wherein each piece of space waste rate data corresponds to a data scale level.

[0059] In this embodiment, the space waste rate data is data reflecting the space utilization rate when the storage space is divided. The smaller the space waste rate data is, the faster the speed of writing the business object data is.

[0060] Specifically, in an optional embodiment of the present application, step S204 includes:

[0061] S204a: According to a storage logical unit group among the plurality of storage logical unit groups, determine a first logical space length of the storage logical unit group and a second logical space length of a previous storage logical unit group.

[0062] In this embodiment, each storage logical unit group has a corresponding logical space length. Based on the above embodiment, for example, the logical space length of the storage logical unit group corresponding to level 2 is 56. The logical space length of the previous storage logical unit group, i.e., the storage logical unit group corresponding to level 1, is 64.

[0063] S204b: Determine space waste rate data corresponding to the storage logical unit group according to the first logical space length, the second logical space length and a preset logical unit space length increment.

[0064] In this embodiment, the preset logical unit space length increment is a specific artificially set value, such as 1 KB.

[0065] Further, in an optional embodiment of the present application, the calculation formula of step S204b is:

[0066]

[0067] In the formula, w n is the space waste rate data corresponding to the nth storage logical unit group among the multiple storage logical unit groups, where n is a natural number greater than 0, and s n is the second logical space length of the nth storage logical unit group, s n-1 is the first logical space length of the n-1th storage logical unit group, and b is the preset logical unit space length increment. For example: b is 1KB, n is 2, s1 is 56KB, s2 is 64K, and the corresponding space waste rate data of the second storage logical unit group is

[0068] S205: Create a storage space resource pool in the object storage pool.

[0069] In this embodiment, the storage space resource pool may be a container for storing business object range data.

[0070] Specifically, in an optional embodiment of the present application, step S205 includes: obtaining free storage logical unit groups corresponding to all different scale level parameters in the object storage pool, and storing the free storage logical unit groups as a storage space resource pool.

[0071] In the embodiment of the present application, the idle storage logic unit groups may be storage logic unit groups to which no data is written, and these storage logic unit groups may be allocated to corresponding front-end shooting devices to store business object data.

[0072] S206: Divide the storage space resource pool into a plurality of object storage spaces according to each data scale level parameter and space waste rate data, and link each object storage space to a preset business scope data source.

[0073] In this embodiment, the space waste rate data can be used as a reference for dividing the object storage interval. For example, when the space waste rate is greater than 0.1, it is necessary to adjust the strategy for dividing the object storage interval, such as changing the logical unit length increment described in the above embodiment from 8KB to 6KB. The preset business scope data source can be a front-end shooting device that provides business scope data. Linking each object storage space to the preset business scope data source can be achieved by establishing a file storage path.

[0074] In summary, the object storage space data processing method provided in the embodiment of the present application determines the data scale level parameters based on the acquired business scope data and business ratio, so as to divide the storage space in the created object storage pool according to the data scale level, and determine multiple storage logic unit groups for storing business objects. It also determines the space waste rate data by presetting the logical unit space length increment according to the storage logic unit combination, and uses it as a reference basis when dividing the storage space, so that the space waste rate of the divided storage space is as small as possible, and then creates a storage space resource pool in the object storage pool, divides this storage space resource pool into multiple object storage spaces, and links each object storage space to a preset business scope data source. Each preset business scope data source can quickly store business objects in the corresponding object storage space according to the link, reducing the time overhead of object space addressing allocation, without the need to improve hardware configuration, and is more suitable for low-cost business object storage application scenarios.

[0075] Based on the above embodiments, in an optional embodiment of the present application, in step S206, the storage space resource pool is divided into multiple object storage spaces according to each data scale level parameter and space waste rate data, including: according to each data scale level parameter and space waste rate data, selecting an idle storage logical unit group from the storage space resource pool as an object storage space until the storage space resource pool is divided into multiple object storage spaces.

[0076] In this embodiment, the scale type of the business objects generated by each front-end shooting device can be one or more. The space length of the storage logic unit group corresponding to different data scale level parameters also needs to be different. The space waste rate data can provide a basis for dividing the object storage space for business objects.

[0077] Exemplary: The acquired business scope data includes large pictures (500K, 900KB) and small pictures (50KB, 80KB). It means that the memory size of the pictures taken by the front-end shooting device is generally within the above two business scope data. Moreover, the ratio of large pictures to small pictures is 1:1. According to the description in the above embodiment, a mapping relationship table of scale data level parameters, storage logic unit group space length, and maximum space waste rate can be obtained, as shown in Table 1 below.

[0078]

[0079] Table 1

[0080] As shown in Table 1, when the memory size of a partial vehicle image taken by a front-end camera is 72KB and the memory size of the overall vehicle image is 576KB, the data scale level corresponding to the 72KB image is 3, and the resource waste rate is 9.7%. The data scale level corresponding to the 576KB image is 6, and the data waste rate is 10.9%.

[0081] Based on the above embodiment, the object storage space data processing method provided as an optional embodiment of the present application further includes:

[0082] Step A: If it is determined that the business object range data meets the over-specification object condition, then in response to a preset space allocation request, an over-specification object storage space is allocated in the object storage pool.

[0083] In this embodiment, the business object range data meeting the over-regulation condition indicates that the data size of the business object is greater than 1MB. In this case, it is necessary to apply for the allocation of independent storage space for such over-regulation business objects.

[0084] In summary, the object storage space data processing method provided in the embodiment of the present application also improves the write speed when storing oversized objects by separately allocating an oversized object storage space in the object storage pool for the oversized objects.

[0085] Figure 3 This is a schematic diagram of the object storage space architecture allocation provided by the embodiment of the present application. In order to better understand how to use the object storage space data processing method provided by the embodiment of the present application to divide the storage space, the embodiment of the present application also describes the architecture division of the object storage space. Figure 3As shown, the storage space architecture is used to store data on a hardware storage cluster, including: an object storage pool 301 , a storage logic unit stack 302 , a storage space resource pool 303 and multiple object storage spaces 304 .

[0086] The object storage pool 301 may be a storage pool for storing business objects, which is composed of storage spaces of each node of the hardware storage cluster.

[0087] The storage logic unit heap 302 may be a container for storing, organizing and managing business objects. The storage logic unit heap 302 has a storage space limit to determine how many objects are stored. The storage logic unit heap 302 stores a plurality of logic unit group lists for managing memory blocks of idle business objects. Each logic unit group list contains a pointer to the storage logic unit heap 302. When it is necessary to allocate memory space for a new business object, the corresponding pointer is obtained from the logic unit group list so that the idle storage space in the storage logic unit heap 302 is allocated to store the new business object. In addition, the storage logic unit heap 302 is also provided with an over-specification object storage space. When the front-end shooting device 305 takes photos of the accident scene, the business objects that need to be stored are generally larger than 1MB, and these photos are regarded as over-specification objects. At this time, it is necessary to apply to store these over-specification objects in the over-specification object storage space.

[0088] The storage space resource pool 303 can be a container for storing business object range data. The storage space resource pool 303 is used to record all idle storage logical unit groups of different data scale levels in the hardware storage cluster, and allocate corresponding storage space to different idle front-end shooting devices at each data scale level.

[0089] The object storage space 304 may be a storage space allocated to each front-end shooting device, and is used to store business object range data, such as picture data, video data, and audio data.

[0090] Figure 4 This is a schematic diagram of the structure of an object storage space data processing device provided in an embodiment of the present application. The device includes: an acquisition module 41, a level determination module 42, a logical unit group determination module 43 and a space division module 44.

[0091] The acquisition module 41 is used to acquire business scope data and business proportions, and create an object storage pool;

[0092] A level determination module 42 determines a plurality of data scale level parameters according to the business scope data and the business ratio;

[0093] A logical unit group determination module 43, used to determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter;

[0094] The logical unit group determination module 43 is further used to determine a plurality of space waste rate data according to the plurality of storage logical unit groups and the preset logical unit space length increment, wherein each space waste rate data corresponds to a data scale level;

[0095] The space partitioning module 44 is used to create a storage space resource pool in the object storage pool;

[0096] The space division module 44 is further used to divide the storage space resource pool into multiple object storage spaces according to each data scale level parameter and space waste rate data, and link each object storage space to a preset business scope data source.

[0097] In an optional embodiment of the present application, the business scope data includes a plurality of business object scope data divided by segments, the business proportion includes a proportion of a plurality of business object scope data, and the level determination module 42 is used to: determine a plurality of data scale level numbers according to the proportion of the plurality of business object scope data, wherein each data scale level number corresponds to a business object scope data. According to each business object scope data and the corresponding data scale level number, determine a plurality of data scale level parameters of the business object scope data, wherein the amount of data between each two adjacent data scale level parameters increases by an increment in a preset range increment correspondence relationship.

[0098] In an optional embodiment of the present application, the logical unit group determination module 43 is specifically used to: determine, according to a storage logical unit group among the multiple storage logical unit groups, a first logical space length of the storage logical unit group and a second logical space length of the previous storage logical unit group. According to the first logical space length, the second logical space length and the preset logical unit space length increment, determine the space waste rate data corresponding to the storage logical unit group.

[0099] In an optional embodiment of the present application, the logical unit group determination module 43 is used to determine the space waste rate data corresponding to the storage logical unit group, and the calculation formula is:

[0100]

[0101] In the formula, w n is the space waste rate data corresponding to the nth storage logical unit group among the multiple storage logical unit groups, where n is a natural number greater than 0, and s n is the second logical space length of the nth storage logical unit group, s n-1is the first logical space length of the n-1th storage logical unit group, and b is the preset logical unit space length increment.

[0102] In an optional embodiment of the present application, the space partitioning module 44 is specifically used to obtain free storage logical unit groups corresponding to all different scale level parameters in the object storage pool, and store the free storage logical unit groups as a storage space resource pool.

[0103] In an optional embodiment of the present application, the space division module 44 is further specifically used to: select an idle storage logical unit group from the storage space resource pool as an object storage space according to each data scale level parameter and space waste rate data, until the storage space resource pool is divided into multiple object storage spaces.

[0104] In an optional embodiment of the present application, the space division module 44 is further specifically used to: if it is determined that the business object range data meets the over-specification object condition, then in response to a preset space allocation request, divide an over-specification object storage space in the object storage pool.

[0105] The object storage space data processing device provided in this embodiment can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effects are similar, and this embodiment will not be repeated here.

[0106] Figure 5 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the system includes: at least one processor 501 and a memory 502 .

[0107] The processor 501 is used to store computer-executable instructions.

[0108] The memory 502 is used to execute the computer-executable instructions stored in the memory to implement the various steps involved in the above method embodiment. For details, please refer to the relevant description in the above method embodiment.

[0109] Optionally, the memory 502 may be independent or integrated with the processor 501 .

[0110] When the memory 502 is independently provided, the electronic device further includes a bus 503 for connecting the memory 502 and the processor 501 .

[0111] An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above-mentioned object storage space data processing method is implemented.

[0112] An embodiment of the present application also provides a computer program product, including a computer program, which implements the above object storage space data processing method when executed by a processor.

[0113] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0114] The modules described above as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to implement the solution of this embodiment.

[0115] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each module may exist physically separately, or two or more modules may be integrated into one unit. The unit composed of the above modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0116] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method of each embodiment of the present application.

[0117] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

[0118] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.

[0119] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0120] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0121] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic device or a main control device.

[0122] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0123] The present invention is intended to illustrate the technical solution of the present application rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some or all of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solution from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for processing object storage space data, characterized in that: include: Obtain business scope data and business proportions, and create an object storage pool; Determining multiple data scale level parameters according to the business scope data and the business ratio; Determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter; Determine a plurality of space waste rate data according to a plurality of storage logical unit groups and a preset logical unit space length increment, wherein each of the space waste rate data corresponds to a data scale level; Creating a storage space resource pool in the object storage pool; According to each data scale level parameter and the space waste rate data, the storage space resource pool is divided into a plurality of object storage spaces, and each object storage space is linked to a preset business scope data source.

2. The method according to claim 1, characterized in that: The business scope data includes a plurality of business object scope data divided by sections, and the business proportion includes a proportion of the plurality of business object scope data; Accordingly, according to the business scope data and the business ratio, multiple data scale level parameters are determined, including: Determine multiple data scale level numbers according to the proportions of the multiple business object scope data, wherein each data scale level number corresponds to one business object scope data; According to each business object range data and the corresponding number of data scale levels, multiple data scale level parameters of the business object range data are determined, wherein the data volume between every two adjacent data scale level parameters increases by an increment in a preset range increment correspondence.

3. The method according to claim 1, characterized in that The step of determining a plurality of space waste rate data according to a plurality of storage logical unit groups and a preset logical unit space length increment comprises: According to one storage logical unit group among the plurality of storage logical unit groups, determining a first logical space length of the storage logical unit group and a second logical space length of a previous storage logical unit group; The space waste rate data corresponding to the storage logical unit group is determined according to the first logical space length, the second logical space length and a preset logical unit space length increment.

4. The method according to claim 3, characterized in that The calculation formula for determining the space waste rate data corresponding to the storage logical unit group according to the first logical space length, the second logical space length and the preset logical unit space length increment is: In the formula, w n is the space waste rate data corresponding to the nth storage logical unit group among the multiple storage logical unit groups, where n is a natural number greater than 0, and s n is the second logical space length of the nth storage logical unit group, s n-1 is the first logical space length of the n-1th storage logical unit group, and b is the preset logical unit space length increment.

5. The method according to any one of claims 1 to 4, characterized in that: The step of creating a storage space resource pool in the object storage pool includes: The idle storage logical unit groups corresponding to all different scale level parameters in the object storage pool are obtained, and the idle storage logical unit groups are stored as a storage space resource pool.

6. The method according to claim 5, characterized in that The step of dividing the storage space resource pool into a plurality of object storage spaces according to each data scale level parameter and the space waste rate data includes: According to each data scale level parameter and the space waste rate data, an idle storage logical unit group is selected from the storage space resource pool as an object storage space until the storage space resource pool is divided into multiple object storage spaces.

7. The method according to claim 2, characterized in that: Also includes: If it is determined that the business object range data meets the over-specification object condition, an over-specification object storage space is allocated in the object storage pool in response to a preset space allocation request.

8. An object storage space data processing device, characterized in that: include: The acquisition module is used to obtain business scope data and business proportions, and create an object storage pool; A level determination module, which determines a plurality of data scale level parameters according to the business scope data and the business ratio; A logical unit group determination module, used to determine a plurality of storage logical unit groups according to a plurality of data scale level parameters, wherein one storage logical unit group corresponds to one data scale level parameter; The logic unit group determination module is further used to determine a plurality of space waste rate data according to a plurality of storage logic unit groups and a preset logic unit space length increment, wherein each of the space waste rate data corresponds to a data scale level; A space partitioning module, used to create a storage space resource pool in the object storage pool; The space division module is also used to divide the storage space resource pool into multiple object storage spaces according to each data scale level parameter and the space waste rate data, and link each object storage space to a preset business scope data source.

9. An electronic device, characterized in that: include: at least one processor and memory; The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the object storage space data processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the object storage space data processing method according to any one of claims 1 to 7 is implemented.

Images