A data access method, device, equipment, computer storage medium and computer program product
By determining the basic information and target request grouping of data to be accessed, and selecting the target file protocol server from multiple file protocol servers to process access requests, the problem of limited access performance of business applications is solved and higher access performance is achieved .
Patent Information
- Application Number
- CN202411446528.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2044-10-16
AI Technical Summary
When a user's business application accesses network files, the performance is limited by the computing performance and network bandwidth of a single file protocol server, and cannot improve access performance.
By determining the basic information of the data to be accessed corresponding to the access request, determining the target request packet, and selecting the target file protocol server from multiple file protocol servers to process the access request, thereby improving access performance.
The joint access through multiple file protocol servers is realized, which improves the access performance of user business applications and solves the problem of limited access performance.
Smart Images

Figure CN118964048B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer network technology, and in particular to a data access method, apparatus, device, computer storage medium and computer program product. Background Art
[0002] Usually, the client (Linux operating system or Windows operating system) will mount the shared directory to the local drive letter (or directory) by connecting to a remote file protocol server (File Protocol Server, FPS); the user's business application can access the network files on the Distributed File System Server Cluster (Distributed File System Server Cluster, DFS Cluster) by mounting the drive letter or mounting the directory. Since an FPS can only be mounted to one drive letter, no matter how the business application accesses the network file drive letter, the maximum network access file performance is only the highest performance that a single FPS can achieve; however, due to the limited computing performance and network bandwidth of an FPS, this has the problem of limited access performance of the user's business application, and the access performance cannot be improved. Summary of the invention
[0003] To solve the above technical problems, the embodiments of the present application hope to provide a data access method, apparatus, device, computer storage medium and computer program product, which can solve the problem of limited access performance of user's business applications in related technologies and improve access performance.
[0004] The technical solution of this application is implemented as follows:
[0005] A data access method, the method comprising:
[0006] Determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed;
[0007] Determining a target request group corresponding to the access request based on the basic information of the data to be accessed;
[0008] Determining, from a plurality of file protocol servers, a target file protocol server corresponding to the target request group;
[0009] The access request is sent to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through the access interface corresponding to the target file protocol server.
[0010] In the above solution, the basic information of the data to be accessed corresponding to the access request is determined, including:
[0011] Determine the size and storage location of the to-be-accessed data corresponding to the access request; wherein the basic information includes the size and the storage location;
[0012] Accordingly, determining the target request group corresponding to the access request based on the basic information of the data to be accessed includes:
[0013] Determining a baseline size for request packets;
[0014] The target request group corresponding to the access request is determined based on the size of the to-be-accessed data, the storage location, and the reference size.
[0015] In the above solution, determining the target request group corresponding to the access request based on the size of the data to be accessed, the storage location and the reference size includes:
[0016] Determining a target size corresponding to the data to be accessed based on the size of the data to be accessed and the storage location;
[0017] The target request group corresponding to the access request is determined based on the target size and the reference size.
[0018] In the above solution, the basic information of the data to be accessed corresponding to the access request is determined, including:
[0019] Determine the identifier of the target access file to which the to-be-accessed data corresponding to the access request belongs; wherein the basic information includes the identifier of the target access file;
[0020] Accordingly, determining the target request group corresponding to the access request based on the basic information of the data to be accessed includes:
[0021] Based on the correspondence between the file identifier and the request group and the identifier of the target access file, the target request group corresponding to the access request is determined.
[0022] In the above solution, the basic information of the data to be accessed corresponding to the access request is determined, including:
[0023] Determine a target storage space of the to-be-accessed data corresponding to the access request; wherein the basic information includes the target storage space;
[0024] Accordingly, determining the target request group corresponding to the access request based on the basic information of the data to be accessed includes:
[0025] The target request group corresponding to the access request is determined based on the correspondence between the storage space and the request group and the target storage space.
[0026] In the above scheme, determining the target file protocol server corresponding to the target request group from multiple file protocol servers includes:
[0027] Determining the number of the plurality of file protocol servers and the sequence number of the target request packet;
[0028] Based on the quantity and the sequence number, the target file protocol server corresponding to the target request packet is determined from the multiple file protocol servers.
[0029] In the above scheme, determining the target file protocol server corresponding to the target request group from the multiple file protocol servers based on the quantity and the sequence number includes:
[0030] Performing a target operation on the quantity and the sequence number to obtain a target value;
[0031] Based on the target value, the target file protocol server corresponding to the target request group is determined from the multiple file protocol servers.
[0032] A data access device, comprising:
[0033] An acquisition unit, configured to determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed;
[0034] A first determining unit, configured to determine a target request group corresponding to the access request based on basic information of the data to be accessed;
[0035] A second determining unit, configured to determine a target file protocol server corresponding to the target request group from a plurality of file protocol servers;
[0036] The processing unit is used to send the access request to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through the access interface corresponding to the target file protocol server.
[0037] A data access device, the device comprising: a processor, a memory and a communication bus;
[0038] The communication bus is used to realize the communication connection between the processor and the memory;
[0039] The processor is used to execute the data access program stored in the memory to implement the steps of the above data access method.
[0040] A computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the data access method as described above.
[0041] A computer program product comprises a computer program, wherein the computer program implements the above method when executed by a processor.
[0042] The data access method, apparatus, device, computer-readable storage medium, and computer program product provided in the embodiments of the present application can determine basic information of the data to be accessed corresponding to the access request, determine the target request group corresponding to the access request based on the basic information of the data to be accessed, determine the target file protocol server corresponding to the target request group from multiple file protocol servers, and send the access request to the target file protocol server so that the target file protocol server accesses the data to be accessed in the file system server through the access interface corresponding to the target file protocol server. In this way, when the access request of the user's business application is obtained, the file system server can be accessed through the target file protocol server corresponding to the access request selected from the multiple file protocol servers, and the access is performed through the corresponding access interface of the target file protocol server. It is not like in the related art that all access requests of the user's business application can only access the file system server through a fixed file protocol server, which greatly improves the access performance and solves the problem of limited access performance of the user's business application in the related art. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A flowchart of a data access method provided in an embodiment of the present application;
[0044] Figure 2 A flowchart of another data access method provided in an embodiment of the present application;
[0045] Figure 3 A schematic diagram of request grouping in a data access method provided in an embodiment of the present application;
[0046] Figure 4 A schematic diagram of a target request group corresponding to data to be accessed in a data access method provided in an embodiment of the present application;
[0047] Figure 5 A schematic diagram of a target request group corresponding to data to be accessed in another data access method provided in an embodiment of the present application;
[0048] Figure 6 A schematic diagram of a target request group corresponding to data to be accessed in another data access method provided in an embodiment of the present application;
[0049] Figure 7 A schematic diagram of a process of accessing data to be accessed through a target FPS in a data access method provided in an embodiment of the present application;
[0050] Figure 8 A schematic diagram of an architecture of a data access method provided in an embodiment of the present application for accessing data to be accessed through a target FPS;
[0051] Fig. 9 A schematic diagram of the structure of a data access device provided in an embodiment of the present application;
[0052] Fig.10 A structural diagram of a data access device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
[0054] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0055] It should be understood that the "embodiments of the present application" or "the aforementioned embodiments" mentioned throughout the specification mean that specific features, structures or characteristics related to the embodiments are included in at least one embodiment of the present application. Therefore, "in the embodiments of the present application" or "in the aforementioned embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.
[0056] Unless otherwise specified, the electronic device performs any step in the embodiments of the present application, and the processor of the electronic device may perform the step. It is also worth noting that the embodiments of the present application do not limit the order in which the electronic device performs the following steps. In addition, the methods used to process data in different embodiments may be the same method or different methods. It should also be noted that any step in the embodiments of the present application can be independently executed by the electronic device, that is, when the electronic device executes any step in the following embodiments, it may not rely on the execution of other steps.
[0057] The present application embodiment provides a data access storage method, which can be applied to a data access device, referring to Figure 1 As shown, the method comprises the following steps:
[0058] Step 101: Determine basic information of the data to be accessed corresponding to the access request.
[0059] The basic information represents the storage status of the data to be accessed.
[0060] In the embodiment of the present application, the data access device may refer to a client; the access request may be a request initiated by a business application of a user on the client to access a file system server. It should be noted that the file system server may refer to a distributed file system server (DFS) in a DFS Cluster; and the data to be accessed may refer to the accessed data on the DFS.
[0061] Among them, basic information may refer to some information related to the data to be accessed; the basic information may include the size and storage information of the data to be accessed; in a feasible implementation method, the storage information may include parameters such as the storage location of the data to be accessed, the identifier of the target access file to which the data to be accessed belongs, or the target storage space of the data to be accessed.
[0062] Step 102: Determine a target request group corresponding to the access request based on basic information of the data to be accessed.
[0063] In an embodiment of the present application, the client may use different scheduling strategies to determine the target request group corresponding to the access request based on the basic information of different data to be accessed. Among them, the target request group may refer to a target request queue. It should be noted that multiple request queues may be pre-set, and after obtaining the access request, different scheduling strategies may be used to determine the target request queue corresponding to each access request based on the basic information of the data to be accessed, so that the target file protocol server corresponding to the access request can be subsequently determined through the target request queue.
[0064] Step 103: Determine a target file protocol server corresponding to the target request group from multiple file protocol servers.
[0065] The file protocol server may refer to an FPS. In the embodiment of the present application, the client may filter a target FPS corresponding to the target request packet from the multiple FPSs according to the information of the multiple FPSs and the information of the target FPS.
[0066] Step 104: Send an access request to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through the access interface corresponding to the target file protocol server.
[0067] In the embodiment of the present application, the client can dispatch the access request to the selected target FPS through the private driver in the client; then, according to the access interface corresponding to the target FPS, the target FPS can access the data to be accessed in the DFS. It should be noted that the corresponding access interface can be used to obtain the shared directory information, establish a local drive letter (directory), and then access the DFS.
[0068] It should be noted that an access interface may refer to a group of access interfaces; wherein the group of access interfaces may include interfaces such as a file reading interface, a file writing interface, various file (directory) attribute acquisition interfaces, and various file attribute setting interfaces. It should be noted that each FPS may correspond to a group of access interfaces; the specific interface information of a group of access interfaces corresponding to each FPS is different, but the functions implemented in a group of access interfaces corresponding to each FPS are the same (i.e., they all include a file reading interface, a file writing interface, various file (directory) attribute acquisition interfaces, and various file attribute setting interfaces).
[0069] The data access method provided in the embodiment of the present application can access the file system server through a target file protocol server corresponding to the access request selected from multiple file protocol servers when obtaining an access request from a user's business application, and the access is performed through the corresponding access interface of the target file protocol server. It is not like in the related art that all access requests of the user's business application can only access the file system server through a fixed file protocol server, which greatly improves the access performance and solves the problem of limited access performance of the user's business application in the related art.
[0070] Based on the above embodiments, the present application provides a data access method. Figure 2 As shown, the method may include the following steps:
[0071] Step 201: The data access device determines the size and storage location of the to-be-accessed data corresponding to the access request.
[0072] Among them, basic information includes size and storage location.
[0073] In an embodiment of the present application, the size of the data to be accessed may refer to the length of the data to be accessed; the storage position may refer to the starting storage position of the data to be accessed in the DFS; in a feasible implementation method, the storage position may refer to the offset of the data to be accessed.
[0074] Step 202: The data access device determines a reference size of a request packet.
[0075] The request group may refer to a pre-set request queue for storing requests to be accessed; the base size of the request group may refer to the size of the pre-set request queue. In a feasible implementation, the request queue may be as follows: Figure 3 The queue shown, of course Figure 3 The example above only shows 10 request groups (ie, request queues), but the number is not limited to 10.
[0076] Step 203: The data access device determines a target request group corresponding to the access request based on the size, storage location and reference size of the data to be accessed.
[0077] Among them, the client can perform certain calculations and processing on the size, storage location and benchmark size of the data to be accessed to determine the target request group corresponding to the access request from all request groups. Specifically, the size and storage location of the data can be calculated first, and the target request group can be determined from all request groups based on the calculation result and the benchmark size. It should be noted that access to data at different locations of a file is achieved through different FPSs.
[0078] In other embodiments of the present application, step 203 may be implemented in the following manner:
[0079] Step 203a: The data access device determines a target size corresponding to the data to be accessed based on the size and storage location of the data to be accessed.
[0080] The target size can be obtained by summing the size of the data to be accessed and the storage location. In a feasible implementation, if the size of the data to be accessed Len=3M and the storage location Pos=1.5M, then the target size is 4.5M.
[0081] Step 203b: The data access device determines the target request group corresponding to the access request based on the target size and the reference size.
[0082] In the embodiment of the present application, the target size can be segmented according to the reference size, and then the target request grouping can be determined according to the segmentation result and the reference size. In a feasible implementation, if the reference size is 1M, it can be segmented into 4, the first corresponding request grouping from 1.5M to 2M, the second corresponding request grouping from 2M to 3M, the third corresponding request grouping from 3M to 4M, and the fourth corresponding request grouping from 4M to 4.5M; specifically, Figure 4 As shown, the target request groups may be request group 1, request group 2, request group 3, and request group 4.
[0083] Step 204: The data access device determines the identifier of the target access file to which the to-be-accessed data corresponding to the access request belongs.
[0084] The basic information includes the identifier of the target access file.
[0085] In an embodiment of the present application, the target access file may refer to the file corresponding to the to-be-accessed data in the DFS; the identifier of the target access file may be used to uniquely identify the file corresponding to the to-be-accessed data in the DFS. In a feasible implementation, the identifier of the target access file may refer to the name of the target access file.
[0086] Step 205: The data access device determines the target request group corresponding to the access request based on the correspondence between the file identifier and the request group and the identifier of the target access file.
[0087] In the embodiment of the present application, the correspondence between the file identifier and the request group can be a correspondence table between the file identifier and the request group that is pre-set according to the actual application scenario and specific requirements. It should be noted that the target request group corresponding to the access request can be found from the correspondence table between the file identifier and the request group according to the identifier of the target access file.
[0088] In a feasible implementation, if the target access files corresponding to the data to be accessed are File 1, File 2, File 3 and File 4, such as Figure 5 As shown, the corresponding target request groups may include request group 0, request group 1, request group 2 and request group 3. It should be noted that different file accesses may be implemented through different FPSs, that is, concurrent access may be performed on a file basis.
[0089] Step 206: The data access device determines a target storage space of the to-be-accessed data corresponding to the access request.
[0090] Among them, the basic information includes the target storage space.
[0091] In an embodiment of the present application, the target storage space may refer to the storage space of the data to be accessed in the DFS; in a feasible implementation, the target storage space may refer to the storage disk (ie, storage directory) of the data to be accessed in the DFS.
[0092] Step 207: The data access device determines the target request group corresponding to the access request based on the correspondence between the storage space and the request group and the target storage space.
[0093] In an embodiment of the present application, the correspondence between storage space and request grouping may be a correspondence table between storage space and request grouping that is pre-set according to actual application scenarios and specific requirements. In a feasible implementation, the correspondence between storage space and request grouping may refer to a correspondence table between storage disks and request groups. It should be noted that, according to the target storage space, the target request group corresponding to the access request may be searched from the correspondence table between storage space and request grouping.
[0094] In a feasible implementation, if the target storage space of the data to be accessed is directory (Dir) 1, Dir2, Dir3 and Dir4, such as Figure 6 The corresponding target request groups shown may include request group 0, request group 1, request group 2 and request group 3. It should be noted that file accesses in different directories may be implemented through different FPSs, that is, concurrent access may be performed by directory.
[0095] It should be noted that steps 201 to 203, steps 204 to 205, and steps 206 to 207 are executed separately, that is, steps 201 to 203, steps 204 to 205, and steps 206 to 207 are parallel solutions; and steps 208 to 210 can be executed after steps 203, 205, and 207.
[0096] Step 208: The data access device determines the number of multiple file protocol servers and the sequence number of the target request packet.
[0097] The number of file protocol servers may refer to the total number of all preset FPSs; the sequence number of the target request packet may refer to the ranking of the target request packet in the preset request packets (request queue).
[0098] Step 209: The data access device determines a target file protocol server corresponding to the target request group from a plurality of file protocol servers based on the quantity and the sequence number.
[0099] In an embodiment of the present application, the client may perform certain operations on the quantity and the sequence number, and filter the target FPS from multiple FPSs according to the result of the operation.
[0100] In other embodiments of the present application, step 209 may be implemented in the following manner:
[0101] Step 209a: The data access device performs a target operation on the quantity and the serial number to obtain a target value.
[0102] Among them, the client can use the target algorithm to perform target operations on the quantity and the sequence number; specifically, the target algorithm can refer to a modulo algorithm, and the target operation is an operation method corresponding to the modulo algorithm.
[0103] Step 209b: The data access device determines a target file protocol server corresponding to the target request group from a plurality of file protocol servers based on the target value.
[0104] In the embodiment of the present application, the client can select the FPS corresponding to the target value from the multiple FPSs as the target FPS. Specifically, the FPS at the sequence number corresponding to the target value in the multiple FPSs can be determined as the final target FPS.
[0105] In a feasible implementation, if the number of multiple FPSs is M, and the sequence number of the target request group in the entire request group is n (i.e., the target request group is the nth), then the access request corresponding to the target request group can be allocated to the i-th FPS. It should be noted that the target FPS is determined by using the operation formula i=n mod m, where mod is a modulus operation.
[0106] It should be noted that if the access request corresponds to multiple target request groups, the target FPS corresponding to each target request group can be determined; then, the target DFS can be accessed through the determined multiple target FPSs. Specifically, the target request group corresponding to the access request can be determined through a private driver, such as Figure 7 The target request groups shown in the figure may be request group 0, request group 1, request group 2, request group 3, request group 4 and request group 5; wherein, the access requests corresponding to request group 0 and request group 3 access the DFS in the DFS Cluster through FPS0, the access requests corresponding to request group 1 and request group 4 access the DFS in the DFS Cluster through FPS1, and the access requests corresponding to request group 2 and request group 5 access the DFS in the DFS Cluster through FPS2.
[0107] In other embodiments of the present application, Figure 8 As shown, after the application on the client sends an access request, it can access the DFS where the access data in DFSCluster is located through the target FPS among multiple FPSs. In this way, the computing performance and bandwidth of multiple FPSs and DFS Cluster can be utilized, and user business can obtain better network file access performance, ensuring that business applications obtain greater DFS Cluster network file access performance. At the same time, the scope of applicability is greatly expanded.
[0108] Step 210: The data access device sends an access request to the target file protocol server, so that the target file protocol server accesses the to-be-accessed data in the file system server through an access interface corresponding to the target file protocol server.
[0109] In other embodiments of the present application, when mounting a private drive on an FPS, user authentication can be performed first, and a local mount drive letter (or directory) and a shared directory can be set; then, a file access interface list (i.e., multiple groups of file access interfaces) for accessing DFS can be established, and the file access interface list can be used to obtain shared directory information and establish a local drive letter (directory); further, access to the corresponding DFS in the DFS Cluster can be achieved through the target FPS.
[0110] It should be noted that, for the description of the same steps and the same contents in this embodiment as those in other embodiments, reference can be made to the description in other embodiments and will not be repeated here.
[0111] The data access method provided in the embodiment of the present application can access the file system server through a target file protocol server corresponding to the access request selected from multiple file protocol servers when obtaining an access request from a user's business application, and the access is performed through the corresponding access interface of the target file protocol server. It is not like in the related art that all access requests of the user's business application can only access the file system server through a fixed file protocol server, which greatly improves the access performance and solves the problem of limited access performance of the user's business application in the related art.
[0112] Based on the above embodiments, the present invention provides a data access device, which can be applied to Figure 1 and Figure 2 In the data access method provided in the corresponding embodiment, refer to Fig. 9 As shown, the data access device 3 may include: an acquisition unit 31, a first determination unit 32, a second determination unit 33 and a processing unit 34, wherein:
[0113] An acquisition unit 31 is used to determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed;
[0114] A first determining unit 32, configured to determine a target request group corresponding to the access request based on basic information of the data to be accessed;
[0115] A second determining unit 33 is used to determine a target file protocol server corresponding to the target request group from a plurality of file protocol servers;
[0116] The processing unit 34 is used to send an access request to the target file protocol server so that the target file protocol server can access the to-be-accessed data in the file system server through an access interface corresponding to the target file protocol server.
[0117] In other embodiments of the present application, the acquisition unit 31 is further used to determine the size and storage location of the to-be-accessed data corresponding to the access request; wherein the basic information includes the size and storage location.
[0118] In other embodiments of the present application, the first determining unit 32 is further configured to perform the following steps:
[0119] Determining a baseline size of a request group to be accessed;
[0120] Based on the size, storage location and reference size of the data to be accessed, a target request group corresponding to the access request is determined.
[0121] In other embodiments of the present application, the first determining unit 32 is further configured to perform the following steps:
[0122] Determine a target size corresponding to the data to be accessed based on the size and storage location of the data to be accessed;
[0123] Based on the target size and the reference size, a target request group corresponding to the access request is determined.
[0124] In other embodiments of the present application, the acquisition unit 31 is further used to determine the identifier of the target access file to which the to-be-accessed data corresponding to the access request belongs; wherein the basic information includes the identifier of the target access file.
[0125] In other embodiments of the present application, the first determining unit 32 is further configured to determine the target request group corresponding to the access request based on the correspondence between the file identifier and the request group and the identifier of the target access file.
[0126] In other embodiments of the present application, the acquisition unit 31 is further used to determine a target storage space of the to-be-accessed data corresponding to the access request; wherein the basic information includes the target storage space.
[0127] In other embodiments of the present application, the first determining unit 32 is further configured to determine a target request group corresponding to the access request based on a correspondence between the storage space and the request group and the target storage space.
[0128] In other embodiments of the present application, the second determining unit 33 is further configured to perform the following steps:
[0129] determining the number of the plurality of file protocol servers and a sequence number of the target request packet;
[0130] Based on the quantity and the sequence number, a target file protocol server corresponding to the target request group is determined from the plurality of file protocol servers.
[0131] In other embodiments of the present application, the second determining unit 33 is further configured to perform the following steps:
[0132] Perform target operations on the quantity and the serial number to obtain the target value;
[0133] Based on the target value, a target file protocol server corresponding to the target request group is determined from a plurality of file protocol servers.
[0134] It should be noted that the specific implementation process of the steps performed by each unit in the embodiment of the present application can be referred to Figure 1 and Figure 2 The implementation process of the data access method provided in the corresponding embodiment will not be repeated here.
[0135] The data access device provided in the embodiment of the present application can access the file system server through a target file protocol server corresponding to the access request selected from multiple file protocol servers when obtaining an access request from a user's business application, and the access is performed through the corresponding access interface of the target file protocol server. It is not like in the related art that all access requests of the user's business application can only access the file system server through a fixed file protocol server, which greatly improves the access performance and solves the problem of limited access performance of the user's business application in the related art.
[0136] Based on the above embodiments, the embodiments of the present application provide a data access device, which can be applied to Figure 1 and Figure 2 In the data access method provided in the corresponding embodiment, refer to Fig.10 As shown, the data access device 4 may include: a processor 41, a memory 42 and a communication bus 43, wherein:
[0137] The communication bus 43 is used to realize the communication connection between the processor 41 and the memory 42;
[0138] The processor 41 is used to execute the data access program in the memory 42 to implement the following steps:
[0139] Determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed;
[0140] Determine a target request group corresponding to the access request based on basic information of the data to be accessed;
[0141] Determining a target file protocol server corresponding to the target request group from a plurality of file protocol servers;
[0142] An access request is sent to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through an access interface corresponding to the target file protocol server.
[0143] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42 to determine the basic information of the to-be-accessed data corresponding to the access request, so as to implement the following steps:
[0144] Determine the size and storage location of the to-be-accessed data corresponding to the access request; wherein the basic information includes the size and storage location.
[0145] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42, based on the basic information of the data to be accessed, to determine the target request group corresponding to the access request, so as to implement the following steps:
[0146] Determining a baseline size of a request group to be accessed;
[0147] Based on the size, storage location and reference size of the data to be accessed, a target request group corresponding to the access request is determined.
[0148] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42, based on the size, storage location and reference size of the data to be accessed, to determine the target request group corresponding to the access request, so as to implement the following steps:
[0149] Determine a target size corresponding to the data to be accessed based on the size and storage location of the data to be accessed;
[0150] Based on the target size and the reference size, a target request group corresponding to the access request is determined.
[0151] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42 to determine the basic information of the to-be-accessed data corresponding to the access request, so as to implement the following steps:
[0152] Determine the identifier of the target access file to which the to-be-accessed data corresponding to the access request belongs; wherein the basic information includes the identifier of the target access file.
[0153] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42, based on the basic information of the data to be accessed, to determine the target request group corresponding to the access request, so as to implement the following steps:
[0154] Based on the correspondence between the file identifier and the request group and the identifier of the target access file, a target request group corresponding to the access request is determined.
[0155] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42 to determine the basic information of the to-be-accessed data corresponding to the access request, so as to implement the following steps:
[0156] Determine a target storage space of the to-be-accessed data corresponding to the access request; wherein the basic information includes the target storage space.
[0157] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42, based on the basic information of the data to be accessed, to determine the target request group corresponding to the access request, so as to implement the following steps:
[0158] Based on the correspondence between the storage space and the request group and the target storage space, a target request group corresponding to the access request is determined.
[0159] In other embodiments of the present application, the processor 41 is used to execute the data access program in the memory 42 to determine the target file protocol server corresponding to the target request group from multiple file protocol servers to implement the following steps:
[0160] determining the number of the plurality of file protocol servers and a sequence number of the target request packet;
[0161] Based on the quantity and the sequence number, a target file protocol server corresponding to the target request group is determined from the plurality of file protocol servers.
[0162] In other embodiments of the present application, the processor 41 is used to execute the memory 42 to determine the target file protocol server corresponding to the target request group from multiple file protocol servers based on the quantity and the sequence number, so as to implement the following steps:
[0163] Perform target operations on the quantity and the serial number to obtain the target value;
[0164] Based on the target value, a target file protocol server corresponding to the target request group is determined from a plurality of file protocol servers.
[0165] It should be noted that the specific description of the steps performed by the processor can be referred to Figure 1 and Figure 2 The implementation process of the data storage method provided in the corresponding embodiment will not be repeated here.
[0166] The data access device provided in the embodiment of the present application can access the file system server through a target file protocol server corresponding to the access request selected from multiple file protocol servers when obtaining an access request from a user's business application, and the access is performed through the corresponding access interface of the target file protocol server. It is not like in the related art that all access requests of the user's business application can only access the file system server through a fixed file protocol server, which greatly improves the access performance and solves the problem of limited access performance of the user's business application in the related art.
[0167] Based on the foregoing embodiments, the embodiments of the present application provide a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement Figure 1 and Figure 2 The corresponding embodiments provide steps in the data access method.
[0168] Based on the foregoing embodiments, the embodiments of the present application provide a computer program product, including a computer program, which can be executed by the processor 41 to complete Figure 1 and Figure 2 The corresponding embodiments provide steps of the data access method.
[0169] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.
[0170] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0171] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0172] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0173] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.
Claims
1. A data access method, characterized in that: The method comprises: Determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed; Based on the basic information of the data to be accessed, different scheduling strategies are used to determine the target request group corresponding to the access request; Determining, from a plurality of file protocol servers, a target file protocol server corresponding to the target request group; Sending the access request to the target file protocol server so that the target file protocol server accesses the to-be-accessed data in the file system server through an access interface corresponding to the target file protocol server; The step of determining the target file protocol server corresponding to the target request group from a plurality of file protocol servers includes: Determining the number of the plurality of file protocol servers and the sequence number of the target request group; the sequence number represents the ranking of the target request group in the preset request group; Based on the quantity and the sequence number, the target file protocol server corresponding to the target request packet is determined from the multiple file protocol servers.
2. The method according to claim 1, characterized in that The basic information of the data to be accessed corresponding to the access request is determined, including: Determine the size and storage location of the to-be-accessed data corresponding to the access request; wherein the basic information includes the size and the storage location; Correspondingly, the determining the target request group corresponding to the access request by adopting different scheduling strategies based on the basic information of the data to be accessed includes: Determining a baseline size for request packets; The target request group corresponding to the access request is determined based on the size of the to-be-accessed data, the storage location, and the reference size.
3. The method according to claim 2, characterized in that The determining the target request group corresponding to the access request based on the size of the to-be-accessed data, the storage location, and the reference size includes: Determining a target size corresponding to the data to be accessed based on the size of the data to be accessed and the storage location; The target request group corresponding to the access request is determined based on the target size and the reference size.
4. The method according to claim 1, characterized in that: The basic information of the data to be accessed corresponding to the access request is determined, including: Determine the identifier of the target access file to which the to-be-accessed data corresponding to the access request belongs; wherein the basic information includes the identifier of the target access file; Correspondingly, the determining the target request group corresponding to the access request by adopting different scheduling strategies based on the basic information of the data to be accessed includes: Based on the correspondence between the file identifier and the request group and the identifier of the target access file, the target request group corresponding to the access request is determined.
5. The method according to claim 1, characterized in that: The basic information of the data to be accessed corresponding to the access request is determined, including: Determine a target storage space of the to-be-accessed data corresponding to the access request; wherein the basic information includes the target storage space; Accordingly, determining the target request group corresponding to the access request based on the basic information of the data to be accessed includes: The target request group corresponding to the access request is determined based on the correspondence between the storage space and the request group and the target storage space.
6. The method according to claim 1, characterized in that The step of determining the target file protocol server corresponding to the target request group from the plurality of file protocol servers based on the quantity and the sequence number includes: Performing a target operation on the quantity and the sequence number to obtain a target value; Based on the target value, the target file protocol server corresponding to the target request group is determined from the multiple file protocol servers.
7. A data access device, characterized in that: The device comprises: An acquisition unit, configured to determine basic information of the data to be accessed corresponding to the access request; wherein the basic information represents the storage status of the data to be accessed; A first determining unit, configured to determine a target request group corresponding to the access request by adopting different scheduling strategies based on the basic information of the data to be accessed; a second determining unit, configured to determine the number of a plurality of file protocol servers and a sequence number of the target request group, wherein the sequence number represents a ranking of the target request group in a preset request group, and determine a target file protocol server corresponding to the target request group from the plurality of file protocol servers based on the number and the sequence number; The processing unit is used to send the access request to the target file protocol server so that the target file protocol server can access the data to be accessed in the file system server through the access interface corresponding to the target file protocol server.
8. A data access device, characterized in that: The device comprises: a processor, a memory and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the data access program stored in the memory to implement the steps of the data access method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the data access method as described in any one of claims 1 to 6.
10. A computer program product, comprising a computer program, characterized in that: When the computer program is executed by a processor, the computer program implements the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
File storage method, file access method, file storage device and file access device
CN105893433A
File access method, system and equipment and medium
CN112148678A
Method, device and equipment for storing access data and storage medium
CN115495431A