Data storage method, device, equipment, medium and program product

Abstract

This disclosure provides a data storage method applicable to the field of cloud computing technology. The method includes: in response to a received storage service switching instruction, mapping a target storage unit obtained by scanning the external storage device using a Fibre Channel connecting the server and the external storage device to the server; if it is determined that the target storage unit needs to accept online access from a target business system, creating an access path in the server that enables online access to the target storage unit based on the identifier of the target storage unit; distributing the access path to the target business system to replace historical paths associated with local storage in the server; and storing data generated by the target business system during business operations in the target storage unit based on the access path. This disclosure also provides a data storage device, apparatus, storage medium, and program product.

Description

Technical Field

[0001] This disclosure relates to the field of cloud computing, and more specifically to a data storage method, apparatus, device, medium, and program product. Background Technology

[0002] In a virtual storage environment, by abstracting and virtualizing physical resources, unified management of storage resources across different devices can be achieved. When it is determined that the server's storage capacity is insufficient and a switch to a storage service is necessary, the relevant technology involves establishing a heterogeneous connection between the storage system used for expansion and the original system, then halting the server's business processing, and finally switching the connection between the server and the original system to the new storage system.

[0003] In the process of realizing the present invention, the inventors discovered that the related technology has at least the following problems: when switching storage services, if the business processing of the application server is suspended, the integrity of the business data will be difficult to guarantee. This will require a lot of time to coordinate and migrate data, resulting in low efficiency of service switching. Summary of the Invention

[0004] In view of the above problems, this disclosure provides a data storage method, apparatus, device, medium and program product.

[0005] According to a first aspect of this disclosure, a data storage method is provided, comprising: in response to a received storage service switching instruction, mapping a target storage unit obtained by scanning the external storage device using a Fibre Channel connecting the server and the external storage device to the server; if it is determined that the target storage unit needs to accept online access from a target business system, creating an access path in the server that enables online access to the target storage unit based on an identifier of the target storage unit; distributing the access path to the target business system to replace a historical path associated with local storage in the server; and storing data generated by the target business system during business operations in the target storage unit based on the access path.

[0006] According to embodiments of this disclosure, the target storage unit is a storage unit that meets preset storage requirements, which are set based on the data growth trend of the target business system. Mapping the target storage unit obtained by scanning the external storage device using the Fibre Channel connecting the server and the external storage device to the server includes: binding the node identifier of the target storage unit to the node identifier of the Fibre Channel port of the server to obtain a binding result; generating a mapping task based on the link mapping parameters between the server and the target storage unit in the binding result; and executing the mapping task to map the target storage unit to the server via the Fibre Channel.

[0007] According to an embodiment of this disclosure, the creation of an access path in the server that enables online access to the target storage unit based on the identifier of the target storage unit includes: importing the target storage unit into a storage pool of the server, wherein the storage pool is used for resource allocation of multiple storage units; reporting the identifier of the target storage unit to the server to create multiple access paths corresponding to the identifier in the server, wherein the multiple access paths can be switched between each other, and the server can call the corresponding storage unit from the storage pool based on the access path.

[0008] According to an embodiment of this disclosure, the method further includes: when it is determined that the target business system meets preset conditions when performing business, creating a temporary storage pool that matches the target storage unit, wherein the preset conditions include at least one of the following: intermediate data needs to be generated when performing the business, the business needs to be tested, or the data generated by the business needs to be isolated.

[0009] According to embodiments of this disclosure, the method further includes: converting the target storage unit into a storage disk format to perform online access confirmation on the target storage unit, wherein the storage disk can be directly accessed online; when it is determined that the target storage unit needs to accept online access from the target business system, importing the target storage unit into the storage pool as a mapped volume, wherein the target storage unit is divided into multiple mapped volumes; assigning a corresponding logical identifier to each mapped volume in the storage pool to invoke the target storage unit based on the logical identifier.

[0010] According to embodiments of this disclosure, the above-mentioned method of sending the access path to the target business system to replace the historical path associated with the local storage in the server includes: setting the takeover mode of the target storage unit to online takeover, wherein the online takeover indicates that the target storage unit wants to take over the storage resources in the local storage online; disconnecting the connection between the target business system and the historical path; and sending the access path to the target business system so that when the server generates an operation request based on the business needs of the target business system, the operation request is sent to the external storage device based on the access path.

[0011] According to embodiments of this disclosure, the above-mentioned method of sending the access path to the target business system to replace the historical path associated with the local storage in the server includes: setting the takeover mode of the target storage unit to online takeover, wherein the online takeover indicates that the target storage unit wants to take over the storage resources in the local storage online; disconnecting the connection between the target business system and the historical path; and sending the access path to the target business system so that when the server generates an operation request based on the business needs of the target business system, the operation request is sent to the external storage device based on the access path.

[0012] According to embodiments of this disclosure, the method further includes: when it is determined that the target storage unit has been scanned from the external storage device, adding the target storage unit to the storage pool of the server; responding to a received operation request, processing the storage resources in the storage pool according to the operation means corresponding to the operation request, wherein the operation means include read operations and write operations, wherein the operation request is generated by the server based on the business needs of the target business system; when it is determined that the target storage unit does not need to accept online access from the target business system, maintaining the storage resource allocation method between the storage pool and the target storage unit, wherein the storage resource allocation method is to allocate resources according to the storage capacity of the local memory and the target storage unit; when it is determined that the target storage unit needs to accept online access from the target business system, and the target storage unit has taken over the local memory online, migrating historical resources in the local memory online to the target storage unit; and changing the storage resource allocation method to allocate resources only according to the storage capacity of the target storage unit.

[0013] A second aspect of this disclosure provides a data storage apparatus, characterized in that the apparatus comprises: a storage mapping module, configured to, in response to a received storage service switching instruction, map a target storage unit obtained by scanning the external storage device using a fiber optic channel connecting the server and the external storage device to the server; a path creation module, configured to, when it is determined that the target storage unit needs to be accessed online by a target business system, create an access path in the server that enables online access to the target storage unit based on the identifier of the target storage unit; a path distribution module, configured to distribute the access path to the target business system to replace historical paths associated with local storage in the server; and a data storage module, configured to store data generated by the target business system during business execution in the target storage unit based on the access path.

[0014] A third aspect of this disclosure provides an electronic device comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the method described above.

[0015] A fourth aspect of this disclosure also provides a computer-readable storage medium having a computer program or instructions stored thereon, which, when executed by a processor, implement the steps of the above-described method.

[0016] The fifth aspect of this disclosure also provides a computer program product, including a computer program or instructions that, when executed by a processor, implement the steps of the above-described method.

[0017] According to embodiments of this disclosure, the target storage unit of an external storage device is mapped to a server via Fibre Channel, thereby enabling online access to the external storage device. During storage service switching, the online switching of the access path ensures that the server and the target business system remain unaware of the changes during the switching process, allowing business operations to continue normally. Online switching of the access path effectively reduces data incompleteness issues caused by data interruptions, while ensuring business continuity. Since business continuity is unaffected, there is no need to invest significant time in coordination and data migration when switching storage services, effectively improving the efficiency of service switching. Attached Figure Description

[0018] The foregoing contents, as well as other objects, features, and advantages of this disclosure, will become clearer from the following description of embodiments with reference to the accompanying drawings, in which:

[0019] Figure 1The illustrations depict application scenarios of data storage methods, apparatuses, devices, media, and program products according to embodiments of the present disclosure.

[0020] Figure 2 A flowchart illustrating a data storage method according to an embodiment of the present disclosure is shown schematically.

[0021] Figure 3 This diagram illustrates the connection between a server and an external storage device in a data storage method according to an embodiment of the present disclosure.

[0022] Figure 4 This illustration schematically shows a data interaction diagram in a data storage method according to an embodiment of the present disclosure;

[0023] Figure 5 A flowchart illustrating a data storage method according to another embodiment of the present disclosure is shown schematically;

[0024] Figure 6 A schematic block diagram of a data storage device according to an embodiment of the present disclosure is shown; and

[0025] Figure 7 A block diagram schematically illustrates an electronic device suitable for implementing a data storage method according to an embodiment of the present disclosure. Detailed Implementation

[0026] The embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.

[0027] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0028] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0029] When using expressions such as "at least one of A, B and C", they should generally be interpreted in accordance with the meaning that is commonly understood by those skilled in the art (e.g., "a system having at least one of A, B and C" should include, but is not limited to, a system having A alone, a system having B alone, a system having C alone, a system having A and B, a system having A and C, a system having B and C, and / or a system having A, B and C, etc.).

[0030] In the technical solution disclosed herein, the user information (including but not limited to user personal information, user image information, user device information, such as location information) and data (including but not limited to data used for analysis, stored data, and displayed data) involved are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of related data all comply with relevant laws, regulations, and standards, necessary confidentiality measures have been taken, and they do not violate public order and good morals. Corresponding operation entry points are provided for users to choose to authorize or refuse.

[0031] Virtualization technology is being used more and more widely. By abstracting and virtualizing physical resources, it can improve resource utilization, flexibility, and manageability. Heterogeneous virtualization refers to the ability to run on different architectures and types of physical hardware. This means that in a data center, virtual machines based on different CPU (processor) architectures can run simultaneously without worrying about compatibility issues.

[0032] The current storage environment is becoming increasingly complex. The diversity of storage devices increases the difficulty and cost of maintenance and management. Heterogeneous virtualization can logically abstract storage, eliminating the differences between different types of storage resources and enabling resource consolidation.

[0033] In an open systems environment, each host system has its own storage resources, and administrators for each system need to control the allocation, use, and management of these resources for each system. Furthermore, each server has its own separately configured and managed file system. However, in current storage environments, the capacity utilization rate of open systems is only 40% to 50%, and this low utilization rate necessitates significant additional costs to meet storage expansion demands.

[0034] Therefore, with the continuous development of storage technology, heterogeneous virtualization technology has stood out among many technologies. Heterogeneous virtualization is a function that logically integrates and utilizes storage resources of different types. In a virtual storage environment, storage becomes transparent to the user. Users do not need to care about the differences in function, capacity, device type, or manufacturer of storage devices; all devices will be managed uniformly and given unified functions such as local replication and remote replication.

[0035] When virtualization technology is applied to storage services, if advanced data services on external storage are needed, the application server accessing the storage needs to be connected to the external storage. This allows the application server to indirectly access data on the original storage by accessing the external storage. Related technologies first establish a heterogeneous connection between the external storage and the original system, then stop the application server's operations. Next, the application server is disconnected from the original system, and then reconnected to the external storage. This heterogeneous takeover solution is an offline takeover, which will temporarily interrupt user services.

[0036] Embodiments of this disclosure provide a data storage method, apparatus, device, medium, and program product. The method includes: in response to a received storage service switching instruction, mapping a target storage unit obtained by scanning an external storage device using a Fibre Channel connecting the server and the external storage device to the server; if it is determined that the target storage unit needs to accept online access from a target business system, creating an access path in the server that enables online access to the target storage unit based on the identifier of the target storage unit; distributing the access path to the target business system to replace historical paths associated with local storage in the server; and storing data generated by the target business system during business operations in the target storage unit based on the access path.

[0037] Figure 1 The illustration schematically depicts application scenarios of data storage methods, apparatus, devices, media, and program products according to embodiments of the present disclosure.

[0038] like Figure 1 As shown, application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 serves as a medium for providing a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.

[0039] Users can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 via the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social media platform software, etc. (for example only).

[0040] The first terminal device 101, the second terminal device 102, and the third terminal device 103 can be various electronic devices with displays and support web browsing, including but not limited to smartphones, tablets, laptops, and desktop computers.

[0041] Server 105 can be a server that provides various services, such as a backend management server that supports websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103 (this is just an example). The backend management server can analyze and process data such as received user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal devices.

[0042] It should be noted that the data storage method provided in this embodiment can generally be executed by server 105. Correspondingly, the data storage device provided in this embodiment can generally be located in server 105. The data storage method provided in this embodiment can also be executed by a server or server cluster that is different from server 105 and capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and / or server 105. Correspondingly, the data storage device provided in this embodiment can also be located in a server or server cluster that is different from server 105 and capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and / or server 105.

[0043] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0044] The following will be based on Figure 1 The described scene, through Figures 2-6 The data storage method of the disclosed embodiments will be described in detail.

[0045] Figure 2 A flowchart illustrating a data storage method according to an embodiment of the present disclosure is shown schematically.

[0046] like Figure 2 As shown, the data storage method includes operations S210 to S240.

[0047] In operation S210, in response to the received storage service switching command, the target storage unit obtained by scanning the external storage device using the Fibre Channel that connects the server and the external storage device is mapped to the server.

[0048] In operation S220, if it is determined that the target storage unit needs to accept online access from the target business system, an access path that enables online access to the target storage unit is created in the server based on the identifier of the target storage unit.

[0049] In operation S230, the access path is sent to the target business system to replace the historical path associated with the local storage in the server.

[0050] In operation S240, the data generated by the target business system when performing business is stored in the target storage unit based on the access path.

[0051] According to embodiments of this disclosure, when it is determined that the server's storage capacity is insufficient and a switch to a storage service is necessary, in response to a received storage service switch command, a scan of the external storage device is performed using the Fibre Channel connecting the server and the external storage device. The Fibre Channel is established when the external storage device is connected, specifically as an FCSAN network (Fibre Channel Storage Area Network). After the Fibre Channel is established, the external storage device is added to the server's data center to change the network topology. By dividing the network into zones, the ports of the external storage device and the server's local storage are grouped into the same zone, thereby enabling communication between them.

[0052] According to embodiments of this disclosure, external storage devices are storage devices independent of servers, such as disk arrays and tape libraries. A storage unit is the smallest unit capable of independently storing and managing data; external storage devices are divided into multiple storage units as the basis for data management. If available or idle storage units exist within an external storage device, they can be discovered via Fibre Channel.

[0053] Figure 3 The diagram illustrates the connection between the server and the external storage device in a data storage method according to an embodiment of the present disclosure.

[0054] like Figure 3 As shown, server 310 and external storage device 320 establish a fiber optic channel via fiber optic switch 330. Server 310 can transmit data with external storage device 320 through the fiber optic channel. External storage device 320 contains multiple storage units, and server 310 can scan for target storage units in external storage device 320 via the fiber optic channel to switch between storage services.

[0055] According to embodiments of this disclosure, target storage units obtained from scanning external storage devices are mapped to a server. The mapping operation represents establishing a logical association between the server and the target storage unit. Through mapping, the server can treat the target storage unit as a usable storage resource. The server can perform data reading, writing, storage, and management operations on the mapped target storage unit, thereby realizing data interaction and resource sharing between the server and the external storage device. This mapping mechanism effectively improves the utilization and flexibility of storage resources, enabling the server to use the space of the external storage device according to actual needs.

[0056] According to embodiments of this disclosure, online access confirmation of the target storage unit specifically involves determining whether the target storage unit needs to accept online access from the target business system. This can be evaluated from multiple perspectives. From a business needs perspective, business functions and business analysis processes can be clearly defined. If the business has high requirements for data real-time performance and process continuity, then online access is determined to be necessary. From a system compatibility perspective, data format matching and interface protocol compatibility can be checked. If it is found that data synchronization technology is needed to ensure data stability and consistency during data storage, then online access to the target storage unit is also determined to be necessary.

[0057] According to embodiments of this disclosure, when it is determined that the target storage unit needs to be accessed online by the target business system, an identifier for the target storage unit is determined. The identifier is a unique identification code corresponding to the target storage unit, specifically a UUID (Universally Unique Identifier). The identifier of the target storage unit is reported to the server so that an access path enabling online access to the target storage unit is created on the server.

[0058] According to embodiments of this disclosure, since the original historical path of the target business system is associated with local storage, the target business system can store data generated during business execution in local storage based on the historical path. After the access path is distributed to the target business system, the access path replaces the historical path, thereby achieving online takeover of data storage without interrupting the business execution of the target business system. After the data takeover is completed, the data generated by the target business system during business execution is stored in the target storage unit based on the access path.

[0059] Figure 4 The illustration shows a schematic diagram of data interaction in a data storage method according to an embodiment of the present disclosure.

[0060] like Figure 4 As shown, the data storage method includes operations S410 to S450.

[0061] Operation S410 establishes the Fibre Channel. Operation S420 maps the target storage unit. Operation S430 generates the access path. Operation S440 transmits service data. Operation S450 stores the data in the target storage unit.

[0062] According to embodiments of this disclosure, a Fibre Channel is established between the server and an external storage device to scan for target storage units on the external storage device. After a target storage unit is detected, it is mapped to the server. The server generates a corresponding access path based on the mapped target storage unit. The target business system can send business data generated during business operations to the server, which then stores the business data in the target storage unit of the external storage device based on the access path.

[0063] According to embodiments of this disclosure, the interaction between the server and the external storage device can be controlled by a third party. The target business system can be deployed and executed on the server, or on other distributed connected servers; this is not limited thereto.

[0064] According to embodiments of this disclosure, the target storage unit of an external storage device is mapped to a server via a Fibre Channel, thereby enabling online access to the external storage device. During storage service switching, the online switching of the access path ensures that the server and the target business system remain unaware of the changes during the switching process, allowing business operations to continue normally. Online switching of the access path effectively reduces data incompleteness issues caused by data interruptions, while ensuring business continuity. Since business continuity is unaffected, there is no need to invest significant time in coordination and data migration when switching storage services, effectively improving the efficiency of service switching.

[0065] According to embodiments of this disclosure, the target storage unit is a storage unit that meets preset storage requirements. The preset storage requirements are set based on the data growth trend of the target business system. The target storage unit obtained by scanning the external storage device using the Fibre Channel connecting the server and the external storage device is mapped to the server. This includes: binding the node identifier of the target storage unit to the Fibre Channel port of the server to obtain a binding result; generating a mapping task based on the link mapping parameters between the server and the target storage unit in the binding result; and executing the mapping task to map the target storage unit to the server through the Fibre Channel.

[0066] According to embodiments of this disclosure, the scanning of target storage units is performed based on preset storage requirements. These preset storage requirements are set based on the data growth trend of the target business system. Furthermore, the preset storage requirements can also be set based on the future number of new business transactions in the target business system and the characteristics of the business data.

[0067] According to embodiments of this disclosure, after determining the target storage unit, the node identifier of the server's Fibre Channel port is obtained. Specifically, the node identifier is WWPN (World Wide Port Name). The target storage unit is bound to the node identifier of the Fibre Channel port to obtain a binding result. The binding result includes link mapping parameters between the server and the target storage unit, as well as the protocol used for the connection, port number, address, device identifier, connection bandwidth, connection status, and related authentication information.

[0068] According to embodiments of this disclosure, a mapping task is generated based on the information in the binding result, and the mapping task is executed. The mapping task includes multiple mapping execution flows, specifically including task initiation conditions, execution order, data transmission steps, etc. The target storage unit is mapped to the server via Fibre Channel, enabling online access to the external storage device.

[0069] According to embodiments of this disclosure, creating an access path in a server that enables online access to the target storage unit based on the identifier of the target storage unit includes: importing the target storage unit into a storage pool of the server, wherein the storage pool is used for resource allocation of multiple storage units; reporting the identifier of the target storage unit to the server to create multiple access paths corresponding to the identifier in the server, wherein the multiple access paths can be switched between each other, and the server can call the corresponding storage unit from the storage pool based on the access path.

[0070] According to embodiments of this disclosure, a target storage unit is imported into a server's storage pool. During the import process, the target storage unit can be scanned and discovered through the server's storage management interface, and then added to the storage pool as prompted. A storage pool is a technology that integrates the storage space of multiple storage units to form a unified storage resource pool, enabling centralized management and flexible allocation of storage resources.

[0071] According to embodiments of this disclosure, since a storage pool may contain multiple storage units, the server needs to accurately identify the target storage unit using a unique identifier. Therefore, reporting the identifier of the target storage unit to the server allows the server to accurately identify and locate the target storage unit, avoiding data confusion and effectively improving the efficiency of data retrieval and access.

[0072] According to embodiments of this disclosure, when constructing an access path, the server combines the reported target storage unit identifier with the base path. This identifier can be the target storage unit's number, name, or other unique identification information. Adding it to the base path generates a more specific and unique access path. Through this access path, the server can directly call the target storage unit from the storage pool.

[0073] According to embodiments of this disclosure, in a distributed system, to reduce data redundancy and risks caused by storing data in a single location, data is typically distributed and stored in different data centers or storage areas. Servers create corresponding access paths in each different data center based on identifiers, and multiple access paths can switch between each other. If a data center fails, the server can quickly switch to an access path in another data center, thereby improving data reliability and availability.

[0074] According to embodiments of this disclosure, the data storage method further includes: creating a temporary storage pool that matches the target storage unit when it is determined that the target business system meets preset conditions when performing business, wherein the preset conditions include at least one of the following: intermediate data needs to be generated when performing business, business needs to be tested, or data generated by business needs to be isolated.

[0075] According to embodiments of this disclosure, it is determined whether the target business system meets preset conditions when performing business operations. If the preset conditions are met, it indicates that during the execution of business operations, a temporary storage pool is needed to buffer data transmission or temporarily store data to meet the current business execution requirements.

[0076] According to embodiments of this disclosure, a temporary storage pool of uniform size is created based on the logical block size of the target storage unit. The target storage unit is imported into this temporary storage pool, and multiple access paths are created on the server, enabling the server to call the target storage unit from the temporary storage pool based on the access paths. By creating a temporary pool, diverse business needs can be flexibly addressed, achieving efficient switching of storage services.

[0077] According to embodiments of this disclosure, after the temporary storage pool is created, it can be further determined whether online takeover is required based on business needs. If the business needs indicate that the temporary storage pool only needs to be used as an intermediate medium for data storage and deleted after use, then online takeover of the target storage unit is not required.

[0078] According to embodiments of this disclosure, if business requirements indicate that data needs to be temporarily stored in a temporary storage pool during business processing, or that further management is required in the temporary storage pool before the final processing result is imported into the existing storage pool, then it is determined that online takeover of the target storage unit is necessary. During the takeover process, in response to business processing, the target storage unit in the temporary storage pool can be taken over first. After the data processing in the temporary storage pool is completed, the storage resources in the temporary storage pool are imported into the existing storage pool. The existing storage pool is taken over through access path replacement. The takeover method of the target storage unit can be flexibly adjusted according to business needs, making data storage diverse and able to meet various business execution environments.

[0079] According to embodiments of this disclosure, the data storage method further includes: converting the target storage unit into a storage disk format to confirm online access to the target storage unit, wherein the storage disk can be directly accessed online; when it is determined that the target storage unit needs to accept online access from the target business system, importing the target storage unit into a storage pool as a mapped volume, wherein the target storage unit is divided into multiple mapped volumes; and assigning a corresponding logical identifier to each mapped volume in the storage pool to invoke the target storage unit based on the logical identifier.

[0080] According to embodiments of this disclosure, the target storage unit scanned using Fibre Channel is in logical volume format. Since different operating systems or storage devices may have specific requirements for storage formats, for compatibility reasons, the target storage unit needs to be converted into a storage disk format that can be directly accessed online by the target business system. If it is determined that the target storage unit needs to be accessible online by the target business system, the target storage unit is divided into multiple mapped volumes, and the target storage unit is imported into the storage pool in a mapped volume manner.

[0081] According to embodiments of this disclosure, a mapped volume is a method of logically associating or mapping a target storage unit to a virtual or logical location. The partitioning of a mapped volume can be based on different partitioning principles and storage requirements; specifically, it can be partitioned according to factors such as storage capacity, storage performance, data type, or user needs.

[0082] According to embodiments of this disclosure, after partitioning, a corresponding logical identifier is assigned to each mapped volume to facilitate the allocation and management of storage resources by the storage pool. The storage pool can allocate storage tasks and resources to different mapped volumes based on their logical identifiers, achieving more granular storage management. Furthermore, assigning corresponding logical identifiers to mapped volumes allows for different configurations and management of storage resources based on different application scenarios and user needs.

[0083] For example, a storage pool can dynamically adjust the storage allocation of a mapped volume based on its usage and storage needs, transferring storage resources from one mapped volume to another, or reallocating storage tasks to other mapped volumes when a mapped volume fails.

[0084] According to embodiments of this disclosure, importing storage units into a storage pool as mapped volumes can bring more flexible storage resource management to the storage system, meet different storage needs and user requirements, and at the same time, the storage pool can uniformly manage and optimize these mapped volumes.

[0085] According to embodiments of this disclosure, the access path is distributed to the target business system to replace the historical path associated with the local storage in the server. This includes: setting the takeover mode of the target storage unit to online takeover, wherein online takeover indicates that the target storage unit wants to take over the storage resources in the local storage online; disconnecting the target business system from the historical path; and distributing the access path to the target business system so that when the server generates an operation request based on the business needs of the target business system, the operation request is sent to the external storage device based on the access path.

[0086] According to embodiments of this disclosure, when it is determined that the target business system can access the target storage unit online, the target business system will store the generated data in the target storage unit. However, at this time, the target storage unit does not take over the local storage; the target storage unit is only a part of the server storage pool. When it is determined that the target storage unit needs to take over the local storage, the takeover mode of the target storage unit is set to online takeover to take over the storage resources in the local storage online, while retaining the cache in the target storage unit itself, allowing data to continue to be accessed.

[0087] According to embodiments of this disclosure, disconnecting the target business system from the historical path only requires deleting the historical path on the server, after which the server will reissue the access path to the target business system. Specifically, after reissuing the access path to the target business system, the server can perform data input / output operations using the port. When the server generates an operation request based on the business needs of the target business system, it can send the operation request to the external storage device based on the access path to achieve data transmission. By disconnecting the historical path and taking over the local storage online, the business execution of the target business system does not need to be interrupted during the switching of storage services, ensuring business continuity and data integrity.

[0088] According to embodiments of this disclosure, the data storage method further includes: when it is determined that a target storage unit has been scanned from an external storage device, adding the target storage unit to the server's storage pool; responding to a received operation request, processing storage resources in the storage pool according to an operation means corresponding to the operation request, wherein the operation means include read operations and write operations, and wherein the operation request is generated by the server based on the business needs of the target business system; when it is determined that the target storage unit does not need to accept online access from the target business system, maintaining the storage resource allocation method between the storage pool and the target storage unit, wherein the storage resource allocation method is to allocate resources according to the storage capacity of the local storage and the target storage unit; when it is determined that the target storage unit needs to accept online access from the target business system, and the target storage unit has taken over the local storage online, migrating historical resources in the local storage to the target storage unit online; and changing the storage resource allocation method to allocate resources only according to the storage capacity of the target storage unit.

[0089] According to embodiments of this disclosure, when the server scans for a target storage unit via Fibre Channel, it first imports the data into the server's storage pool for data storage. In response to received operation requests, the server processes the storage resources in the storage pool to transmit data via read and write operations. If it is determined that the target storage unit will not subsequently require online access from the target business system, then the target storage unit's function is merely to expand the local storage capacity. Therefore, the server allocates resources to the storage pool based on the storage capacity of the local storage and the target storage unit.

[0090] According to embodiments of this disclosure, if it is determined that the target storage unit will subsequently require online access from the target business system, then the current storage service needs to be switched. The current storage service can no longer meet the target business system's requirements for read / write speed and concurrent processing capabilities, which will lead to system malfunction. Therefore, the target storage unit needs to take over the local storage online.

[0091] According to embodiments of this disclosure, after the target storage unit has taken over the local storage online, if it is determined, based on the characteristics of the service, that historical resources in the local storage need to be migrated online to the target storage unit, a migration task can be added. After the migration is complete, the local storage is released. If the historical resources will not affect the subsequent operation of the service, they can also be discarded. The operation of the service will not be affected during the resource migration process.

[0092] According to embodiments of this disclosure, after determining that the target storage unit has taken over the local memory online, the storage resource allocation method is changed to allocate resources solely based on the storage capacity of the target storage unit. The local memory has been released and does not need to be referenced. Configuring corresponding storage resource allocation methods to meet different storage needs effectively improves the utilization rate of storage resources and makes resource allocation more flexible.

[0093] Figure 5 A flowchart illustrating a data storage method according to another embodiment of the present disclosure is shown schematically.

[0094] like Figure 5 As shown, the data storage method includes operations S501 to S513.

[0095] In step S501, establish a Fibre Channel. In step S502, map the target storage unit to the server. In step S503, convert the target storage unit to a storage disk format. In step S504, determine if the target storage unit needs to accept online access. In step S505, add the target storage unit to the server's storage pool.

[0096] According to embodiments of this disclosure, a target storage unit of an external storage device is mapped to a server via a Fibre Channel, enabling online access to the external storage device. The target storage unit is converted to meet compatibility requirements during online verification. If the target storage unit does not require online access, it can be directly used to expand the server's storage pool, thereby meeting data storage needs and effectively improving storage management efficiency.

[0097] In operation S506, determine whether the business execution meets the preset conditions. In operation S507, create a temporary storage pool. In operation S508, import the target storage unit into the storage pool as a mapped volume. In operation S509, set the takeover mode of the target storage unit to online takeover. In operation S510, issue the access path to the target business system. In operation S511, disconnect the historical path associated with the local storage in the server.

[0098] According to embodiments of this disclosure, by creating a temporary pool, diverse business needs can be flexibly addressed, enabling efficient switching of storage services. Importing storage units into the storage pool as mapped volumes provides more flexible storage resource management for the storage system. By disconnecting historical paths and taking over local storage online, the business execution of the target business system can be maintained without interrupting the switching of storage services, ensuring business continuity and data integrity.

[0099] In operation S512, historical resources in local memory are migrated online to the target storage unit. In operation S513, local memory is released.

[0100] According to embodiments of this disclosure, by migrating historical resources online, the integrity of data in the target storage unit can be guaranteed, and the online migration will not affect the operation of the business, effectively improving the data migration efficiency.

[0101] Based on the above data storage method, this disclosure also provides a data storage device. The following will be combined with... Figure 6 The device is described in detail.

[0102] Figure 6 A schematic block diagram of a data storage device according to an embodiment of the present disclosure is shown.

[0103] like Figure 6 As shown, the data storage device 600 in this embodiment includes a storage mapping module 610, a path creation module 620, a path distribution module 630, and a data storage module 640.

[0104] The storage mapping module 610, in response to a received storage service switching command, maps the target storage unit obtained by scanning the external storage device using the Fibre Channel connecting the server and the external storage device to the server. In one embodiment, the storage mapping module 610 can be used to perform the operation S210 described above, which will not be repeated here.

[0105] The path creation module 620, when determining that the target storage unit needs to be accessed online by the target business system, creates an access path in the server that enables online access to the target storage unit based on the identifier of the target storage unit. In one embodiment, the path creation module 620 can be used to perform the operation S220 described above, which will not be repeated here.

[0106] The path distribution module 630 is used to distribute the access path to the target business system in order to replace the historical path associated with the local storage in the server. In one embodiment, the path distribution module 630 can be used to perform the operation S230 described above, which will not be repeated here.

[0107] The data storage module 640 is used to store data generated by the target business system during business execution into the target storage unit based on the access path. In one embodiment, the data storage module 640 can be used to perform the operation S240 described above, which will not be repeated here.

[0108] According to embodiments of this disclosure, the storage mapping module 610 includes an identifier binding submodule, a task generation submodule, and a task execution submodule.

[0109] The identifier binding submodule is used to bind the target storage unit to the node identifier of the server's Fibre Channel port to obtain the binding result.

[0110] The task generation submodule is used to generate mapping tasks based on the link mapping parameters between the server and the target storage unit in the binding result.

[0111] The task execution submodule is used to execute mapping tasks to map target storage units to the server via Fibre Channel.

[0112] According to embodiments of this disclosure, the path creation module 620 includes a storage import submodule and an identifier reporting submodule.

[0113] The storage import submodule is used to import target storage units into the server's storage pool, where the storage pool is used to allocate resources among multiple storage units.

[0114] The identifier reporting submodule is used to report the identifier of the target storage unit to the server, so as to create multiple access paths corresponding to the identifier in the server. The multiple access paths can switch between each other, and the server can call the corresponding storage unit from the storage pool based on the access path.

[0115] According to embodiments of this disclosure, the data storage device 600 further includes a storage creation module.

[0116] The storage creation module is used to create a temporary storage pool that matches the target storage unit when the target business system meets preset conditions during business execution. The preset conditions include at least one of the following: intermediate data needs to be generated during business execution, business needs to be tested, or the data generated by the business needs to be isolated.

[0117] According to embodiments of this disclosure, the data storage device 600 further includes a format conversion module, a mapping import module, and an identifier allocation module.

[0118] The format conversion module is used to convert the target storage unit into the format of a storage disk so that the target storage unit can be accessed online. The storage disk can be directly accessed online.

[0119] The mapping import module is used to import the target storage unit into the storage pool as a mapped volume when it is determined that the target storage unit needs to be accessed online by the target business system. The target storage unit is divided into multiple mapped volumes.

[0120] The identifier allocation module is used to assign a corresponding logical identifier to each mapped volume in the storage pool, so as to call the target storage unit based on the logical identifier.

[0121] According to embodiments of this disclosure, the path distribution module 630 includes a takeover setting submodule, a path disconnection submodule, and a path distribution submodule.

[0122] The takeover settings submodule is used to set the takeover mode of the target storage unit to online takeover. Online takeover indicates that the target storage unit wants to take over the storage resources in the local memory online.

[0123] The Path Disconnection submodule is used to disconnect the target business system from the historical path.

[0124] The path distribution submodule is used to distribute the access path to the target business system, so that when the server generates an operation request based on the business needs of the target business system, the operation request is sent to the external storage device based on the access path.

[0125] According to embodiments of this disclosure, the data storage device 600 further includes a storage addition module, a resource processing module, an allocation and maintenance module, a resource migration module, and an allocation and modification module.

[0126] The storage addition module is used to add the target storage unit to the server's storage pool when it is determined that the target storage unit has been scanned from an external storage device.

[0127] The resource processing module is used to respond to received operation requests and process the storage resources in the storage pool according to the operation methods corresponding to the operation requests. The operation methods include read operations and write operations. The operation requests are generated by the server based on the business requirements of the target business system.

[0128] The allocation and maintenance module is used to maintain the storage resource allocation method between the storage pool and the target storage unit when it is determined that the target storage unit does not need to accept online access from the target business system. The storage resource allocation method is to allocate resources according to the storage capacity of the local storage and the target storage unit.

[0129] The resource migration module is used to migrate historical resources from the local storage to the target storage unit online when it is determined that the target storage unit needs to accept online access from the target business system and the target storage unit has already taken over the local storage online.

[0130] The allocation change module is used to change the storage resource allocation method to allocate resources only based on the storage capacity of the target storage unit.

[0131] According to embodiments of this disclosure, any plurality of modules among the storage mapping module 610, path creation module 620, path distribution module 630, and data storage module 640 may be combined into one module, or any one of these modules may be split into multiple modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of other modules and implemented in one module. According to embodiments of this disclosure, at least one of the storage mapping module 610, path creation module 620, path distribution module 630, and data storage module 640 may be at least partially implemented as hardware circuitry, such as a field-programmable gate array (FPGA), a programmable logic array (PLA), a system-on-a-chip, a system-on-a-substrate, a system-on-package, an application-specific integrated circuit (ASIC), or any other reasonable means of integrating or packaging circuitry, or implemented in hardware or firmware, or in any one of software, hardware, and firmware implementations, or in a suitable combination of any of these. Alternatively, at least one of the storage mapping module 610, path creation module 620, path distribution module 630, and data storage module 640 may be implemented at least partially as a computer program module, which can perform corresponding functions when the computer program module is run.

[0132] Figure 7 A block diagram schematically illustrates an electronic device suitable for implementing a data storage method according to an embodiment of the present disclosure.

[0133] like Figure 7 As shown, an electronic device 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage portion 708 into a random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include onboard memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0134] RAM 703 stores various programs and data required for the operation of electronic device 700. Processor 701, ROM 702, and RAM 703 are interconnected via bus 704. Processor 701 performs various operations of the method flow according to embodiments of the present disclosure by executing programs in ROM 702 and / or RAM 703. It should be noted that programs may also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 may also perform various operations of the method flow according to embodiments of the present disclosure by executing programs stored in one or more memories.

[0135] According to embodiments of this disclosure, the electronic device 700 may further include an input / output (I / O) interface 705, which is also connected to a bus 704. The electronic device 700 may also include one or more of the following components connected to the input / output (I / O) interface 705: an input section 706 including a keyboard, mouse, etc.; an output section 707 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the input / output (I / O) interface 705 as needed. A removable medium 711, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 710 as needed so that computer programs read from it can be installed into the storage section 708 as needed.

[0136] This disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs that, when executed, implement the method according to the embodiments of this disclosure.

[0137] According to embodiments of this disclosure, the computer-readable storage medium can be a non-volatile computer-readable storage medium, such as including, but not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to embodiments of this disclosure, the computer-readable storage medium may include ROM 702 and / or RAM 703 and / or one or more memories other than ROM 702 and RAM 703 described above.

[0138] Embodiments of this disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowchart. When the computer program product is run on a computer system, the program code is used to cause the computer system to implement the methods provided in the embodiments of this disclosure.

[0139] When the computer program is executed by the processor 701, it performs the functions defined in the system / apparatus of this disclosure embodiments. According to embodiments of this disclosure, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0140] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of signals over a network medium, and may be downloaded and installed via the communication section 709, and / or installed from a removable medium 711. The program code contained in the computer program can be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination thereof.

[0141] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, it performs the functions defined in the system of this disclosure embodiment. According to embodiments of this disclosure, the systems, devices, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0142] According to embodiments of this disclosure, program code for executing the computer programs provided in embodiments of this disclosure can be written in any combination of one or more programming languages. Specifically, these computational programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C", or similar programming languages. The program code can execute entirely on a user's computing device, partially on a user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0143] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0144] Those skilled in the art will understand that the features described in the various embodiments of this disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in this disclosure. In particular, the features described in the various embodiments of this disclosure can be combined and / or combined in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0145] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.

Claims

1. A data storage method, characterized in that, The method includes: In response to a received storage service switching command, the target storage unit obtained by scanning the external storage device using the Fibre Channel connecting the server and the external storage device will be mapped to the server by binding the node identifier of the target storage unit and the Fibre Channel port of the server. If it is determined that the target storage unit needs to be accessed online by the target business system, the identifier of the target storage unit is reported to the server so as to create multiple access paths in the server that can access the target storage unit online, wherein the multiple access paths can switch between each other; The access path is distributed to the target business system to replace the historical path associated with the local storage in the server; When the server generates an operation request based on the business needs of the target business system, it sends the operation request to the external storage device based on the access path. The data generated by the target business system when performing business operations is stored in the target storage unit based on the access path.

2. The method according to claim 1, characterized in that, The target storage unit is a storage unit that meets preset storage requirements, which are set based on the data growth trend of the target business system. The process of scanning the external storage device using the Fibre Channel connecting the server and the external storage device to obtain the target storage unit, and mapping it to the server by binding the node identifier of the Fibre Channel port of the target storage unit to the server, includes: The target storage unit is bound to the node identifier of the Fibre Channel port of the server to obtain the binding result; Based on the link mapping parameters between the server and the target storage unit in the binding result, a mapping task is generated; The mapping task is executed to map the target storage unit to the server via the Fibre Channel.

3. The method according to claim 1, characterized in that, The method further includes: The target storage unit is imported into the server's storage pool, wherein the storage pool is used to allocate resources to multiple storage units; The server can retrieve the corresponding storage unit from the storage pool based on the access path.

4. The method according to claim 3, characterized in that, The method further includes: If the target business system meets preset conditions when executing business, a temporary storage pool matching the target storage unit is created. The preset conditions include at least one of the following: intermediate data needs to be generated when executing the business, the business needs to be tested, or the data generated by the business needs to be isolated.

5. The method according to claim 4, characterized in that, The method further includes: The target storage unit is converted into a storage disk format to enable online access confirmation of the target storage unit, wherein the storage disk can be directly accessed online; If it is determined that the target storage unit needs to accept online access from the target business system, the target storage unit is imported into the storage pool as a mapped volume, wherein the target storage unit is divided into multiple mapped volumes; In the storage pool, a corresponding logical identifier is assigned to each of the mapped volumes so that the target storage unit can be invoked based on the logical identifier.

6. The method according to claim 1, characterized in that, The step of distributing the access path to the target business system to replace the historical path associated with the local storage in the server includes: The takeover mode of the target storage unit is set to online takeover, wherein the online takeover indicates that the target storage unit wants to take over the storage resources in the local memory online; Disconnect the target business system from the historical path.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: If the target storage unit is found in the external storage device, the target storage unit is added to the server's storage pool. In response to a received operation request, the storage resources in the storage pool are processed according to the operation means corresponding to the operation request, wherein the operation means include read operations and write operations, and wherein the operation request is generated by the server based on the business requirements of the target business system; If it is determined that the target storage unit does not need to accept online access from the target business system, the storage resource allocation method between the storage pool and the target storage unit is maintained, wherein the storage resource allocation method is to allocate resources according to the storage capacity of the local memory and the target storage unit; If it is determined that the target storage unit needs to accept online access from the target business system, and the target storage unit has already taken over the local storage online, the historical resources in the local storage will be migrated online to the target storage unit. The storage resource allocation method is changed to allocate resources only based on the storage capacity of the target storage unit.

8. A data storage device, characterized in that, The device includes: The storage mapping module is used to respond to a received storage service switching command by mapping the target storage unit obtained by scanning the external storage device using the Fibre Channel that connects the server and the external storage device to the server by binding the node identifier of the target storage unit and the Fibre Channel port of the server. The path creation module is used to report the identifier of the target storage unit to the server when it is determined that the target storage unit needs to be accessed online by the target business system, so as to create multiple access paths in the server that enable online access to the target storage unit, wherein the multiple access paths can be switched between each other; The path distribution module is used to distribute the access path to the target business system in order to replace the historical path associated with the local storage in the server; The device is further configured to, when the server generates an operation request based on the business needs of the target business system, send the operation request to the external storage device based on the access path. The data storage module is used to store the data generated by the target business system when performing business operations to the target storage unit based on the access path.

9. An electronic device, comprising: one or more processors; Memory, used to store one or more computer programs. The characteristic feature is that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program or instructions stored thereon, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 7.

Images