DISTRIBUTED GLOBAL OBJECT STORAGE

Abstract

Several embodiments of the present application establish a computer-implemented method for accessing data comprising receiving, through a first storage controller in a first peer network and from an entity remote from the first peer network, a message identifying a first content item, wherein the first content item is identified based on a task to be executed having access to the first content item, determining, through the first storage controller, a first storage partition that stores the first content item, wherein the first storage partition is included in a tiered group of storage partitions accessible by the first peer network, retrieving, through the first storage controller from the first storage partition, the first content item, and causing,through the first storage controller, the first content element is transmitted to a second peer network for storage in a second storage partition accessible by the second peer network.

Description

DISTRIBUTED GLOBAL OBJECT STORAGE FIELD OF INVENTION The modalities of this disclosure generally refer to distributed computing systems and, more specifically, to distributed global object storage. BACKGROUND OF THE INVENTION Distributed computing systems include many different hardware and software components that operate to provide a variety of services to clients of the distributed computing systems. For example, a distributed computing system running video production services could provide diverse, geographically dispersed users with the ability to collaborate by generating and modifying various media assets that are combined to form an audiovisual program. In many cases, due to disparate filming and editing locations, a given media asset may need to be physically transported between users. In such cases, storage latency associated with the physical transport of a given media asset through a collaborative user pipeline can result in significant latency before the media asset is finalized. Furthermore, various security measures are required for the safe physical transport of the media asset across diverse geographical locations. Due to the complexities and latencies associated with the physical transport of media assets, many users employ providers to transfer content to a single repository. However, these users may still require the physical transport of the media asset before the provider can transfer the media object to the single repository. Additionally, because each provider may use different storage and file transfer systems, media assets may be transferred to the repository inefficiently or insecurely. As illustrated, what is required in the technique is a more effective system for storing and distributing data associated with a media element in order to efficiently strengthen collaboration among multiple users. BRIEF DESCRIPTION OF THE INVENTION Several modalities of the present application establish a computer-implemented method for accessing data comprising receiving, through a first storage controller in a first peer network and from a remote entity to the first peer network, a message identifying a first content item, wherein the first content item is identified based on a task to be executed having access to the first content item, determining, through the first b? QC Ln / Lznz / E / YILI Figure 3 establishes a method flowchart for storing a content item within a storage division of the network infrastructure of Figure 1A, according to the various modalities. Figure 4 establishes a method flowchart for transferring a content item between storage divisions of the network infrastructure of Figure 1A, according to the various modalities. DETAILED DESCRIPTION OF THE INVENTION The following description sets forth numerous specific details to provide a more complete understanding of the methods described in this disclosure. However, it will be apparent to those skilled in the art that the methods described in this disclosure can be practiced without one or more of these specific details. Overview Distributed computing systems include many different hardware and software components that operate to provide a variety of services to clients of the distributed computing system. For example, a distributed computing system running video production services might provide multiple users with the ability to upload and modify various portions of video files to produce an audiovisual program. In many cases, contributors to an audiovisual program are geographically dispersed, often across multiple continents. Furthermore, parts of the production studio may be geographically dispersed, such as when video is shot on location and physically transported to a specific production location to upload various content elements to a single content hub.Content items can then be distributed from the centralized content hub to various destinations. Previous techniques required each studio production to independently find solutions for sharing content between contributors. For example, some contributors would physically transport content items between contributors, such as using production assistants to carry physical hard drives containing content between vendors. In another example, contributors would send content items to third-party vendors who would manage the transfer of the content items to a centralized content hub. However, these techniques dramatically increased the latency associated with transporting content items between multiple users. This latency consequently resulted in a significant increase in the time required to complete a production workflow for an audiovisual program.Furthermore, the use of disparate vendors leads to various security and efficiency problems associated with different vendors being used. QC Ln / Lznz / E / YILI uses different technologies and archiving systems to transfer files. Furthermore, until the content items are finally uploaded to the centralized content hub, there is no way to efficiently index content items while they are being produced and modified locally. In contrast, the disclosed network and associated disclosed techniques allow a distributed global object storage system to securely ingest, index, and transfer portions of content items between disparate locations. The global object storage system can then provide a tiered storage system that tracks the location of multiple content items as they are added to the system. Furthermore, the global object storage system can efficiently transfer multiple portions of content items to local networks, increasing the efficiency of content transfer to geographically local networks as latency between transfers decreases. In various configurations, the distributed global object storage system includes several tiers of storage spread across a network of hub units and multiple geographically distributed peer networks. Each network contains one or more storage partitions that can store portions of various content items as objects. When a contributor creates a new content item on a local peer network, a storage controller within that local peer network determines an applicable storage partition to store the content item. The storage controller then causes the content item to be written to and stored in the appropriate local storage partition.Once stored, the storage controller sends a message to the hub network identifying the content item's storage location within the local peer network. The hub network then indexes the content item's location, along with other information about the content item. In some configurations, the network of concentrator units includes a media orchestrator that receives information about the location of portions of various content items, as well as workflow information associated with those content items. Based on the information received, the media orchestrator determines a scheduled task that requires a particular portion of a content item and the location where the scheduled task will run. The media orchestrator communicates with several storage controllers, including a storage controller on the local network that is currently storing the portion of the content item and the storage controller on the target local network where the scheduled task will run. QC Ln / Lznz / E / YILI The media orchestrator sends commands to both storage controllers to schedule the transfer of content item portions to the desired location in the target local network's storage plane, where the transfer will be conducted over a period of time that allows the scheduled task to be executed on time. The applicable storage controllers then cause the content item portions to be moved to a storage slice associated with the target local network.In several scenarios, to increase efficiency during task execution, the selected storage partition where the content item is stored is a tiered storage partition that enables high-speed transfers between the storage partition and the location where the scheduled task will run (for example, the storage partition is physically close to the workstation used to run the scheduled task). Therefore, the latency associated with accessing the content item from the new storage partition, as opposed to the previous storage partition (for example, a storage partition in a more distant location), is reduced. Conveniently, a storage controller within a given network can efficiently transfer, store, and retrieve portions of stored objects so that applications operating within that network can efficiently access and modify those portions. As discussed earlier, conventional content aggregators do not effectively index portions of content items as content items are added or modified, nor do conventional content aggregator systems efficiently transfer portions of content items between local networks within a given network infrastructure.As a result, contributors in different geographical locations have difficulty efficiently performing tasks that require access to portions of a particular content item, due to factors such as waiting to access the content item, as well as the latency associated with accessing the content item from long distances. In contrast, a distributed storage network using disclosed storage controllers efficiently stores portions of content items in local storage and transfers those portions to other local networks in a way that allows contributors to efficiently execute tasks due to reductions in wait times and latency. Furthermore, a distributed storage network using disclosed storage controllers to manage a group of storage shards allows it to efficiently scale local storage capacity based on various parameters, including storage parameters and flow parameters. QC Ln / Lznz / E / YILI of work, and costs associated with users performing tasks using resources within the distributed computing system. Overview of the distributed global object storage system Figure 1A illustrates a network infrastructure used to transfer media content to one or more peer networks, according to various modalities of this disclosure. As shown, the network infrastructure 100 includes, without limitation, a concentrator unit network 110 and peer networks 140 (for example, 140(1)-140(4)). The concentrator unit network 110 and the partner networks 140 include the control plane 120 and the storage plane 130 respectively. The concentrator unit network 110 includes the security module 105, the media controller 107, and the secure object storage 115. Each partner network 140 includes at least one storage controller (for example, 121(1)-121(5)), and a tiered storage group 136 that includes at least one remote storage split (for example, 132(1)-132(7)) and at least one on-premises storage split (for example, 134(1)-134(7)).Each peer network 140 is connected to the concentrator unit network 110 via one or more media channels configured to carry large files and objects, and / or communication channels for transmitting messages between components. In operation, the media controller 107 coordinates with one or more storage controllers 121 (for example, storage controllers 121(4) in peer network 140(3)) in a particular peer network 140 to cause a secure transfer of one or more portions of a content item between storage divisions, such as a transfer of a first portion of a content item from remote storage division 132(6) to secure object storage 115 in the concentrator unit network 110, or alternatively, to on-premises storage division 134(4) in peer network 140(2).In several modes, the media controller 107 can communicate with the security module 105 to encrypt portions of content elements and allow the secure transfer of the encrypted portions between components. In several modalities, a content item can be a media asset, media asset metadata, and / or other data associated with digital media. In some modalities, the content item can be a portion of a single digital media asset. For example, an audiovisual file could be split and converted into multiple objects. Each object could be an individual content item with a separate object identifier, where the individual content item is a fragment of a discrete portion of the individual file. In another example, the individual file could be split into objects that QC Ln / Lznz / E / YILI represent separate components, such as audio objects, subtitle objects, separate visual effect objects, etc. In some modes, portions of a given content item may be stored as multiple portions. In such cases, multiple portions of the content item may be stored in different storage partitions. For example, a content item might be a scene from a movie. In such cases, a portion of the content item, such as a 10-second period of the scene, may be stored separately and transferred from remote storage 132(5) on partner network 140(2) to on-premises storage 134(3) on partner network 140(2) in anticipation of a scheduled visual effects (VFX) task. In some modes, each portion of a content item may have a different object identifier while sharing a common file identifier.In such cases, the media controller 107 can use the file identifier to locate the storage partitions in which each portion of the content item, identified by the separate object identifiers and associated with the file identifier, is stored within the network infrastructure 100. The 110 concentrator network and the 140 peer network(s) (e.g., 140(1)-140(4)) include multiple network communication systems, such as routers and switches, configured to facilitate data communication between devices included in the 110 concentrator network and devices included in the 140 peer network(s). Those skilled in the art will recognize that many viable techniques exist for constructing the 110 concentrator network and the 140 peer network(s), including technologies commonly used in deploying Internet communication networks. For example, the 110 and 140 networks may include a wide area network (WAN), a local area network (LAN), and / or a wireless network (Wi-Fi), among others.In various modes, one or more communication protocols, such as Transmission Control Protocol (TCP), Internet Protocol (IP), and / or User Datagram Protocol (UDP), can be used to transport messages and / or media data (e.g., portions of content elements) between 110, 140 networks. Each 110, 140 network includes a separate control plane 120 and storage plane 130. In various configurations, several components in the control plane 120 and / or storage plane 130 are distributed across 110, 140 networks. In operation, components in the control plane 120 manage data input to the components in the storage plane 130. Additionally, components in the control plane 120 manage the indexing and transfer of data that is stored in the storage plane 130. Control plane 120 is a portion of concentrator unit network 110 and / or partner network 140 that manages data storage in the storage plane QC Ln / ίZΖΠΖ / E / YΙΛΙ 130. In various modes, one or more components included in control plane 120 may cause received media content items and / or other data (for example, metadata, workflow data, other application data, etc.) to be securely stored in at least one location within storage plane 130. Additionally or alternatively, one or more components of control plane 120 may also manage local access to content items stored in storage plane 130. For example, the media orchestrator 111 and / or one or more storage controllers 121 included in control plane 120 could manage secure access by a media application to data stored in storage plane 130. Security module 105 can be an application run by one or more devices on the concentrator unit network 110 that enables the secure transfer of content items between devices. In some configurations, security module 105 can respond to one or more transfer requests generated by media controller 107 by providing security keys, authorization tokens, etc., to applicable devices. For example, upon receiving tokens and / or keys from security module 105, media controller 107 could distribute the tokens and / or keys to one or more storage controllers 121 to encrypt the content items and enable the secure transfer of the encrypted content items between storage partitions. The media controller 107 is an application run by one or more devices included in the concentrator unit 110 network, such as a server, that manages the input and / or transfer of content items. In various modes, the media controller 107 can act as a central catalog of content items and / or a centralized orchestrator service that manages the indexing and / or transfer of data stored in portions of the storage plane 130. For example, media controller 107 might receive information from storage controller 121(3) regarding new content items that were introduced into partner network 140(3), such as when a production stores new footage in on-premises storage 134(6). In such cases, media controller 107 might update a media catalog that indexes the new footage as one or more content items and stores information about the content items, such as the storage division if the items are stored (e.g., on-premises storage 134(6)), the location of the content item (e.g., partner network 140(3)), one or more workers associated with the content item, scheduled tasks associated with the content item, and so on. In various modes, the Media Controller 107 can receive and analyze data associated with one or more workflows (e.g., workflow pipeline, tasks) QC Ln / Lznz / E / YILI individual, authorized users, etc.), and / or information that is associated with content items stored in the concentrator unit network 110 (for example, stored in secure object storage 115) and / or partner networks 140 (for example, stored in a division of a storage group in tiers 136). Based on the analysis of such information, the media controller 107 can facilitate the transfer of complete content items or portions of content items between storage divisions included in the network 110, 140, such as a content item stored in secure object storage 115 and / or portions of content items stored in storage divisions 132, 134 that are included in at least one partner network 140. For example, media controller 107 might include a media orchestrator that receives information from the media catalog, where the media catalog provides information specifying the network and / or storage partition that is currently storing a particular portion of a content item within network infrastructure 100. Media controller 107 might, for example, identify the network as peer network 140(4) and / or identify the particular storage partition as remote storage 132(7). In such cases, the media orchestrator included in media controller 107 might send a message to storage controller 121(5) that includes a command for storage controller 121(5) to retrieve the locally stored portion of the content item.The storage controller 121(5) could respond by retrieving the portion of the content item for use, for example, by a media application operating within peer network 140(4). In several modes, the media orchestrator included in media controller 107 could receive information from one or more media workflows. This information can be associated with one or more production workflows of various types. Such production workflow types might include, for example, production tasks to be executed by one or more users in relation to content items stored within network infrastructure 100. Additionally or alternatively, such production workflow types might include archiving tasks associated with storing content items at a specific storage level within network infrastructure 100 (for example, transferring a portion of a content item from remote storage 132(4) to an archive storage level included in secure object storage 115). In several modes, media controller 107 can analyze workflow information to identify a particular partner network 140 (for example, partner network 140(3)) associated with a task that is scheduled to run on a particular portion of a content item. For example, media controller 107 QC Ln / Lznz / E / YILI Media Controller 107 can employ one or more heuristics associated with the content item portion and the scheduled task (for example, cost, object type, speed, workflow, hardware characteristics, etc.) to determine a specific storage level and / or storage partition that allows efficient access to the content item portion for the scheduled task. By employing one or more heuristics, Media Controller 107 can identify a target storage partition in which to store the content item portion to optimize the performance of the scheduled task. In several modes, media controller 107 can employ a cost heuristic to determine the costs associated with storing a content item in a particular storage partition, as well as the costs associated with transferring the content item. For example, storing data in remote storage 132 might be associated with a daily cost (for example, $0.0025 per GB per month), while transferring data from secure object storage 115 to remote storage 132 might have a separate associated cost (for example, $0.005 per GB). Media controller 107 can then select a storage partition that minimizes transfer and storage costs when access has been granted for a task.In some modes, Media Controller 107 can use an object-type heuristic to determine object-related characteristics, such as object size, applications that can open the object, media type (e.g., text, video, image, audio, etc.), and so on. Alternatively, Media Controller 107 can use a speed heuristic to determine transfer rates associated with one or more storage partitions. These speed metrics can include retrieval rates associated with accessing a content item, as well as input / output rates associated with transferring a file into and out of the storage partition. In some modes, the Media Controller 107 can use a workflow heuristic to determine information about a task to be executed as part of a production workflow. This information can include the users assigned to the task, the location where the task will be executed, the scheduled start time for the task, the time frame for completing the task, and so on. In several modes, the Media Controller can use the workflow heuristic to determine a target location and target time for the content item to be delivered to the target storage partition.In several modes, the Media Controller 107 can employ a hardware feature heuristic to analyze characteristics of specific storage partitions, such as the remaining available space in the storage partition, the storage tier associated with the storage partition, the device health of the particular storage partition, and so on. For example, the Media Controller 107 could analyze hardware characteristics to determine a particular storage partition within a storage tier that will store the content item. In several modes, media controller 107 can employ multiple heuristics to identify a particular storage partition and generate routing information to cause the content item to be transferred to that storage partition for a specific time. For example, media controller 107 could employ various heuristics to determine that storing the portion of the content item in on-premises storage 134(6) of peer network 140(3) allows the user to access the portion of the content item at a location that is geographically close to the user.Therefore, the closer the user's geographical location is to on-premises storage 134(6), the lower the storage latency and retrieval times associated with accessing the content item portion from a workstation could be, and thus increase the user's efficiency when accessing the content item and performing their scheduled task.Upon determining that the target storage partition (for example, on-premises storage 134(6)) is different from the storage partition in which the portion of the content item is currently stored (for example, remote storage 132(7)), the media controller 107 could communicate with one or more storage controllers 121 (for example, storage controllers 121(3), 121(5)) to facilitate the transfer of the particular portion of the content item from the storage partition that is currently storing the portion to a new storage partition that will be associated with the scheduled task. In some modes, when Media Controller 107 facilitates the transfer of a specific content item, Media Controller 107 may receive a notification that the transfer is complete. In such cases, Media Controller 107 may then trigger updates related to the content item's indexing. For example, the media orchestrator within Media Controller 107 might trigger an update to a media catalog and / or media workflow within Media Controller 107. This update reflects the updated location of the specific content item, the storage partition that holds the specific content item, and / or the completion of a particular task associated with the specific content item. In some modes, the update may also indicate that the content item has been modified.In such cases, media controller 107 may cause a synchronization action to occur. QC Ln / ίZΖΠΖ / E / YΙΛΙ so that the modified content element is copied into secure object storage 115. The storage plane 130 includes one or more devices in various networks 110, 140 that store data accessible through the control plane 120. For example, the concentrator unit network 110 might include secure object storage 115, while each peer network includes a tiered storage group 136 comprising one or more storage splits 132, 134. In various modes, the media controller 107 can manage each of the storage devices included in the storage plane 130 as a composite tiered storage group.For example, media controller 107 might manage a workstation's local storage (e.g., local memory and / or storage within the workstation) as Tier 0 storage, storage within the tiered storage group 136 (e.g., on-premises storage 134, remote storage 132) as Tier 1 storage, and / or secure object storage 115 as Tier 2 storage. In some configurations, a given storage tier might include multiple sub-tiers. For example, media controller 107 might manage the tiered storage group such that the on-premises storage division 134 is managed as Tier 1A storage, while the remote storage 132 is managed as Tier 1B storage. In several configurations, each secure object plane (115) and / or storage partition can store one or more copies of a portion of a given content item. In some configurations, the storage plane (130) can be stateless. In such cases, the storage plane (130) can replicate a portion of a given content item and store multiple copies of the portion across multiple storage devices and / or storage partitions. In such cases, the failure of a single storage device or storage partition cannot prevent access to the portion of the content item because a copy of the portion can be retrieved from another storage device and / or storage partition. Secure Object 115 storage can be, for example, one or more devices, such as one or more web servers, that store data from multiple sources. In several forms, Secure Object 115 storage can be an online storage service (OSS) (for example, Amazon® Simple Storage Service (S3), Google® Cloud Storage, etc.) in which a catalog of thousands or millions of files and / or objects is stored or accessed. In some forms, Secure Object 115 storage can also provide computing services. 3 and / or other processing services. Although Figure 1 shows only one secure object storage 115, in various configurations, multiple instances of secure object storage 115 (e.g., 115(1), 115(2), etc.) can be included in the concentrator unit network 110. In several configurations, secure object storage 115 can act as a source of truth for a given content item. In such cases, a content item stored in secure object storage 115 can be more reliable than different copies of the content item stored in other storage partitions. In some configurations, media controller 107 can manage secure object storage 115 as a tiered storage group. For example, media controller 107 can manage multiple sub-tiers within secure object storage, such as a “high-performance” Tier 2A storage associated with active objects linked to active production workflows, a “medium-performance” Tier 2B storage associated with high-priority archive content items, and a “low-performance” Tier 2C storage associated with low-priority archive content items. In some configurations, Secure Object Storage 115 can move stored objects to files so that a media application accessing an object from Secure Object Storage 115 views the object as a file in an applicable file system. For example, a user might have a workstation that includes a file system compliant with the Portable Operating System Interface (POSIX). In such cases, Secure Object Storage 115 and / or another application could move the objects stored in Secure Object Storage 115 so that the user can view one or more objects associated with a content item as native files on the workstation's file system. In several modes, secure object storage 115 can permanently store one or more content items associated with an audiovisual program. For example, a portion of a content item associated with an audiovisual program can be temporarily stored on one or more peer networks 140(1)140(4) to allow users to perform tasks associated with the audiovisual program that require access to the content items (e.g., virtual effects, animation, translation, generation of promotional materials, etc.). Once all tasks associated with the audiovisual program are completed, the media controller 107 can coordinate the transfer of all copies of the portion to secure object storage 115 for permanent storage as a portion of a stored object. The 140 partner networks (e.g., 140(1)-140(N)) include one or more networks connected to the concentrator unit network that include several b? QC Ln / Lznz / E / YILI controllers 4. Storage 121 and several storage divisions 132, 134. In several modes, each partner network 140 may be associated with a geographically distinct region. In some modes, each partner network 140 may be associated with a particular production studio and may have multiple storage divisions 132, 134 in storage plane 130 that are associated with geographically distinct regions. In several modes, the media orchestrator 111 can cause the transfer of content items to a particular storage partition 132, 134 within a particular peer network 140 via the applicable storage controller 121. In such cases, the content item can be transferred between different storage partitions 132, 134 in different peer networks 140 (for example, a remote storage partition 132(4) and an on-premises storage partition 134(7)) so that the content item is in a storage partition that is geographically close to a user when the user accesses the content item. This geographical proximity can then reduce latency when the user accesses the content item. For example, the concentrator unit network 110 might be located in an eastern portion of the United States, while each partner network 140 has one or more storage divisions 132,134 that are distributed across other geographic locations (for example, partner network 140(1) has on-premises storage 134(2) in Asia, partner network 140(2) has remote storage 132(4), 132(5) in separate European locations, and so on). A particular user who is scheduled for an animation task might be located in an eastern portion of Asia. In such cases, the media controller 107 can refer to a media catalog and one or more workflows to determine that the user is scheduled to run an animation task associated with a first portion of a content item that is stored in secure object storage 115 on the concentrator unit network 110.Media controller 107 could determine a storage split included in storage plane 130 that is geographically close to East Asia (e.g., remote storage 132(4)), and can communicate with the applicable storage controller for the region (e.g., storage controller 121(1)) to cause the first portion to be transferred and stored in storage split 132(4). The storage controller(s) 121 (for example, 121(1)-121(N)) is a component included in the control plane 120 of the peer network 140 that manages content items within the storage plane 130 that is associated with a given peer network 140. In various modes, the storage controller 121 can send messages to the media controller 107 indicating a specific storage partition that is currently storing a content item. QC Ln / Lznz / E / YILI 5. The entire content item or a portion thereof. Alternatively, storage controller 121 can manage the transfer of a content item between a specific storage partition in storage plane 130 and other devices (e.g., a different storage partition within peer network 140, a transfer to a separate peer network 140 and / or secure object storage 115, etc.). In various modes, storage controller 121 can communicate with media controller 107 via a communication channel to determine which content items to upload or download to other locations. In such cases, storage controller 121 can communicate with one or more storage partitions 132, 134 within the tiered storage group 136 of peer network 140 to manage the content item transfer.In several modes, storage controller 121 can register with media controller 107 by specifying current information, such as the amount of local storage available in the storage group in tiers 136. Alternatively, storage controller 121 can download metadata associated with a specific content item and cause the content item to be downloaded and stored locally in storage plane 130 of peer network 140. For example, storage controller 121(1) could communicate with media controller 107 to receive information regarding a specific content item to be downloaded from secure object storage 115 to remote storage 132(1).The storage controller 121(1) could then communicate with a media transfer agent that optimizes the transfer of the specific content item, such as using UDP-based communications to transmit the content item from secure object storage 115. In some embodiments, the storage plane 130 may be independent of the control plane 120. In such cases, the storage plane 130 and / or the control plane 120 may be scaled independently. For example, the peer network 140(1) could include a single storage controller 121(1) managing a storage group at tiers 136 (for example, 136(1) comprising three remote storage splits 132(1)-132(3) and two on-premises storage splits 134(1)-134(2)). In another example, two storage controllers 121(3)-121(4) could manage a storage group at tiers 136 (for example, 136(3)) comprising a single remote storage split 132(6) and a single on-premises storage split 134(6).In several modes, multiple target storage divisions 132 and / or in-installation storage divisions 134 can be added to a given tiered storage group 136 without scaling the number of controllers <7 / QC Lñ / Lznz / E / YILI. 6 corresponding storage 121. The tiered storage group 136 includes one or more storage partitions associated with a given partner network 140(1). In various configurations, the tiered storage group 136 may be a single tier in a composite tiered storage system that includes secure object storage 115 and / or local storage of connected workstations (not shown). In various configurations, the tiered storage group 136 may be a storage area network (SAN) that allows the size of the tiered storage group 136 to be a virtual combination of remote storage partitions 132 and / or on-premises storage partitions 134. In such cases, the storage partitions 132, 134 included in the tiered storage group 136 may be tiered based on multiple parameters, such as transfer latency, cost, technical characteristics, etc.Thus, a given content item is stored at a particular level based on the parameters. In various modes, the media controller 107 can run one or more heuristics to determine a particular storage level to store the given content item. For example, the storage controller 121 might initially cause an ingested content item to be stored at storage level 1B (for example, stored in a remote storage partition 132).When media controller 107 applies one or more heuristics to determine that the content item will be accessed as part of a scheduled task requiring fast retrieval speeds, storage controller 121 could then cause the content item to be moved to Tier 1A storage (for example, stored in an on-premises storage split 134) to decrease the storage latency associated with the retrieval speed of the workstation accessing the content item from on-premises storage. Each of the remote storage partitions 132 (for example, 132(1)132(N)) and / or on-premises storage partitions 134 (for example, 134(1)-134(N)) acts as a container for storing data. In various modes, a given storage partition 132, 134 can securely store content items as objects. In such cases, the storage partition may include a key, provided by the security module 105, to encrypt data so that access by other devices, such as a media application, requires appropriate authorization and / or authentication. On-premises storage partitions 134 can be one or more local storage devices located within the partner network 140. In various modes, an on-premises storage partition 134 can be located in one <7 / QC LÍV Lznz / E / YILI Seven or more Internet Exchanges (IXs), an on-premises cache at a particular provider location, a metropolitan edge, and / or a Demilitarized Zone (DMZ). Remote storage partitions 132 may be one or more cloud-based storage partitions, such as an Elastic Compute Cloud (EC2) instance, that are associated with a particular peer network 140. In several modalities, the remote storage partition 132 may be geographically close to the peer network 140. In such cases, media applications operating on the peer network 140 may experience lower latency when accessing content items stored in the corresponding remote storage partition 132. Figure 1B illustrates a more detailed version of the concentrator unit network 110 of the Network Infrastructure in Figure 1A, according to the various modalities. As shown, the network infrastructure 150 includes, without limitation, the concentrator unit network 110 and the partner networks 140 (for example, 140(1)-140(2)). The concentrator unit network 110 includes the media controller 107 and the secure object storage 115. The media controller 107 includes the media orchestrator 111, the media transfer agent 113, the media catalog 117, and the media workflows 119 (for example, 119(1), 119(2), etc.). Each peer network 140 includes one or more media storage devices 142 (for example, 142(1)-142(2)). In several modes, each peer network 140 includes one or more media storage devices 142 (for example, 142(1)-142(N)) that include various components in the control plane 120 and / or the storage plane 130. For example, the media storage device 142(1) may include two storage controllers 121 and a tiered storage group 136 that includes two on-premises storage divisions 134 and six remote storage divisions 132. Each media storage device 142 is connected to the concentrator unit network 110 through a media channel 160 and / or a communications channel 170. In several modes, each media storage device 142 is connected to other media storage devices 142 through the media channel 160 and / or the media channel 180.In operation, the media controller 107 includes a media orchestrator 111 that coordinates with one or more media storage devices 142 to cause a secure transfer of a content item stored on a media storage device 142 (for example, media storage device 142(1)) and another device within the network infrastructure 150. In such cases, the new location of the content item is updated in the media catalog 117. Each media storage device 142 (for example, 121(1)-121(4)) can be a device included in one or more peer networks 140 that stores data for one or more users associated with the peer network 140. In various modes, the device <7 / QC LÍV Lznz / E / YILI Media storage device 142 can act as a container that stores data, including content items, which are accessed by one or more users associated with the partner network 140. In some embodiments, the media storage device 142 can store content items associated with multiple users. For example, the partner network 140(2) could be a network associated with a studio that includes multiple users. In such cases, the media storage devices 142(2) could store content items associated with various scheduled tasks that are being and / or will be run by one or more users associated with the studio. In some embodiments, a user may not have direct access to the concentrator unit network 110.In such cases, the media controller 107 can cause the content items, which the user will access for a scheduled task, to be transferred to the media storage device 142(2). Once stored on the media storage device 142(2), the user can implement various techniques to transfer the content items from the media storage device 142(2) to local storage (for example, a personal storage drive on a workstation and / or endpoint device). In several modes, one or more devices on peer network 140 can communicate with media orchestrator 111 to initiate the transfer of content items between storage devices. For example, media storage device 142(1) included in peer network 140(1) could communicate with media orchestrator 111 to trigger the transfer of a content item from secure object storage 115 to media storage device 142(1) via media channel 160. Such transfers could include media storage device 142(1) initially downloading the content item in anticipation of a scheduled user task requiring access to the content item.Additionally or alternatively, the media orchestrator 111 could cause the content item to be uploaded from the media storage device 142(1) to secure object storage 115 once the scheduled task is completed. In some modes, multiple media storage devices 142 may be included in a common peer network 140. In such cases, a user may have access to at least one media storage device 142 to access a given content item. In some modes, the media orchestrator 111 can refer to a media catalog 117 to determine the location (for example, a specific partner network 140 and / or media device 142) of a specific content item. In such cases, the media catalog 117 can identify which networks (for example, the concentrator unit network 110, the partner network 140(1)) are currently storing at least QC Ln / ίZΠZ / Β / YΙΛΙ 9 a copy of the content item. In some modes, the media catalog 117 can also specify the storage device (for example, secure object storage 115, media storage device 142(1)) and / or a particular storage partition 132,134 in which the content item is located. In some modes, a given content item can be a file associated with multiple objects. In such cases, the media catalog 117 can index each object by recording the object identifier and can associate each object identifier with the file. In several modes, the media orchestrator 111 may reference one or more media workflows 119 (for example, 119(1), 119(2), etc.) to determine which media device 142 will store a content item, and / or routing information regarding how the content item will be transferred. The media orchestrator 111 may also determine the current location of the specific content item by referencing the media catalog 117. Upon determining the location of the specific content item, the media orchestrator 111 may generate one or more messages containing commands for a particular storage controller 121 to retrieve the specific content.In cases where the media catalog does not specify the particular storage partition 132, 134 in which the specific content item is located, the storage controller 121 can connect to one or more storage partitions 132, 134 within the storage group in tiers 136 of a particular peer network 140 to determine the exact location of the specific item within a particular storage partition 132, 134 and retrieve the specific content item for transfer to a media application and / or a separate storage partition 132, 134. In various modes, the media orchestrator 111 and / or the storage controller 121 can update the media catalog 117 to reflect the actual location of the specified content item after the transfer is complete. In several modes, the media orchestrator 111 can "pre-prime" or "cache-prime" the applicable media storage device 142(2), causing the specified content item to be transferred from secure object storage 115 to the media storage device 142(2) before the user is scheduled to access the specified content item. In such cases, one or more media workflows 119 could specify information associated with a production workflow, such as a specific user who is to perform the task, and / or the time at which the user is to start the task, and / or the portion of the content item to which the user requires access.In such cases, the media orchestrator 111 could determine information associated with the portion of the content item, such as the size of the specific portion of the content item, and employ heuristics to schedule the transfer of the specific content item and provide routing information associated with it. QC Ln / Lznz / E / YILI 0 transfer. For example, a first media workflow 119(1) might specify an upcoming task associated with a first portion of a content item to be executed by a user associated with the partner network 140(2), where the upcoming task is scheduled to start in 24 hours. A second media workflow 119(2) might specify that all portions of the content item not associated with a production task are to be achieved in secure object storage 115. In such a case, the media orchestrator 111 could use the information included in media workflows 119(1)-119(2) to execute one or more heuristics associated with the content item.The media orchestrator 111 can run heuristics to identify the portion of the content item associated with the next task, identify the media storage device that currently stores the content item, and identify the applicable target media storage device 142(2) that optimizes the performance of the next task. In some modes, the current location of the specified content item includes the particular network (for example, the hub drive network 110) and / or the particular storage device (for example, secure object storage 115) that is currently storing the specified content item.Media orchestrator 111 could communicate with both storage devices to transfer the specified content item from secure object storage 115 in a manner that results in the content item being stored on target media storage device 142(2) within a 24-hour period, so that the content item is stored on target media storage device 142(2) when the next task is starting. In some modes, media orchestrator 111 could also communicate with the storage device that currently stores the content item so that the remaining portion of the content item is stored on secure object storage 115. Media transfer agent 113 transfers content items between media storage devices 142(1)-142(2) on peer networks 140(1)-140(2) and storage devices on the concentrator network 110 (for example, secure object storage 115). In various configurations, media transfer agent 113 may include key storage containing one or more keys used by one or more users and / or devices to access encrypted content items and / or secure data storage. For example, media transfer agent 113 might include one or more keys, provided by security module 105, that are required to access one or more portions of secure object storage 115. In such cases, media orchestrator 111 may communicate with media transfer agent 113 to authorize and / or authenticate the storage device. QC Ln / Lznz / E / YILI 1 media 142 and allow media storage device 142 to download a content item that is stored in secure object storage 115. The media catalog 117 maintains a record that maps each content item and / or each portion of a given content item, which are included in the network infrastructure 150, to the specific media storage devices 115, 142 that store at least one copy of the content item. In various ways, the media catalog 117 can associate each content item with a file identifier and each portion of the content item with a separate object identifier. Alternatively, the media orchestrator 111 can reference one or more entries in the media catalog 117 to identify a given file identifier and / or object identifier in order to identify the media storage devices 115, 142 that are currently storing a copy of a specific content item.In several modes, the media orchestrator 111 can update one or more entries in the media catalog 117 to reflect a transfer of a content item to a new media storage device 115, 142. In some modes, one or more media storage devices 115, 142 can send notifications to the media catalog 117 via the communication channel 170. In such cases, the media catalog 117 can be updated without intervention from the media orchestrator 111. In some modes, the media orchestrator 111 can reference information from both media workflows 119 in the media catalog 117 to determine routing information associated with the transfer of a content item. In such cases, the media orchestrator 111 can reference the media catalog 117 to receive information associated with the content item (for example, a media catalog specifying that the concentrator network 110 is currently storing the content item).The media orchestrator 111 can also refer to one or more media workflows 119 to identify a user's location (e.g., partner network 140(2)) that is associated with a scheduled task, the storage tier associated with the completion of the scheduled task, and the costs with transferring the content item to the target location and storing the content item in a given storage tier. Media workflows 119 (e.g., 119(1), 119(2), etc.) maintain records associated with various workflow procedures and features. In several configurations, a given media workflow 119 may include one or more entries that map tasks in a production workflow to information associated with those tasks, such as location, users, costs, time frame for performance, and so on. In some configurations, the media controller 107 may include several types QC Ln / Lznz / E / YILI of media workflows 119, such as a cost workflow associated with minimizing / optimizing storage utilization based on different storage and transfer costs. Additionally or alternatively, a media workflow type 119 may include technical characteristics of one or more storage devices (e.g., available space, storage level, device health, etc.). For example, a media workflow 119 might be a production workflow that includes entries associated with various production tasks performed by one or more users. For a given production task, the media workflow might include an entry specifying the content elements required to perform the production task, as well as information about the user assigned to perform the task.For example, Media Workflow 119 might contain an entry for a production task that includes a set of task parameters, such as the media applications associated with running the task, the time the task will start, a set of authorized users who can run the task, a specific user to whom the task is assigned, the assigned user's current geographic location, the partner network 140 associated with the assigned user, a preferred storage level in which the content items will be stored when the task runs, and so on. Alternatively, Media Workflow 119 maintains information about the users who will run the task.This information may include, for example, the times the user will run the task (and therefore needs access to a content item), the peer network 140 and / or media storage device 142(2) associated with the user, the keys and / or permissions associated with the user, etc. For example, media workflow 119 could be a production workflow that stores an entry for a captioning task associated with adding captions to audio dialogue and / or descriptions within a specific portion of a content item. The entry within media workflow 119 could specify the portion of the content item that needs to be accessed to begin the captioning task, as well as a particular media application (for example, a captioning application) associated with running the task.When a specific user is assigned the task of generating subtitles, the media workflow 119 could be updated so that the input includes the specific user's geographic location, the nearest partner network 140 (for example, partner network 140(2)), and a schedule (for example, start time, duration, etc.) during which the specific user will access the portion of the content item. In various modes, the media orchestrator 111 can reference the input. QC Ln / ίZΠZ / Β / YΙΛΙ 3 included in the media workflow 119 to generate routing information to transfer the specific portion of the content item to the media storage device 142(2), corresponding to the peer network 140(2) that is closest to the target user. In such cases, the media orchestrator 111 can generate routing information so that the specific portion of the content item is stored on the media storage device 142(2) for the specified time that the user will initiate the captioning task. Distributed tiered storage and caching platform Figure 2 is a block diagram of various devices that can be implemented in conjunction with the network infrastructure of Figure 1, according to the various modalities. As shown, the network infrastructure 200 includes, but is not limited to, the concentrator unit network 110, the media storage devices 210(1)-210(2), and the media applications 240(1)-240(2). Each media storage device 210 includes the control plane 120 and the storage plane 130. The control plane 120 includes storage controllers 221 (e.g., 221(1)-221(2)) and transfer agents 223 (e.g., 223(1)-223(3)).The storage plane 130 includes the tiered storage groups that one or more remote storage divisions 132 (for example, 231(1)-231(3)) and one or more on-premises storage divisions (for example, 134(1)-134(3)) divide into Tier 1A storage 136(1) and Tier 1B storage 136(2). In operation, the storage controller 121 (1) communicates with the media orchestrator 111 to transfer a specified content item. The media storage devices 210 (e.g., 210(1)-210(2)) include the control plane 120, which controls the transfer and / or storage of content items in the storage plane 130. In various configurations, the media storage device 210 may implement one or more components in the control plane 120 to securely connect to other devices within the network infrastructure 200 and access secured content items. For example, one or more media transfer agents 223 (e.g., 223(1)-223(2)) could handle authorization and / or authentication for the media storage device 210 when the media storage device 210 transfers data to or from secure object storage 115.The media storage device 210 can use one or more components included in the control plane 120 to execute authorization and / or authentication techniques to access data included in secure object storage 115. In several modes, the storage controller 121(1) causes the transfer agent 223(2) to connect to the storage plane 130. When a QC Ln / Lznz / E / YILI 4. Content item, transfer agent 223(2) receives the content item from secure object storage 115 through media transfer agent 113 and causes the content item to be stored in a storage partition included in storage plane 130. When a content item is loaded, transfer agent 223(2) retrieves the content item from storage plane 130 and transmits the content item to media transfer agent 113, which stores the content item in secure object storage 115. In some modes, storage controller 121(1) causes transfer agent 223(1) to retrieve the content item so that media application 240(1) can access the content item.For example, storage controller 121(1) could respond to a message generated by media orchestrator 111 specifying a scheduled task associated with a content item, causing transfer agent 223(1) to retrieve the content item from storage plane 130. In such cases, media application 240(1) accesses the content item from storage plane 130 through transfer agent 223(1). The transfer agent 223 includes one or more agents (for example, 223(1)-223(3)) that manage data transfers between the storage plane 130 and other locations. In various configurations, the control plane 120 may include a separate transfer agent 223(1) download and a separate transfer agent 223(2) upload. In some configurations, the control plane 120 may include a single transfer agent 223(3) that handles both uploads and downloads. In other configurations, the control plane 120 may include separate transfer agents 223 that manage transfers to different devices and / or components. For example, the control plane 120 could include a first transfer agent 223(1) to manage the access and / or transfer of content items between the storage plane 130 and the media application 240.Similarly, control plane 120 could include a second transfer agent 223(2) between storage plane 130 and other media storage devices 210(2)210(4) and / or devices in the concentrator unit network 110. In several modes, transfer agent 223 receives information regarding the location of a specified content item from storage controller 221. This information may include the current location of the specified content item or its target location. Based on the received information, transfer agent 223 connects to the applicable component at the applicable location (for example, remote storage split 232(1) and on-premises storage split 234(3)) and transfers the specified content item. In several modes, transfer agent 223 can optimize transfers between the QC Ln / ΙΖΠΖ / Β / ΥΙΙΛΙ 5 storage to or from the media storage device 210 by selecting a specific transfer method. For example, the transfer agent 223(1) may employ TCP-based transfers for transfers to the media application 240(1), while the transfer agent 223(2) may execute UDP-based transfers to the secure object storage 115. In some modes, the transfer agent 223 may cache a specified content item for storage in an applicable location by ensuring that the specified content item is transferred to and in the applicable storage partition 232, 234 for a specified time.For example, transfer agent 223(2) could cache a specified content item by first downloading the specified content item from secure object storage 115 and storing the specified content item in level 1A storage 236(1) (for example, on-premises storage split 234(2)) before a specified time. Media application 240 (e.g., 240(1), 240(2)) includes one or more applications that access content items during execution. For example, media application 240(1) might access content items from the storage group at levels 236 on media storage device 210(1) to enable a user to complete a task. In various forms, media application 240 includes several tools and functions that enable a user to perform specific tasks within media application 240. For example, media application 240(2) might be a three-dimensional (3D) design application deployed by a device within peer network 140(2) (e.g., a workstation or endpoint device) that includes media storage device 210(2).In various forms, the 240 media application could be one of several types of software products, such as coding environments, graphics design applications, word processing applications, entertainment applications (e.g., content playback applications, games, etc.), and so on. In several modes, storage controller 221 can manage secure access by media application 240. In several modes, storage controller 221 can communicate with one or more authorization and / or authentication servers to allow media application 240 to access and / or modify content elements stored in storage plane 130. For example, media storage device 210(1) could communicate with media application 240(1) located on a separate device within peer network 140(1). In such cases, storage controller 221(1) could cause the authorization and / or authentication servers to grant media application 240(1) access to data in 1A level storage 236(1) and / or 1B level storage 236(2), such as elements of b? QC Ln / Lznz / E / YILI 6 contents stored in storage plane 130 that a user will have access to and / or that will be modified by a user. Figure 3 establishes a flowchart of the steps of the method for storing a content item within a storage partition of the network infrastructure of Figure 1A, according to the various modalities. Although the steps of the method are described with reference to the systems and call flows of Figures 1A-2, those skilled in the art will understand that any system configured to implement the steps of the method, in any order, falls within the scope of this disclosure. Method 300 begins at step 301, where media controller 107 identifies a content item to be stored. In several modes, storage controller 221 may receive a message indicating that a particular content item is to be stored within peer network 140, where storage controller 121 is located. In several modes, storage controller 221 may receive a message from media controller 107 to download a particular content item from a separate location. In some modes, media application 240 may perceive an indication to save a new content item within storage plane 130 on peer network 140. In step 303, storage controller 221 causes a transfer agent 223 to connect to a storage partition. In various modes, media controller 107 and / or storage controller 221 can analyze the storage group's tier 136 configuration within peer network 140 to determine and / or select a particular storage partition 132, 134 within the tier 136 storage group to store the content item. In various modes, media controller 107 can run various heuristics to analyze parameters, such as storage parameters (e.g., capacity, storage latency, costs, etc.).), and / or workflow parameters, in order to select a specific storage level and / or a specific storage split (for example, a remote storage split 132 or an on-premises storage split 134) that is most applicable for storing the centenide element. In such cases, the media controller 107 can send a cemande to the storage centerlader 221, where the storage controller 221 responds by connecting the transfer agent 223 to the identified storage split. In step 305, the identified content item is stored in a particular storage division via transfer agent 223. In various modes, storage controller 121 can send one or more commands to transfer agent 223, which is part of peer network 140, to transfer the content item to the specific storage division. In various modes, the controller of <7 / QC Lñ / Lznz / E / YILI 7 Storage 121 may cause the transfer agent 223 to apply one or more security keys to encrypt the content item and / or cause a secure transfer of the content item through a media channel 160, 180. In step 307, storage controller 221 sends a message to media controller 107 identifying the content item's location. In some modes, when the content item is stored in the specific storage division 132 or 134, storage controller 121 may send a message to media controller 107 reflecting the content item's current location (e.g., specific network, specific storage division). In some modes, the message may indicate that the content item is included in partner network 140. Alternatively, the message may indicate that the content item is stored in a specific storage division 132 or 134. In such cases, media controller 107 may update the media catalog 117 to reflect the content item's current location. In step 309, storage controller 221 optionally causes the content item to be copied to secure object storage 115. In several modes, media controller 107 can cause secure object storage 115 to synchronize with the content item to ensure that any changes to the content item are copied to the main repository. In such cases, storage controller 221 can respond to a message received from media controller 107 by causing transfer agent 223 to send a copy of the content item to secure object storage 115. Figure 4 establishes a flowchart of the steps of the method for transferring a content item between storage divisions of the network infrastructure of Figure 1A, according to the various modalities. Although the steps of the method are described with reference to the systems and call flows of Figures 1A-2, those skilled in the art will understand that any system configured to implement the steps of the method, in any order, falls within the scope of this disclosure. Method 400 begins at step 401, where media controller 107 identifies the current location of a stored content item. In various modes, the media orchestrator 111 included in media controller 107 can receive information from the media catalog 117 and / or one or more storage controllers 121 that specify the location of various content items. The information, for example, might be media workflow information 119 that includes the file identifier for a content item associated with a scheduled task. Media orchestrator 111 can use the file identifier to have the content item query the media catalog 117 to identify the location(s) (for example, partner network 140(1)) and / or... 8 exact storage partition (for example, facility storage partition 134(2)) that is currently storing a portion of the specified content item. In step 403, the media orchestrator 111 transmits instructions to transfer the stored content item. In various modes, the media orchestrator 111 can employ various heuristics associated with media workflows 119 and / or other information associated with the storage plane 130 (for example, costs associated with storage tiers, storage latencies, storage characteristics, etc.) to determine a target storage partition to store the content item.In such cases, the media orchestrator 111 can send messages that include routing information to storage controllers 121 associated with the current location (e.g., storage controller 121(1)) and the target location (e.g., storage controller 121(5)), where the routing information is used by the storage controllers 121 to cause the transfer of the specified content item to the specified location. In step 405, storage controller 121(1) causes transfer agent 223 to connect to the storage partition that contains the stored content item. In some modes, storage controller 121(1) can respond to the routing information included in the message received from media orchestrator 111 by identifying the storage partition (for example, remote storage 132) within the tiered storage group 136 that contains the specific content item. In such cases, storage controller 121(1) can send a message to transfer agent 223 to connect to the identified storage partition. In step 407, transfer agent 223 transfers the stored content item from the current storage split. In several modes, upon connecting to the identified storage split, transfer agent 223 can initiate a secure transfer of the specified content item to a new location, as specified by the routing information provided by storage controller 121(1). For example, storage controller 121(1) might specify that the specified content item is to be transferred to peer network 140(2). In such cases, transfer agent 223 can connect via media channel 160 to a transfer agent on peer network 140(2) and securely transfer the specified content item to the other transfer agent. In step 409, the detached transfer agent receives the content item and transfers it to a new storage partition. In various modes, the detached transfer agent securely transfers the specific content item to a particular storage partition based on the information in <7 / QC LÍV Lznz / E / YILI 9. Routing information received is provided by a corresponding storage controller. In some modes, the storage controller at the new location provides routing information that specifies the particular storage partition within the tiered storage group that will store the specific content item. In such cases, the separate transfer agent connects to the new storage partition and causes the content item to be stored in the new storage partition. In summary, a distributed global storage system includes a network of hub units and a plurality of peer networks. Each peer network includes a media storage device comprising at least one storage controller that manages the content of a tiered storage group that is included in a separate storage plane.When a content item is introduced, the storage controller determines a specific storage partition within the tiered storage group in which to store the content item. The storage partition then causes the content item to be stored as an object within the tiered storage group. In some modes, the storage controller sends a message to the hub network indicating that the local peer network is storing the content item. In such cases, the hub network indexes the content item and can synchronize it, causing the content item to be stored in the secure object storage that is part of the hub network. A media controller within the concentrator network determines various scheduled tasks to be executed, as well as the locations where those tasks will be performed. Based on this information, the media controller instructs the storage controller to retrieve one or more specific content items from the tiered storage pool. In some configurations, the media controller specifies that the content item should be made locally available. In such cases, the storage controller causes the content item to be transferred to a specific storage tier within the local peer network, so that a media application operating on the local peer network can access the content item. In other configurations, the media controller specifies that the content item should be transferred to a separate peer network.In these modes, the storage controller causes the content item to be retrieved and transferred to the separate peer network. The storage controller located on the separate peer network then causes the content item to be stored within the separate peer network's tiered storage pool so that a media application operating on the separate peer network can access it. QC Ln / Lznz / E / YILI to the content element. At least one technological advantage of the disclosed techniques compared to the previous technique is that a storage controller within a given network can efficiently transfer, store, and retrieve stored objects, allowing applications operating within that network to efficiently access and modify them. Using a storage controller to manage a group of storage tiers enables a distributed storage system to efficiently scale storage capacity based on multiple parameters, including workflow parameters associated with users performing tasks using resources within the distributed computing system. 1. In various embodiments, a computer-implemented method for accessing data, the method comprises receiving, through a first storage controller in a first peer network and from a remote entity to the first peer network, a message identifying a first content item, wherein the first content item is identified based on a task to be executed having access to the first content item, determining, through the first storage controller, a first storage partition that stores the first content item, wherein the first storage partition is included in a tiered group of storage partitions accessible by the first peer network, retrieving, through the first storage controller from the first storage partition, the first content item, and causing, through the first storage controller,the first content element to be transmitted to a second peer network for storage in a second storage partition accessible by the second peer network. 2. The computer-implemented method of clause 1, wherein the entity remote from the first peer network comprises a media controller included in a concentrator unit network that is connected to the first peer network. 3. The computer-implemented method of clause 1 or 2, wherein the media controller analyzes a set of parameters associated with the task to be executed having access to the first content item, wherein the set of parameters includes (i) at least one parameter associated with a technical characteristic of the first storage partition and the second storage partition, (ii) a scheduled time specifying when the task is scheduled to be executed, or (iii) a task parameter associated with a user executing the task, based on the set of parameters, identifies the second storage partition to store the first content item, and generates the message identifying the first content item and the second storage partition to cause the first storage controller to transfer the first content item to the second storage partition before the scheduled time QC Ln / ίΖΠΖ / Β / ΥΙΛΙ programmed. 4. The computer-implemented method of any of clauses 1-3, where a media application, operating within the second peer network, has access to the first content item of the second storage division. 5. The computer-implemented method of any of clauses 1-4, wherein a user has remote access to the media application from a network that is remote from at least the first peer network and the second peer network. 6. The computer-implemented method of any of clauses 1-5, wherein the storage-slice tiered group includes at least one local storage slice and at least one cloud-based storage slice, and the second storage slice is included in a second storage-slice tiered group on the second peer network. 7. The computer-implemented method of any of clauses 1-6, further comprising sending to a concentrator network, through a second storage controller included in the second peer network, an update message indicating that the first content item is currently stored in the second storage split, where the concentrator network is connected to the second peer network, and where a catalog included in the concentrator network is updated based on the update message. 8. The computer-implemented method of any of clauses 1-7, further comprising receiving, through the first storage controller from a media application operating within the first peer network, a second content item, transmitting, through the first storage controller to the first storage split, the second content item, and sending, through the first storage controller to a concentrator unit network connected to the first peer network, an update message indicating that the second content item is currently stored in the first storage split. 9. The computer-implemented method of any of clauses 1-8, wherein the second content item is received as a set of one or more files and further comprising, before transmitting the second content item to the first storage division, transferring the set of one or more files to an object. 10. The computer-implemented method of any of clauses 1-9, further comprising transmitting, through a second storage controller included in the second peer network, to a secure object store included in a concentrator network, the first content element, wherein the concentrator network is connected to the second peer network, and wherein the secure object store stores the first content element as a secure object acting QC Ln / Lznz / E / YILI as a source of truth for other copies of the first content item.11. In various embodiments, a computer network enabling access to data comprises a first peer network including a first storage controller that receives, from an entity remote from a first peer network, a message identifying a first content item, wherein the first content item is identified based on a task to be executed on the first content item, wherein the first storage controller is configured to have access to a tiered group of storage partitions including at least one local storage partition and at least one cloud-based storage partition, and a second peer network having access to a second storage partition that stores the first content item received from the first peer network.where the first storage controller further determines a first storage partition, included in the group of tiered storage partitions, which stores the first content item, retrieves the first content item from the first storage partition, and causes the first content item to be transmitted to the second peer network. 12. The computer network of clause 11, wherein the second peer network further comprises a second storage controller that receives the first content item from the first peer network, and causes the first content item to be stored in the second storage partition, wherein a media application, operating within the second peer network, has access to the first content item in the second storage partition. 13. The computer network of clause 11 or 12, where the group in levels of storage partitions is included in a storage plane that is separate from a control plane that includes the first storage controller. 14. The computer network of any of clauses 11-13, further comprising a set of transfer agents included in the control plane in the first peer network, wherein the first storage controller causes at least one transfer agent included in the set of transfer agents to securely transfer the first content item from the first storage split. 15. The computer network of any of clauses 11-14, wherein the first peer network further comprises a third storage controller, and the entity remote from the first peer controller comprises a media controller that forwards at least one message to the third storage controller instead of the first storage controller. 16. The computer network of any of clauses 11-15, where the first storage controller also receives, from a media application operating QC Ln / įZРZ / В / YΙΛΙ within the first peer network, a second content item, transmits, to the first storage division, the second content item, and sends, through the first storage controller to a network of concentrator units connected to the first peer network, an update message indicating that the second content item is currently stored in the first storage division. 17. The computer network of any of clauses 11-16, wherein the first storage controller sends, to a concentrator network connected to the first peer network, an update message indicating that the second content item is currently stored in the first storage split, and a catalog included in the concentrator network is updated based on the update message. 18. In various embodiments, one or more non-transient, computer-readable storage media include instructions that, when executed by one or more processors, cause one or more processors to perform the steps of receiving, through a first storage controller in a first peer network and from an entity remote from the first peer network, a message identifying a first content item, where the first content item is identified based on a task to be executed on the first content item; determining, through the first storage controller, a first storage partition that stores the first content item, where the first storage partition is accessible by a group of storage partition levels in the first peer network; and retrieving, through the first storage controller from the first storage partition,the first content element, and cause, through the first storage controller, the first content element to be transmitted to a second peer network for storage in a second storage partition accessible by the second peer network. 19. The non-transient, computer-readable storage medium or media of clause 18, further comprising instructions that, when executed by one or more processors, cause one or more processors to further execute the steps of sending to a concentrator network, through a second storage controller included in the second peer network, an update message indicating that the first content item is currently stored in the second storage split, where the concentrator network is connected to the second peer network, and where a catalog included in the concentrator network is updated on the basis of the update message. 20. The non-transient, computer-readable storage medium or media of clause 18 or 19, where a media application, operating within the second network of <7 / QC LÍV Lznz / E / YILI interlocutor, has access to the first content element of the second storage division. Any and all combinations of any of the claimed elements mentioned in any of the claims and / or any elements described in this application, in any form, fall within the contemplated scope of this disclosure and protection. The descriptions of the various modalities have been presented for illustrative purposes, but are not intended to be exhaustive or limited to the modalities disclosed. Many modifications and variations will be apparent to those skilled in the technique without departing from the scope and spirit of the modalities described. Aspects of these modalities may be incorporated as a computer program system, method, or product. Accordingly, aspects of this disclosure may take the form of a purely hardware modality, a purely software modality (including firmware, resident software, microcode, etc.), or a modality that combines software and hardware aspects, which may generally be referred to herein as a “module,” a “system,” or a “computer.” Furthermore, any hardware and / or software technique, process, function, component, engine, module, or system described in this disclosure may be implemented as a circuit or assembly of circuits. Additionally, aspects of this disclosure may take the form of a computer program product embedded in one or more computer-readable media that have computer-readable program code embedded therein. Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof.More specific examples (a non-exhaustive list) of computer-readable storage media would include the following: an electrical connection having one or more wires, a laptop floppy disk, a hard disk drive, random-access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fiber, a portable compact disc (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the context of this document, a computer-readable storage medium may be any tangible medium capable of containing or storing a program for use by or in connection with an instruction-executing system, apparatus, or device. Aspects of this disclosure were described earlier with reference to illustrations QC Ln / Lznz / E / YILI of flowchart and / or block diagrams of methods, apparatus (systems), and computer program products in accordance with disclosure modalities. It shall be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to produce a machine. The instructions, when executed through the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / acts specified in the flowchart and / or block or blocks of the block diagram.Such processors may be, without limitation, general purpose processors, special purpose processors, application-specific processors, or field-programmable gate arrays. The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of computer program systems, methods, and products according to various modalities of this disclosure. In this sense, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions to implement the specified logical functions. It should also be noted that, in some alternative implementations, the functions shown in the block may occur out of the order shown in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved.It will also be noted that each block in the block diagrams and / or flowchart illustration, as well as combinations of blocks in the block diagrams and / or flowchart illustration, can be implemented by systems based on special-purpose hardware that perform the specified functions or acts, or combinations of special-purpose hardware and computer instructions. Although the foregoing is directed to modalities of the present disclosure, other modalities and additional modalities of disclosure may be contemplated without departing from the basic scope thereof, and the scope thereof is determined by the following claims.

Claims

1A computer-implemented method for accessing data, characterized in that it comprises: receiving, through a first storage controller in a first peer network and from a remote entity to the first peer network, a message identifying a first content item, wherein the first content item is identified based on a task to be executed having access to the first content item; determining, through the first storage controller, a first storage partition that stores the first content item, wherein the first storage partition is included in a tiered group of storage partitions accessible by the first peer network; retrieving, through the first storage controller of the first storage partition, the first content item;and cause, through the first storage controller, the first content element to be transmitted to a second peer network for storage in a second storage partition accessible by the second peer network.

2. The computer-implemented method according to claim 1, characterized in that the entity remote from the first interlocutor network comprises a media controller included in a concentrator unit network that is connected to the first interlocutor network.

3. The computer-implemented method according to claim 2, characterized in that the media controller: analyzes a set of parameters associated with the task to be executed having access to the first content item, wherein the set of parameters includes: (i) at least one parameter associated with a technical characteristic of the first storage partition and the second storage partition, (ii) a scheduled time specifying when the task is scheduled to be executed, or (ii) a task parameter associated with a user executing the task; based on the set of parameters, identifies the second storage partition to store the first content item;and generates the message that identifies the first content item and the second storage division QC Ln / Lznz / E / YILI to cause the first storage controller to transfer the first content item to the second storage division ahead of schedule.

4. The computer-implemented method according to claim 1, characterized in that a media application, operating within the second interlocutor network, has access to the first content element from the second storage division.

5. The computer-implemented method according to claim 4, characterized in that a user has remote access to the media application from a network that is far from at least the first interlocutor network and the second interlocutor network.

6. The computer-implemented method according to claim 1, characterized in that: The storage partition tiered group includes at least one local storage partition and at least one cloud-based storage partition; and the second storage partition is included in a second storage partition tiered group in the second peer network.

7. The computer-implemented method according to claim 1, characterized in that it further comprises: Sending to a concentrator network, through a second storage controller included in the second interlocutor network, an update message indicating that the first content element is currently stored in the second storage division, wherein the concentrator network is connected to the second interlocutor network, and wherein a catalog included in the concentrator network is updated based on the update message.

8. The computer-implemented method according to claim 1, characterized in that it further comprises: receiving, through the first storage controller from a media application operating within the first peer network, a second content element; transmitting, through the first storage controller to the first storage division, the second content element; and sending, through the first storage controller to a concentrator unit network connected to the first peer network, an update message indicating that the second content element is currently stored in the first storage division.

9. The computer-implemented method according to claim 8, QC Ln / ίZΖΠZΖ / Β / YΙΛΙ characterized in that the second content element is received as a set of one or more files and further comprising, before transmitting the second content element to the first storage division, transferring the set of one or more files to an object.

10. The computer-implemented method according to claim 1, further comprising: transmitting, through a second storage controller included in the second peer network to a secure object storage included in a concentrator unit network, the first content element, wherein the concentrator unit network is connected to the second peer network, and wherein the secure object storage stores the first content element as a secure object acting as a source of truth for other copies of the first content element.

11. A computer network that allows access to data, characterized in that it comprises: a first peer network that includes a first storage controller that receives, from an entity remote from the first peer network, a message that identifies a first content item, wherein the first content item is identified based on a task to be executed on the first content item, wherein the first storage controller is configured to have access to a tiered group of storage partitions that includes at least one local storage partition, and at least one cloud-based storage partition, wherein the first storage controller;and a second peer network that has access to a second storage partition that stores the first content item received from the first peer network, wherein the first storage controller further: determines a first storage partition, included in the group in levels of storage partitions, that stores the first content item; retrieves, from the first storage partition, the first content item; and causes the first content item to be transmitted to the second peer network.

12. The computer network according to claim 11, characterized in that the second peer network further comprises a second storage controller that: receives the first content element from the first peer network; and causes the first content element to be stored in the second storage partition, wherein a media application, operating within the second peer network, has access to the first content element from the second storage partition. 5 13. The computer network according to claim 11, characterized in that the group in levels of storage partitions is included in a storage plane that is separate from a control plane that includes the first storage controller. 14.- The computer network according to claim 13, characterized in that it further comprises a set of transfer agents included in the control plane in the first interlocutor network, wherein the first storage controller causes at least one transfer agent included in the set of transfer agents to securely transfer the first content element from the first storage partition.

Images