Systems and methods for content distribution policy enforcement
By performing content filtering in the buffer between the storage device and the network interface card, identifying and filtering unsuitable content in the data, the problem of excessive burden on the host processor when processing large amounts of data in the prior art is solved, and efficient , stable content transmission.
Patent Information
- Application Number
- CN202410593617.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-08-25
- Filing Date
- 2024-05-14
- Publication Date
- 2024-11-26
AI Technical Summary
When processing large amounts of data, it is difficult to effectively filter content and reduce the burden on the host processor, resulting in interruption of content transmission or deterioration in quality.
Buffers are introduced between the storage device and the network interface card, the content type is identified through the content detection circuit, and the filtering policy is applied using the filtering circuit to delay transmission to perform content filtering, avoiding direct transmission of data to the main memory.
It realizes efficient filtering and transferring content suitable for the client without increasing the burden on the host processor, reducing data transmission delay and improving content transmission quality.
Smart Images

Figure CN119025022A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates generally to storage devices, and more particularly to content filtering of data on storage devices. Background Art
[0002] As the capacity provided by storage devices increases, applications can process more and more data. It may take a lot of time to transfer large amounts of data from storage devices to main memory for application processing. In addition, having the host processor execute commands to process the data may impose a burden on the host processor.
[0003] There remains a need for support for managing the data to be transferred without burdening the host processor. Summary of the invention
[0004] A device comprises: a storage device storing a content stream, a network interface device sending a filtered content stream, and a processing circuit connected to the storage device and the network interface device, wherein the processing circuit is configured to apply a filtering policy to the content stream to generate the filtered content stream.
[0005] In one embodiment, the processing circuit includes a buffer and a filtering circuit, the buffer is used to store a first content stream portion, the content stream includes a first content stream portion and a second content stream portion, the filtering circuit is configured to apply a filtering policy to the first content stream portion to generate a filtered content stream portion, and the network interface device is configured to send the filtered content stream portion.
[0006] In one embodiment, the processing circuit further includes a second buffer, the second buffer stores the third content stream portion, the second content stream includes the third content stream portion and the fourth content stream portion, the processing circuit further includes a second filtering circuit, the second filtering circuit is configured to apply the second filtering policy to the third content stream portion to generate a second filtered content stream portion, the second filtered content stream includes the second filtered content stream portion, and the network interface device is configured to send the second filtered content stream portion.
[0007] In one embodiment, the network interface device is configured to send the filtered content stream portion to the first client and send the second filtered content stream portion to the second client.
[0008] In one embodiment, the first content stream portion includes a content type, and the filter policy identifies the content type to be filtered.
[0009] In one embodiment, the processing circuit includes content detection circuitry for identifying a type of content in a first content stream portion, the first content stream including a first content stream portion and a second content stream portion.
[0010] In one embodiment, the processing circuit further includes a buffer storing the first content stream portion, and the content detection circuit is configured to identify a content type in the first content stream portion based at least in part on the first content stream portion in the buffer.
[0011] In one embodiment, the processing circuit further comprises a second buffer storing a third content stream portion and a second content detection circuit for identifying a second content type in the third content stream portion based at least in part on the third content stream portion in the second buffer.
[0012] In one embodiment, the processing circuit includes a delay circuit for delaying the network interface device for an interval before sending the filtered content stream.
[0013] In one embodiment, the processing circuit is configured to apply a filtering policy during the interval.
[0014] In one embodiment, the content flow includes a content flow portion, and the filter policy specifies deleting the content flow portion from the content flow or replacing the content flow portion in the content flow with a replacement content flow portion in the content flow.
[0015] A method includes accessing a content stream using a device, filtering the content stream using processing circuitry of the device to produce a filtered content stream, and transmitting the filtered content stream using a network interface device of the device.
[0016] In one embodiment, accessing the content stream using the device includes receiving the content stream from a source and storing the content stream in a storage device of the device.
[0017] In one embodiment, accessing a content stream using a device includes storing a first content stream portion in a buffer of a processing circuit of the device, the content stream including the first content stream portion and a second content stream portion, and filtering the content stream using the processing circuit of the device to produce a filtered content stream includes filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion.
[0018] In one embodiment, filtering a first content stream portion in a buffer of a processing circuit of the device to produce a filtered content stream portion includes applying a filtering policy to the first content stream portion in a buffer of a processing circuit of the device to produce a filtered content stream portion, and the method also includes applying a second filtering policy to a second content stream portion in a buffer of a processing circuit of the device to produce a second filtered content stream portion.
[0019] In one embodiment, sending the filtered content stream using a network interface device of the device includes sending a filtered content stream portion to a first client using the network interface device and sending a second filtered content stream portion to a second client using the network interface device.
[0020] In one embodiment, filtering the content stream using the processing circuitry of the device to produce a filtered content stream includes detecting, using the processing circuitry of the device, a content type in the first content stream portion.
[0021] In one embodiment, filtering the content stream using processing circuitry of the device to produce a filtered content stream includes delaying transmission of the content stream by a network interface device of the device for an interval.
[0022] In one embodiment, filtering the content stream using the processing circuitry of the device to produce the filtered content stream further comprises: filtering the content stream using the processing circuitry of the device during the interval to produce the filtered content stream.
[0023] In one embodiment, the content stream includes a content stream portion, and filtering the content stream using the processing circuitry of the device to produce a filtered content stream includes replacing the content stream portion of the content stream with the replacement content stream portion. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The drawings described below are examples of how embodiments of the present disclosure may be implemented and are not intended to limit the embodiments of the present disclosure. Various embodiments of the present disclosure may include elements not shown in a particular drawing and / or may omit elements shown in a particular drawing. The drawings are intended to provide illustrations and may not be to scale.
[0025] Figure 1 A machine including a multifunction device for performing content filtering according to an embodiment of the present disclosure is shown.
[0026] Figure 2 The embodiment according to the present disclosure is shown Figure 1 Details of the machine.
[0027] Figure 3 The embodiment according to the present disclosure is shown Figure 1 Details of the multifunctional device.
[0028] Figure 4 The embodiment according to the present disclosure is shown. Figure 3 The content detection circuit and Figure 3 The filtering circuit processes the content stream.
[0029] Figure 5 The embodiment according to the present disclosure is shown Figure 1 Details of the storage device.
[0030] Figure 6 The present invention shows a method for communicating with a source machine and / or a client according to an embodiment of the present disclosure. Figure 1 machine.
[0031] Figure 7 The embodiment according to the present disclosure is shown Figure 1 Multifunctional equipment filtration Figure 4 Flowchart of an example process for content flow.
[0032] Figure 8 The embodiment according to the present disclosure is shown Figure 1 Multi-function device access Figure 4 Flowchart of an example process for content flow.
[0033] Fig. 9 The embodiment according to the present disclosure is shown Figure 3 The content detection circuit detects Figure 4 The content in the content stream and the Figure 3 The filter circuit filters Figure 4 Flowchart of an example process for content flow.
[0034] Fig.10 The embodiment according to the present disclosure is shown Figure 3 The delay circuit delays Figure 4 Flow diagram of an example process for delivery of a content stream. DETAILED DESCRIPTION
[0035] Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. In the following detailed description, many specific details are set forth to enable a thorough understanding of the present disclosure. However, it should be understood that one of ordinary skill in the art may practice the present disclosure without these specific details. In other cases, well-known methods, processes, components, circuits, and networks are not described in detail to avoid unnecessarily obscuring aspects of the embodiments.
[0036] It should be understood that although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without departing from the scope of the present disclosure, a first module may be referred to as a second module, and similarly, a second module may be referred to as a first module.
[0037] The terms used in the description of the present disclosure herein are only used for the purpose of describing specific embodiments and are not intended to limit the present disclosure. As used in the description of the present disclosure and the appended claims, the singular forms "one", "an" and "the" are intended to also include plural forms, unless the context clearly states otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that when used in this specification, the terms "include" and / or "comprise" specify the presence of the features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groups. The components and features of the accompanying drawings are not necessarily drawn to scale.
[0038] As data management moves toward centralized (or cloud) storage of data, it becomes increasingly important to manage the delivery of such data to clients. For some business models, the amount of data to be managed may be relatively small, with little need to regulate the use of such data. But other business models may involve the transmission of large amounts of data, and management of what data is transmitted may be important. For example, video on demand may involve large amounts of data to be transmitted over a network: a 90-minute movie may involve the transmission of 100 gigabytes (GB) or more of content. In addition, a host may want to control what videos are transmitted. For example, a host or end user may want to ensure that any video transmitted to a child does not include any pornographic or violent content.
[0039] Identifying what content should be filtered can involve the use of artificial intelligence (AI) and / or machine learning (ML) models. The AI / ML models may involve some processing of the content. For example, the AI / ML model may process each image (also known as a frame) of a video stream individually to identify which images should be filtered. Or, the AI / ML model may process the video associated with the content stream to eliminate language that is deemed inappropriate. Using a host processor to process each image or audio stream individually can place a burden on the host processor. This burden is exacerbated by the fact that any number of clients may be accessing the content at any given time, and the burden placed on the host may overtax the host processor, resulting in interruptions or degradation in quality in the delivery of the content, such as due to latency, as the host processor attempts to keep up with filtering all content streams.
[0040] Embodiments of the present disclosure solve this problem by performing content filtering in a buffer in a bridge between a storage device and a network interface card (or other delivery mechanism). Content can be sequentially retrieved from the storage device and buffered in the bridge. Content filters can then be applied to the data in the buffer, where the filtered content is identified, replaced, or eliminated while in the buffer. The network interface card can then retrieve the (filtered) content from the buffer and deliver the (filtered) content to the client.
[0041] Embodiments of the present disclosure may include multiple such buffers. Different content filters may be applied to each buffer, enabling multiple clients to access content using different content filters. For example, one client may want to filter violent content, while another client may want to filter bad language in audio content. The content stream in each buffer may be filtered to be appropriate for that client.
[0042] Embodiments of the present disclosure may perform content filtering in two stages. In the first stage, the content may be analyzed to determine what forms of content may be included. Note that this stage may be performed independently of what filtering may actually be appropriate for the client. Thus, for example, the content may be analyzed to determine which portions are pornographic, which portions are violent, which portions include offensive language, etc. In the second stage, filters appropriate for the client may be applied: content identified by the filter may be removed from the buffer based on the previous analysis.
[0043] In some embodiments of the present disclosure, the content stream may have been previously analyzed to identify the type of content included in the content stream. In such embodiments, filters may be applied based on this earlier analysis rather than repeating the analysis.
[0044] In some embodiments of the present disclosure, the content stream may have been stored on a storage device. In other embodiments of the present disclosure, the content stream may be first stored on a storage device and then analyzed and filtered according to the needs of the client.
[0045] In some embodiments of the present disclosure, the content stream can be delayed before being transmitted to the client. By delaying the transmission, the embodiments of the present disclosure have time to perform content analysis and filtering, and adapt to potential delays (e.g., when retrieving data from a storage device, when performing content analysis and filtering, and / or when transmitted by a network interface card).
[0046] Although the above discussion focuses on content filtering based on specific video or audio content, embodiments of the present disclosure can support any desired content filtering. For example, content can be filtered based on a quality of service (QoS) level suitable for the client. As an example, sports programs may be subject to broadcast delays (to encourage customers to watch the game in person, which generates revenue for franchises / sports leagues). The content stream of the game can be stored on a storage device, but a time filter can be applied to prevent the game from being transmitted to the client too quickly.
[0047] Figure 1 A machine including a multifunction device for performing content filtering according to an embodiment of the present disclosure is shown. Figure 1 In the present invention, machine 105 (which may also be referred to as a host or system) may include processor 110, memory 115, and storage device 120. Processor 110 may be any kind of processor. Processor 110 may also be referred to as a host processor. (For ease of illustration, processor 110 and other components discussed below are shown outside the machine, and embodiments of the present disclosure may include these components within the machine.) Although Figure 1 A single processor 110 is shown, but machine 105 may include any number of processors, each of which may be a single-core or multi-core processor, each of which may implement a reduced instruction set computer (RISC) architecture or a complex instruction set computer (CISC) architecture (among other possibilities), and which may be mixed in any desired combination.
[0048] The processor 110 may be coupled to a memory 115. The memory 115 may be any kind of memory, such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a permanent random access memory, a ferroelectric random access memory (FRAM), or a non-volatile random access memory (NVRAM), such as a magnetoresistive random access memory (MRAM), flash memory, etc. The memory 115 may be a volatile or non-volatile memory as desired. The memory 115 may also be any desired combination of different memory types and may be managed by a memory controller 125. The memory 115 may be used to store data that may be referred to as "short-term": that is, data that is not expected to be stored for a long time. Examples of short-term data may include temporary files, data used locally by an application (which may have been copied from other storage locations), etc.
[0049] The processor 110 and the memory 115 may also support an operating system under which various applications may run. These applications may issue requests (which may also be referred to as commands) to read data from or write data to any of the memories 115 .
[0050] Storage device 120 may be used to store what may be referred to as “long-term” data: that is, data that is intended to be stored for a longer period of time, or that does not need to be stored in memory 115. Storage device 120 may be accessed using device driver 130. Although Figure 1 One storage device 120 is shown, but any number (one or more) of storage devices may be present in the machine 105 .
[0051] Embodiments of the present disclosure may include any desired mechanism for communicating with the storage device 120. For example, the storage device 120 may be connected to one or more buses, such as a peripheral component interconnect express (PCIe) bus, or the storage device 120 may include an Ethernet interface or some other network interface. Other potential interfaces and / or protocols to the storage device 120 may include non-volatile memory express (NVMe), NVMe over fabric (NVMe-oF), remote direct memory access (RDMA), transmission control protocol / Internet protocol (TCP / IP), universal flash storage (UFS), embedded multimedia card (eMMC), InfiniBand, serial attached small computer system interface (SCSI) (SAS), Internet SCSI (iSCSI), serial AT attachment (SATA), and cache coherent interconnect protocols (such as the compute express link (CXL) protocol), as well as other possibilities.
[0052] Although Figure 1 The generic term "storage device" is used, but embodiments of the present disclosure may include any storage device format that can benefit from the use of computational storage units, examples of which may include hard disk drives and solid-state drives (SSDs). Any reference to "SSD" below should be understood to include such other embodiments of the present disclosure.
[0053] For the purposes of this document, a distinction is made between memory 115 and storage devices 120. This distinction can be understood as being based on the type of commands that are typically used to access data from a component. For example, memory 115 is typically accessed using a load or store command, while storage devices 120 are typically accessed using read and write commands. Memory 115 is also typically accessed by an operating system, while storage devices 120 are typically accessed by a file system. (As described below, cache coherent interconnect storage devices are intended to be classified as storage devices, despite the fact that they can be accessed using load and store commands as well as read and write commands.)
[0054] Alternatively, the distinction between memory 115 and storage 120 may be understood as being based on the persistence of data in a component. Memory 115 generally does not guarantee the persistence of data in the absence of power being supplied to the component, whereas storage 120 may guarantee that data will persist even in the absence of power being supplied. If such a distinction is made between memory 115 and storage 120, memory 115 may not include a non-volatile form of storage, or a non-volatile form of storage may erase data when power is restored (making the non-volatile form of storage appear empty as a volatile form of storage would appear when power is restored).
[0055] Alternatively, the distinction may be understood as being based on the speed of access to data stored by the respective components, with faster components being considered memory 115 and slower components being considered storage 120. However, using speed to differentiate between memory 115 and storage 120 is not ideal, as a solid-state drive (SSD) is typically faster than a hard drive, but would still be considered a storage 120 rather than memory 115.
[0056] The machine 105 may also include an accelerator ( Figure 1 15), which can support executing commands in locations other than processor 110. In this way, the accelerator can help reduce the load on processor 110. In addition, the accelerator can be located closer to storage device 120 to support near data processing. Performing near data processing can reduce the time required to execute commands (executing commands on data on storage device 120 can be faster than the following process: transferring data from storage device 120 to memory 115, having processor 110 execute commands on the data in memory 115, and then transferring the data from memory 115 back to storage device 120).
[0057] The machine 110 may also include a multi-function device 135. The multi-function device 135 may provide the functions of multiple devices. Figure 1 In the embodiment, the multifunction device 135 may include a storage device 120 and a network interface device 140. The storage device 120 may be any type of storage device. The network interface device 140 may be any type of network interface device. For example, the network interface device 140 may be a network interface card, a wireless connection point (such as a or transmitter and / or receiver. Wi-Fi is a registered trademark of the Wireless Ethernet Compatibility Alliance, Inc. in the United States and other countries; Bluetooth is a registered trademark of Bluetooth SIG, Inc. in the United States and other countries), or any other mechanism or component that can support the transmission and / or reception of content.
[0058] The multifunction device 135 may appear to the machine 105 as providing the functionality of both the storage device 120 and the network interface device 140. Thus, the processor 110 may issue commands to access data from the multifunction device 135 as if it were the storage device 120, and may issue commands to send or receive data via the network interface device 140 as if it were the network interface device 140. The multifunction device 135 may achieve this result by exposing functionality to the machine 105, which may then use the functionality to access various features of the multifunction device 135.
[0059] In some embodiments of the present disclosure, the machine 105 may include a device driver 130 for a multifunction device 135 instead of a device driver for the storage device 120 (or another device driver 130 for the network interface device 140). In such embodiments of the present disclosure, the device driver 130 may support all functions of the multifunction device 135, including the functions of the storage device 120 and / or the network interface device 140.
[0060] In some embodiments of the present disclosure, the multifunction device 135, the storage device 120, and the network interface device 140 may be designed to work together. That is, the storage device 120 and the network interface device 140 may know that they are connected to the multifunction device 135 instead of to the PCIe bus (and therefore to the processor 110). However, in other embodiments of the present disclosure, the storage device 120 and / or the network interface device 140 may be off-the-shelf components that can be connected to the multifunction device 135. In such embodiments of the present disclosure, the storage device 120 and / or the network interface device 140 may not know that the multifunction device 135 is between them and the processor 110. That is, the storage device 120 and / or the network interface device 140 may think that they are communicating with the processor 110, even though the request may be through the multifunction device 135 (or even initiated at the multifunction device 135).
[0061] Figure 2 The embodiment according to the present disclosure is shown Figure 1 Details of the machine. Figure 2In the embodiment of the present invention, generally, the machine 105 includes one or more processors 110, which may include a memory controller 120 and a clock 205, which may be used to coordinate the operation of the components of the machine. The processor 110 may also be coupled to a memory 115, which may include, by way of example, a random access memory (RAM), a read-only memory (ROM), or other state preservation medium. The processor 110 may also be coupled to a storage device 125 and a network connector 210, which may be, for example, an Ethernet connector or a wireless connector. The processor 110 may also be connected to a bus 215, to which a user interface 220 and input / output (I / O) interface ports and other components may be attached, and an I / O engine 225 may be used to manage the I / O interface ports.
[0062] Figure 3 The embodiment according to the present disclosure is shown Figure 1 Details of the multifunctional device 135. Figure 3 In the embodiment, the multifunction device 135 may include interfaces 305 - 1 and 305 - 2 (which may be collectively referred to as interfaces 305 ). The interface 305 - 1 may be used to send requests to the storage device 120 , and the interface 305 - 2 may be used to send requests to the network interface device 140 .
[0063] Interface 305 should not be considered to be a separate physical interface (although some embodiments of the present disclosure may use separate physical interfaces for storage device 120 and network interface 140). Instead, interface 305 can be considered to be a single physical interface provided by multifunction device 135 to the storage device 120 and network interface 140. Figure 1 The storage device 120 and the network interface device 140 may each expose various functions as described in U.S. patent application serial number 18 / 074,360 filed on December 2, 2022, which is currently pending and is incorporated herein by reference for all purposes. For example, the storage device 120 may expose one function for writing data to the storage device 120 and another function for reading data from the storage device 120 (other functions may also be exposed). Function 310-1 is an example of such a function. Similarly, the network interface device 140 may expose functions, such as function 310-2. (Functions 310-1 and 310-2 exposed by the storage device 120 and / or the network interface device 140 may be collectively referred to as function 310.) The multifunction device 135 may expose functions corresponding to these functions exposed by the storage device 120 and the network interface device 140 through the interface 305, such as functions 315-1 and 315-2 (which may be collectively referred to as function 315). When Figure 1 When the processor 110 wants to use the function of the storage device 120, Figure 1The processor 110 may trigger the appropriate function exposed by the multifunction device 135, and then the multifunction device 135 may trigger the appropriate function exposed by the storage device 120, as shown by the dashed line 320. Similarly, when Figure 1 When the processor 110 wants to use the function of the network interface device 140, Figure 1 The processor 110 may trigger the appropriate function exposed by the multifunction device 135, and then the multifunction device 135 may trigger the appropriate function exposed by the network interface device 140, as shown by the dashed line 325. The functions exposed by the storage device 120 / network interface device 140 may be determined by the multifunction device 135, and the corresponding functions may be exposed by the multifunction device 135 to the Figure 1 Of the machine 105 , the multifunction device 135 is shown as interface 305 .
[0064] Note that the functions 310-1 and 310-2 exposed by the storage device 120 and the network interface device 140 are each identified as physical function (PF) 0, while the functions 315-1 and 315-2 exposed by the multifunction device 135 are identified as PF0 and PF1. The reason for this change in numbering is that each device can start its numbering at 0. The storage device 120 and the network interface device 140 can number their functions without regard to the other device. However, because a multifunction device can receive requests to perform functions on behalf of both the storage device 120 and the network interface device 140, some functions may be renumbered to avoid conflicts (if the multifunction device 135 exposes two different functions numbered as PF 0, the multifunction device 135 may not be able to determine whether the corresponding function is on the storage device 120 or the network interface device 135). By renumbering some functions, the multifunction device 135 may be able to uniquely identify Figure 1 The processor 110 requests which function to be triggered, and can then trigger the corresponding function of the appropriate device.
[0065] In some embodiments of the present disclosure, the multifunction device 135 may expose other functionality that is unique to the multifunction device 135 (i.e., functionality that does not correspond to functionality of the storage device 120 or the network interface device 140). For example, as discussed in U.S. patent application Ser. No. 18 / 074,360 filed on Dec. 2, 2022, a multifunction device may support various functionality, such as transcoding a content stream from a format used to store the content to a format that a recipient can receive. These functionality may include encryption or compression of the content stream, to name just two examples: Other functionality may also be supported. Since such functionality may be functionality of the multifunction device 135 rather than functionality of the storage device 120 or the network interface device 140, the multifunction device 135 may also expose such functionality ( Figure 3), these functions may not be mapped to the functions of the storage device 120 or the network interface device 140.
[0066] The multifunction device 135 may include bridges 330-1 and 330-2 (which may be collectively referred to as bridges 330). The bridge 330 may serve as a Figure 1 A pass-through device for transmitting requests and responses between the processor 110 and the storage device 120 / network interface device 140. For example, if Figure 1 If the machine 105 uses a PCIe bus to communicate with the multifunction device 135 (and therefore with the storage device 120 and / or the network interface device 140), the bridge 330 can be a PCIe to PCIe bridge (because the storage device 120 and / or the network interface device 140 may desire to be connected to a PCIe bus); in other embodiments of the present disclosure, the bridge 330 can support communications using other buses and / or protocols.
[0067] By Figure 1 The machine 105 includes a multifunction device 135 (and a bridge 330) that can perform certain functions. For example, when the machine 105 wants to transfer content to a client, it usually loads the content into Figure 1 The content is then transferred to the network interface device 140. This sequence of operations involves additional steps: Figure 1 Because the multifunction device 135 is connected to (or includes) both the storage device 120 and the network interface device 140, the content stored on the storage device 120 can be directly transferred to the network interface device 140 without first being transferred to the storage device 115. Figure 1 storage 115. By avoiding the need to transfer content to Figure 1 The memory 115 can reduce the time required to actually transmit the content and can also reduce Figure 1 The total load on the memory 115 can therefore be improved Figure 1 The overall performance of the machine 105.
[0068] When content is to be delivered to the client, Figure 1 The processor 110 may inform the multifunction device 135 of the content to be transmitted and the client (eg, network address / port combination) to receive the content. Figure 1 The processor 110 can trigger a function exposed by the multifunction device 135 to start the process and identify the content and client. The function can be a function unique to the multifunction device 135, rather than a function exposed by the storage device 120 or the network interface device 140 mirrored by the multifunction device 135.
[0069] To process the transfer of the content, the multifunction device 135 may trigger an appropriate function, such as function 310-1, to read the content from the storage device 120. Note that this request to read the content may originate from the multifunction device 135 rather than from the Figure 1 The multifunction device 135 may store the content received from the storage device 120 in a buffer 335. The buffer 335 may be any form of storage device: for example, DRAM or SRAM, etc. The multifunction device 135 may then trigger a function on the network interface device 140 to transmit the content stored in the buffer 335 to the client.
[0070] In some embodiments of the present disclosure, the content to be transmitted to the client may fit into the buffer 335. However, in other embodiments of the present disclosure, the content may be larger than the buffer 335. For example, if the content is a video stream of a movie, the overall content size may easily be 100 gigabytes (GB) or more. In such embodiments of the present disclosure, the content may be divided into multiple parts, which may be stored in the buffer 335 until read by the network interface device 140, after which the next part may be transmitted to the buffer 335. This process may be repeated until the entire content has been transmitted.
[0071] In some embodiments of the present disclosure, it may be desirable to filter content. Continuing with the example of streaming a movie, there may be restrictions on what types of content to transmit. These restrictions may be set by the client (e.g., a parent may want to filter any violent content or profanity), by the host (e.g., machine 105 may want to block any pornographic content), or both. The multifunction device may be configured to perform such content filtering.
[0072] The multifunction device 135 may include content detection circuitry 340 and filtering circuitry 345. The content detection circuitry 340 may identify what type of content is found in the portion of the content stream currently stored in the buffer 335. The content detection circuitry 340 may implement, for example, one or more artificial intelligence (AI) / machine learning (ML) models or neural networks to detect various types of content. The content detection circuitry 340 may implement more than one model, as different models may support detecting different types of content. For example, one AI / ML model may be better suited for detecting violence, while another neural network model may be better suited for detecting profanity. Which models the content detection circuitry 340 implements may depend on the type of content. Figure 1 machine 105. For example, Figure 1 The machine 105 may require that pornographic content not be transmitted, in which case a model that can detect pornographic content may be needed. However, if Figure 1If the machine 105 allows the client to transmit violent content, the model for detecting violent content can be omitted. (Of course, if the machine 105 allows the client to transmit violent content in addition to Figure 1 If a machine 105 applies its own filtering policy in addition to the filtering policy of the machine 105, a model for detecting violent content may still be needed.)
[0073] The filtering circuitry 345 can then use the information about what type of content is found in the portion of the content stream and apply a filtering policy to the portion of the content. The filtering policy can identify what type of content should be removed and how the portion of the content stream can be modified to remove unacceptable content. Figure 4 Content detection circuit 340 and filtering circuit 345 are discussed further.
[0074] When content is to be delivered to the client immediately without filtering, the network interface device 140 may read the content from the buffer 335 once the content is stored in the buffer 335. However, when filtering is to be performed, the filtering itself may take some time. In order to allow for the time required to perform filtering, the multifunction device 135 may include a delay circuit 350. The delay circuit 350 may delay delivery of the content from the buffer 335 to the network interface device 140 (or, alternatively, may delay access of the content from the buffer 335 by the network interface device 140) until after filtering has been performed. The delay interval imposed by the delay circuit 350 may be configurable, and any desired delay (from zero seconds or no delay, with no limit upwards) may be used. The delay interval may be set by Figure 1 machine 105, by the client or by any other desired agent.
[0075] Although Figure 3 The multifunction device 135 is shown as including each of the buffer 335, the content detection circuit 340, the filtering circuit 345, and the delay circuit 350, but embodiments of the invention may support more than one of each component. For example, by including multiple buffers 335, the multifunction device 135 may support the delivery of content to multiple clients in parallel. The content may be the same or different: for example, the same movie may be delivered to multiple clients, or different movies may be delivered to multiple clients.
[0076] Each buffer 335 may have its own associated content detection circuit 340, filtering circuit 345 and / or delay circuit 350. In such an embodiment of the present disclosure, different filtering strategies may be used to filter each content. Typically, each content detection circuit 340 may operate according to similar principles and using similar models, because the types of content that can be found in the content stream tend to be the same. However, in some embodiments of the present disclosure, different content detection circuits 340 may function differently. For example, one buffer 335 may be used to buffer audiovisual content, while another buffer 335 may be used to buffer only audio content. The content detection circuit 340 associated with the latter buffer 335 may not need to support detection of violent or pornographic content, which is typically visual content rather than audio content. Typically, each filtering circuit 345 may also operate according to similar principles and using similar models, but different filtering strategies that can identify what content should be removed from the content stream may be applied. Typically, each delay circuit 350 may also operate according to similar principles and using similar models, but different delay intervals may be applied.
[0077] In some embodiments of the present invention, the bridge 330, the buffer 335, the content detection circuit 340, the filter circuit 345, and the delay circuit 350 may be implemented as a unit shown as a processing circuit 355. The processing circuit 355 may be implemented using any desired implementation, including a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SoC), a single-core processor or a multi-core processor, a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose GPU (GPGPU), a tensor processing unit (TPU), or a neural processing unit (NPU), etc. In other embodiments of the present invention, the bridge 330, the buffer 335, the content detection circuit 340, the filter circuit 345, and the delay circuit 350 may each be implemented separately and interconnected. In such embodiments of the present disclosure, the bridge 330, the buffer 335, the content detection circuit 340, the filter circuit 345, and the delay circuit 350 may all be implemented using an FPGA, an ASIC, a SoC, a single-core or multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU, etc. In addition, each component can be implemented using the same or different structures: for example, bridge 330 can be implemented as a SoC, while buffer 335 can be implemented using DRAM, and content detection circuit 340 and filtering circuit 345 can be implemented as FPGA. All combinations that can be used to implement multi-function device 135 are considered to be covered by embodiments of the present disclosure.
[0078] Figure 4 The embodiment according to the present disclosure is shown. Figure 3 The content detection circuit 340 and Figure 3The filtering circuit 345 processes the content stream. Figure 4 , a content stream 405 is shown. The content stream 405 may be stored in Figure 1 One of any number of content streams on storage device 120. Content stream 405 can be divided into frames 410-1 to 410-8, and frames 410-1 to 410-8 can be organized into scenes 415-1 and 415-2. (Frames 410-1 to 410-8 can be collectively referred to as frames 410; scenes 415-1 and 415-2 can be collectively referred to as scenes 415.) Although Figure 4 The content stream 405 is shown as including eight frames 410 and two scenes 415, but embodiments of the present disclosure may include any number of frames and / or scenes, but are not limited thereto. Additionally, while the terms "image," "frame," and "scene" are typically associated with video content, audio content and other forms of content may also be divided into portions, albeit using different terminology (e.g., for audio content, the term "frame" may be replaced with a certain interval of audio content, such as one second of audio content, and the term "scene" may be replaced with "track"). For purposes of this discussion, the terms "frame" and "scene" are intended to apply to any content stream, not just video content.
[0079] The content stream 405 may also be divided into multiple parts. The parts of the content stream 405 may be sized to fit Figure 3 335, or they can be determined by how much content can be processed at one time by the content detection circuit 340. Each portion can include one or more frames and / or scenes. In addition, dividing the content stream 405 into multiple portions can allow more than one portion of the content stream 405 to be stored in the buffer 335. Figure 3 335. For example, Figure 3 Buffer 335 may be large enough to store both scenes 415-1 and 415-2. Figure 4 For purposes of , each frame 410 may be considered a separate portion of content stream 405 ; however, this assumption is merely for purposes of explanation, and a portion of content stream 405 may include more than one frame 410 .
[0080] Content detection circuitry 340 may inspect each portion of content stream 405. Content detection circuitry may apply models 420-1 through 420-3 (which may be collectively referred to as model 420) to determine what type of content may be found in a portion of content stream 405. Figure 3As discussed, each model 420 may be designed to detect a specific type of content, and the models 420 working together may identify what type of content is in a specific portion of the content stream 405. Note that any portion of the content stream 405 may have zero, one, or more different types of content. For example, one portion of the content stream 405 may not have any type of content (as may occur during a fade transition between different scenes 415), while another portion of the content stream 405 may have both violent content and profane language (as may occur in a scene where people are shooting and cursing at each other).
[0081] When content detection circuitry 340 detects any particular type of content in a portion of content stream 405, content detection circuitry 340 may mark that portion of content stream 405 to indicate that the content type has been detected. For example, label 425 is shown attached to portion 410-3 of content stream 405, indicating that portion 410-3 includes both offensive language and violent content; other portions of content stream 405 may be similarly marked. In some embodiments of the present disclosure, label 425 may be stored with content stream 405 (e.g., in Figure 3 335 of the content stream 405); in other embodiments of the present disclosure, the content detection circuit 340 may transmit the tag 425 (and any other tags for other portions of the content stream 405) separately to the filtering circuit 345. Note that by storing the tag 425 in the buffer associated with the portion of the content stream 405 Figure 1 The content detection circuit 340 may be omitted from future transmissions of the content stream 405 on the storage device 120: the tag 425 (and any other tags associated with other portions of the content stream 405) may be removed from the storage device 120. Figure 1 The content may be retrieved from storage device 120 and used by filtering circuit 345 without first applying content detection circuit 340.
[0082] Note that content detection circuitry 340 does not necessarily filter content stream 405 itself: which portions of content stream 405 are to be filtered are determined by the appropriate filtering policy to be applied to content stream 405. But content detection circuitry 340 plays its role in identifying what types of content may be found in various portions of content stream 405, so that filtering circuitry 345 can then filter out appropriate portions of content stream 405.
[0083] In some embodiments of the present disclosure, the content detection circuit 340 may detect the content stored in the Figure 3405. In fact, the content detection circuitry 340 may operate in real time as data is waiting to be transmitted to the client. But what type of content is to be found in a portion of the content stream 405 is a relatively static concept: if there is violent content, there is violent content, if there is profane language, there is profane language, and so on. The type of content found in the content stream 405 may not change over time unless the content itself changes. For content such as movies, such changes are typically infrequent and may never occur. Therefore, the content detection circuitry 340 may operate to identify and tag portions of the content stream 405 before any client requests the content stream 405. That is, the content detection circuitry 340 may process the content stream 405 to identify what type of content may be found in the portion of the content stream 405. The tags 425 associated with the portion of the content stream 405 may then be stored in a cache before any client requests the content stream 405. Figure 1 405 . Then, when a client requests the content stream 405 , the tags 425 may be retrieved along with the portion of the content stream 405 so that the filtering circuitry 345 may apply an appropriate filter to the content stream 405 . However, in some embodiments of the present disclosure, new models 420 may be added, or existing models 420 may be updated, to identify new types of content. If new models 420 are added or existing models 420 are updated, the portion of the content stream 405 may be re-analyzed by the content detection circuitry 340 to update the tags 425 that may have been previously stored to reflect the change in what type of content may be identified in the portion of the content stream 405 .
[0084] Regardless of when or how content detection circuitry 340 identifies the content type in a portion of content stream 405, filtering circuitry 345 can then use tags 425 to determine which portions of content stream 405 are to be filtered. Figure 3 As discussed, Figure 1 Different machines 105 and / or different clients may need to perform different filtering. For example, Figure 1 The machine 105 may require filtering all pornographic content, while a specific customer may wish to filter violent content and / or bad language for transmission to minors. Therefore, the filtering circuit 345 can implement one of any number of filtering strategies. Figure 4, the filtering circuit 345 is shown as supporting filtering policies 430-1 to 430-3 (which may be collectively referred to as filtering policies 430), but the filtering circuit 345 may support any number of filtering policies 430 without limitation. Each filtering policy 430 may identify what type of content is to be filtered. Thus, for example, filtering policy 430-1 may specify that pornographic content is to be removed, while filtering policy 430-2 may specify that violent content and profane language are to be removed. In some embodiments of the present disclosure, the filtering circuit 345 may apply more than one filtering policy 430 at any time, and may remove any portion of the content stream 405 that contains a content type covered by any of the applied filtering policies 430. In other embodiments of the present disclosure, the filtering circuit 345 may apply only one filtering policy that may specify exactly what type of content is to be filtered from a portion of the content stream 405. Thus, continuing with the above example, a single filtering policy 430 may indicate that pornography, violence, or any content including profane language is to be removed.
[0085] Filter policy 430 may be structured in any desired manner and may use any logical expression of what content is to be filtered. For example, filter policy 430 may specify that content that is violent or contains profane language is to be filtered, but content that is both violent and contains profane language should not be filtered. (Such a filter policy may seem impractical and is irrelevant to this example: it is left to the reader to imagine why such a filter policy might be desired)
[0086] By examining each portion of the content stream 405 and its tags 425, the filtering circuit 345 can determine what content to allow through and what content to filter. For example, after applying the filtering policy 430, the filtering circuit 345 can produce a filtered content stream 435. Like the content stream 405, the filtered content stream 435 can include frames 440-1 to 440-8, which can be organized into scenes 445-1 and 445-2. (Frames 440-1 to 440-8 can be collectively referred to as frames 440; scenes 445-1 and 445-2 can be collectively referred to as scenes 445) Although Figure 4 The content stream 435 is shown as including eight frames 440 and two scenes 445 , but embodiments of the present disclosure may include any number of frames and / or scenes without limitation.
[0087] As a result of the operation of filtering circuitry 345, some portions of filtered content stream 435 may not change, and some portions of filtered content stream 435 may change. Figure 4, frames 410-1, 410-2, 410-5, 410-7, and 410-8 are shown as unchanged frames 440-1, 440-2, 440-5, 440-7, and 440-8 in the filtered content stream 435, as indicated by the lack of cross-hatching in these frames. On the other hand, frames 410-3, 410-4, and 410-6 in the filtered content stream 435 have been filtered, as indicated by the cross-hatching in frames 440-3, 440-4, and 440-6. Embodiments of the present disclosure are not limited to which portions of content stream 405 are changed in filtered content stream 435: in some embodiments of the present disclosure, no portion of filtered content stream 435 may be changed, while in other embodiments of the present disclosure, all (or substantially all) portions of filtered content stream 435 may have been changed.
[0088] The filtering circuitry 345 may also determine how to change portions of the filtered content stream 435, such as frames 440-3, 440-4, and 440-6. In some embodiments of the present disclosure, the filtering circuitry 345 may simply delete portions of the content stream 405 that are marked as containing content to be filtered. In other embodiments of the present disclosure, the filtering circuitry 345 may replace portions of the content stream 405 that are marked as containing content to be filtered with alternative content (e.g., by replacing those portions with a screen showing "filtered content"). In other embodiments of the present disclosure, if sufficient information is provided about where the type of content can be found within the portion, a sub-portion of the content may be modified (e.g., by pixelating the video or beeping the audio), but the remainder of the portion of the content stream may remain unchanged.
[0089] In the above discussion, the focus is on filtering a single content stream 405. In some embodiments of the present disclosure, a user may be accessing a single content stream 405. But in other embodiments of the present disclosure, a user may actually access multiple content streams in parallel. For example, instead of storing a movie as a single audiovisual content stream, the movie may be stored as multiple content streams: one for video, one for audio, one for background music, one for closed captions / open captions, etc. In this way, a user may have the option of enabling or disabling specific parts of the content. For example, a person with hearing difficulties may disable audio content (recorded dialogue streams, background music streams, etc.) and may enable closed captions / open captions content, while a person with normal hearing ability may do the opposite. In this way, users can customize their experience according to their own sensory preferences.
[0090] In the case of using multiple content streams to present the desired content to the user, you can use Figure 3 Different buffers 335 of the embodiment may utilize different content detection circuits 340 and / or filtering circuits 345 to process each content stream, or different content detection circuits 340 and / or filtering circuits 345 may be used. Figure 3 A single buffer 335 and a single content detection circuit 340 / single filtering circuit 345 are used to process all selected content streams. All possible variations between these two options are also possible.
[0091] However, synchronization across content streams may be important in situations where multiple content streams may be used to deliver a single content 405. For example, if there is one second of audio in the audio content stream that is removed by filtering circuit 345, but the corresponding one second of video in the video content stream is not removed, the audio and video may become unsynchronized. This result is undesirable because unsynchronized audio and video may distract the user.
[0092] One solution to avoid out-of-sync content is to ensure that no portion of a content stream is deleted unless the corresponding portion is also deleted from all other content streams. Another solution is to avoid deleting content and instead replace it with empty space to fill the appropriate gap (in this case, a portion of the content stream is temporarily interrupted but resumed at the correct time to synchronize with other content streams). A third solution is for the filtering circuit 345 to notify other filtering circuits 345 processing other content streams that are part of the overall content to remove the corresponding portions of their content streams when content to be filtered is identified in one content stream.
[0093] Another solution is for the filter circuit 345 to remove the appropriate portion of its content stream and leave it to another element to ensure that the content delivery remains synchronized. For example, each portion of the content or at some appropriate interval (e.g., every second, every five seconds, or every 10 seconds of content) can have an associated time stamp (or some other indicator that can be used to ensure that the content across the streams is properly synchronized). The bridge 330-2 or delay circuit 350 can then use these time stamps to ensure that the content remains synchronized. If one content stream arrives at a particular time stamp before the other content streams, the delivery of that content stream can be delayed until all content streams have arrived at that time stamp, which can keep the content streams synchronized (or return them to synchronization if they are currently not synchronized).
[0094] Figure 5 The embodiment according to the present disclosure is shown Figure 1 Details of the storage device 120. Figure 5 In the embodiment of the storage device 120, the embodiment is shown as being for a solid state drive (SSD), but embodiments of the present disclosure may include other implementations, such as a hard disk drive. Figure 5In the embodiment, the storage device 120 may include a host interface layer (HIL) 505, a controller 510, and various flash memory chips 515-1 to 515-8 (also referred to as "flash memory storage"), which may be organized into various channels 520-1 to 520-4. The host interface layer 505 may manage the storage device 120 and other components (such as Figure 1 The host interface layer 505 may also manage communications with devices that are remote from the storage device 120: i.e., not considered to be Figure 1 A device that is part of the multifunction device 135 but communicates with the storage device 120, for example, via one or more network connections. These communications may include read requests to read data from the storage device 120, write requests to write data to the storage device 120, and delete requests to delete data from the storage device 120.
[0095] The host interface layer 505 may manage interfaces across only a single port, or it may manage interfaces across multiple ports. Alternatively, the storage device 120 may include multiple ports, each of which may have a separate host interface layer 505 to manage interfaces across that port. Embodiments of the inventive concept may also mix the possibilities (e.g., an SSD with three ports may have one host interface layer for managing one port and a second host interface layer for managing the other two ports). The host interface layer 505 may communicate with other components via a connection 525, which may be, for example, a PCIe connection, an M.2 connection, a U.2 connection, a SCSI connection, or a SATA connection, etc.
[0096] The controller 510 may use a flash memory controller 530 to manage read and write operations on the flash memory chips 515-1 to 515-8 as well as garbage collection and other operations. The SSD controller 510 may also include a flash translation layer 535. The flash translation layer 535 may manage logical block addresses (LBAs) (such as those specified by the flash memory controller 530). Figure 1 The flash translation layer 535 does not need to notify the host 105 when data is moved from one block to another within the storage device 120. Figure 1 Host 105.
[0097] Although Figure 5 The storage device 120 is shown as including eight flash memory chips 515-1 to 515-8 organized into four channels 520-1 to 520-4, but embodiments of the inventive concept may support any number of flash memory chips organized into any number of channels. Figure 5 shows the structure of an SSD, but can be used with Figure 5 The structure shown in FIG. 1 is different from that shown in FIG. 1 and is implemented in other storage devices (eg, hard drives) to manage reading and writing data, but has similar potential benefits.
[0098] Although Figure 5 The storage device 120 is shown as being merely a storage device, but embodiments of the present disclosure may include other components within the storage device 120. For example, the storage device 120 may include or have associated therewith a computational storage unit or accelerator that may support near data processing. The computational storage unit or accelerator may be provided by Figure 1 processor 110 (or attached to Figure 1 other devices of the multi-function device 135) to perform various operations.
[0099] Figure 6 The present invention shows a method for communicating with a source machine and / or a client according to an embodiment of the present disclosure. Figure 1 Machine 105. Figure 6 , machine 105 is shown connected to network 605. Network 605 can be any kind of network, including a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or a global network, such as the Internet. Network 605 can be implemented using a wired network connection (such as an Ethernet connection) or a wireless connection that supports any form of wireless communication. Network 605 can also include any desired combination of the above network types, mixing wired and wireless networks and / or mixing different network types.
[0100] Client 610 is also shown connected to network 605. Client 610 may request content to be streamed from machine 105 over network 605, and machine 105 may transmit the requested content (which may be filtered) to client 610.
[0101] Figure 6 Also shown is an origin machine 615. In some embodiments of the disclosure, client 610 may request content from machine 105 that is not currently stored on machine 105. While machine 105 may be able to redirect the request to a machine that stores the content, such as origin machine 615, in some embodiments of the disclosure, it may be desirable to transfer the content from origin machine 615 to machine 105 and then transfer the content to client 610. For example, client 610 may be only the first of many clients to request content from machine 105, or where machine 105 and client 610 are relatively close to each other, while origin machine 615 may be relatively far from client 610. In these cases, it may be more efficient for origin machine 615 to transfer a copy of the content to machine 105 rather than directing the request for the content to origin machine 615.
[0102] To transfer content from source machine 615 to machine 105, the content in question may be transmitted over network 605. Machine 105 may then store the content in Figure 1 The content may then be transferred to the client 610 as described above. (Of course, in some embodiments of the present disclosure, the content may be stored in Figure 1 on the storage device 120 for future use and also stored in Figure 3 buffer 335 for content detection and filtering as described above to accelerate the delivery of content to client 610).
[0103] Although Figure 6 A machine 105, one client 610, and one source machine 615 are shown, but embodiments of the present disclosure may support any number of clients 610 and / or any number of source machines 615 in communication with the machine 105 over the network 605. Thus, for example, at any time, any number (zero or more) of clients 610 may request content, and at any time, the machine 105 may deliver content from any number (zero or more) of source machines 615.
[0104] Figure 7 The embodiment according to the present disclosure is shown Figure 1 Multifunctional device 135 filtration Figure 4 A flowchart of an example process for content flow 405. Figure 7 In block 705, Figure 1 The multifunction device 135 can access Figure 4 As described above, this access may involve Figure 4 Content stream 405 (or Figure 4 405 ) from Figure 1 The storage device 120 is transmitted to Figure 3 Buffer 335. At block 710, Figure 3 The filtering circuit 345 can filter Figure 4 Content stream 405 (or Figure 4 405 ) to generate Figure 4 Finally, at block 715, Figure 1 The network interface device 140 may send Figure 4 Filtered content stream 435.
[0105] Figure 8 The embodiment according to the present disclosure is shown Figure 1 Multi-function device 135 access Figure 4 A flowchart of an example process for content flow 405. Figure 8 In block 805, Figure 1 The multifunctional device 135 can be Figure 6 The source machine 615 receives Figure 4 405. At block 810, Figure 1 The storage device 120 can store Figure 4 405. If Figure 4 The content of the stream 405 is already stored in Figure 1 On the storage device 120, blocks 805 and 810 may be omitted, as indicated by dashed line 815. At block 820, Figure 1 The multifunctional device 135 can be Figure 1 120 accesses to storage devices Figure 4 Finally, at block 825, Figure 1 The multifunctional device 135 can Figure 4 Content stream 405 (or Figure 4 A portion of the content stream 405) is stored in Figure 3 The processing circuit (355) Figure 3 in the buffer 335.
[0106] Fig. 9 The embodiment according to the present disclosure is shown Figure 3 The content detection circuit 340 detects Figure 4 The content in the content stream 405 and the Figure 3 The filter circuit 345 filters Figure 4 A flowchart of an example process for content flow 405. Fig. 9 In block 905, Figure 3 The content detection circuit 340 can be Figure 4 Detected in part of the content stream 405 Figure 4 The content type 425. At block 910, Figure 3 The content detection circuit 340 can Figure 4 The content type 425 is Figure 4 The association may be stored in Figure 1 The storage device 120 may be stored locally on Figure 3 The content detection circuit 340 (for transmitting to Figure 3 Filter circuit 345). If Figure 4 The content type 425 has been determined and Figure 4 associated with a portion of content stream 405, for example, if content type 425 is already stored in Figure 1 If the storage device 120 is used as the storage device 120, then boxes 905 and 910 can be omitted, as shown by the dotted line 915.
[0107] At block 920, Figure 3The filtering circuit 345 can determine Figure 4 Does the filtering policy 430 identify Figure 4 Content-type 425. This can involve Figure 3 The content detection circuit 340 receives Figure 4 Content-type 425, or from Figure 1 120 accesses to storage devices Figure 4 content type 425, depending on where the content type 425 is currently available. Figure 4 425 Content-Type Not Found Figure 4 , then at block 925, Figure 3 The filtering circuit 345 may leave portions of the content stream 405 unchanged (e.g., Figure 4 Content Flow 405 Figure 4 Frames 410-1, 410-2, 410-5, 410-7, and 410-8 are unchanged included in Figure 4 The filtered content stream 435 is as Figure 4 Otherwise, at block 930, Figure 3 The filtering circuitry 345 may delete, replace, or otherwise modify portions of the content stream 405 to Figure 4 Filter out the content stream 405 Figure 4 Content type 425 (e.g., Figure 4 Content Flow 405 Figure 4 Frames 410-3, 410-4 and 410-6 are deleted, replaced or modified as Figure 4 4 and 440 - 6 of the filtered content stream 435 ).
[0108] Fig.10 The embodiment according to the present disclosure is shown Figure 3 The delay circuit 350 delays Figure 4 Flow diagram of an example process for delivering a content stream 405. Fig.10 In block 1005, Figure 3 The delay circuit 350 can Figure 4 The transmission of the content stream 405 is delayed by an interval. At block 1010, during the interval, Figure 3 The content detection circuit 340 and / or Figure 3 The filter circuit 345 can be used to filter Figure 4 405 of the content stream.
[0109] exist Figure 7-10, some embodiments of the present disclosure are shown. However, those skilled in the art will recognize that other embodiments of the present disclosure are possible by changing the order of the boxes, by omitting boxes, or by including links not shown in the drawings. All these variations of the flow charts are considered embodiments of the present disclosure, whether explicitly described or not.
[0110] Embodiments of the present disclosure include systems and methods for integrating storage devices such as solid-state drives (SSDs) and network interface cards (NICs) and thereby providing an efficient architecture for streaming content distribution. The fast non-volatile memory (NVMe) controllers of the SSD and NIC can be independently exposed to the host using separate PCIe functions (PF / VF). A peer-to-peer (P2P) data path can be provided between the storage device and the NIC. Various features can be performed on the data in the P2P buffer before transmission, such as inserting delays in content distribution, filtering of certain content types, etc.
[0111] By providing content directly from the SSD to the NIC for distribution to end users, system resource costs can be saved, such as host bus bandwidth, host memory bandwidth, CPU cycles, energy spent on moving data, etc. In addition, embodiments of the present disclosure can provide a lower latency solution for applications such as streaming. When content data is provided to the NIC from the storage device, more advanced functions such as latency insertion, content filtering and inspection, and end-user policies / SLAs can be performed in an efficient manner.
[0112] In embodiments of the present disclosure, a processing element such as a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), or other processor may be used to connect one or more SSD controllers and / or one or more network interface cards (NICs) to a host. The SSD controllers and NICs may be connected to such an FPGA using a connector so that different types may be connected as needed. In some embodiments of the present disclosure, some SSD controllers and / or computing resources may be connected in a fixed manner if desired. In other embodiments of the present disclosure, the SSD controller, P2P buffer, and associated content filters / processing logic, and the NIC controller may be fully integrated into a single processing element. In other embodiments of the present disclosure, these elements may be connected to each other using technologies such as chiplets in a single package such as an MCP (multi-chip package).
[0113] As shown in the figure above, one or more SSD controllers and one or more NICs are exposed to the host through a PCIe endpoint (EP) physical function (PF) or virtual function (VF) in a transparent manner using a PCIe-PCIe bridge. The SSD controller and NIC can be connected to the FPGA using a PCIe root port (RP). The FPGA logic can perform PCIe pass-through of host and device interactions and host protocols. That is, the host system software stack (such as SSD device drivers and NIC drivers) and application frameworks (such as web servers, content servers, etc.) can talk directly to the SSD controller and NIC through the FPGA. This connection can facilitate easy integration of the device into an existing application software stack. The architecture can enable the control plane in the host at the same data plane in the device.
[0114] In other embodiments of the present disclosure, the device may have other host interfaces, such as Ethernet, TCP / IP, RDMA, NVMe-oF, UFS, eMMC, SAS, SATA, etc., instead of PCIe. Similarly, in other embodiments of the present disclosure, the FPGA interface to the SSD controller and NIC may use other protocols, such as Ethernet, TCP / IP, RDMA, NVMe-oF, UFS, eMMC, SAS, SATA, etc. The embodiments of the present disclosure may be described with reference to PCIe and NVMe as transport and host protocols for communication between the host and the device, but other transport and host protocols may be used to implement optimal data processing operations in the proposed storage device.
[0115] The PCIe bridge (which may be a lightweight bridge (LWB)) can forward all host PCIe packets and traffic to the SSD controller and the NIC attached to it, using appropriate translation if necessary. Similarly, the PCIe bridge can forward PCIe packets and traffic originating from the SSD controller and the attached NIC to the host, using appropriate translation if necessary. That is, the SSD and NIC can perform data DMA operations to the host system memory without any interference from the FPGA logic.
[0116] The device may provide a peer-to-peer (P2P) data buffer that may be used to transfer media content data directly between the SSD controller and the NIC without sending it to the host memory. Such P2P data transfer may reduce consumed energy as well as CPU cycles, host memory bandwidth, and host bus bandwidth. P2P data transfer may also enable lower latency for content distribution. The P2P buffer may use on-chip SRAM, off-chip DRAM, or any other memory or combination of multiple memory elements.
[0117] In some embodiments of the present disclosure, the processing element may include one or more processor cores or logic elements attached to the P2P buffer to perform certain content detection and filtering operations before the content data is provided to the NIC for transmission.
[0118] In some embodiments of the present disclosure, the P2P buffer contents may be delayed for a certain amount of time before being provided to the NIC. The delay time may be dynamically specified by the host, or may be a device setting.
[0119] In other embodiments of the present disclosure, the content in the P2P buffer may be selectively discarded and not provided to the NIC for transmission to the end user. The host may dynamically instruct the device to discard a certain amount of content present in the P2P buffer. In some embodiments of the present disclosure, the discarding of content may be time-based, such as 10 seconds or 1 minute. In other embodiments of the present disclosure, the host may set a discard time window by giving start discard and stop discard instructions.
[0120] In other embodiments of the present disclosure, content discarding can be performed based on the detected content type. The host can program the type of content to be detected in the P2P buffer. The device may include content detection logic based on artificial intelligence (AI) / machine learning (ML) to detect bad content. If bad content is detected, the device may automatically discard the content. In other embodiments of the present disclosure, the device may maintain statistics of such content detected, and may also notify the host that bad content has been discarded.
[0121] In other embodiments of the present disclosure, the discarding of content can be based on metadata related to the content being distributed and end-user preferences and settings. The host can program the discarding policy into the integrated device based on the end-user account details. When the content is provided to the NIC, the processing element logic can check the metadata against the discarding policy and can appropriately discard the content data. The discarding policy programmed by the host can also be a function of the end-user service level agreement. Some other discarding parameters can include date, time, month, dynamically detected content type, content type based on metadata, end-user ID, network parameters such as TCP / IP address, MAC address, storage parameters such as namespace ID, NVM set identifier, submission queue (SQ) / completion queue (CQ) identifier, host identifier, etc.
[0122] An example of such an end-user content discard policy may be "do not stream content between 10pm and 7am". Another example of an end-user discard policy may be "do not stream R (or higher) rated content". Such content distribution policy checking and enforcement at the data source as the SSD may prevent unnecessary content delivery network (CDN) traffic in the network, thereby reducing congestion in the network.
[0123] Various filtering operations on the data contained in the P2P buffer as described above can be performed under the guidance of the device without involving the host. In some embodiments of the present disclosure, the FPGA-based content filtering step can be performed under the guidance of the host. The host can use the host bus interface to provide such instructions to one or more PCIe functions.
[0124] The following discussion is intended to provide a brief general description of suitable one or more machines in which certain aspects of the present disclosure may be implemented. One or more machines may be controlled at least in part by input from conventional input devices (such as a keyboard, mouse, etc.) and by instructions received from another machine, interaction with a virtual reality (VR) environment, biometric feedback, or other input signals. As used herein, the term "machine" is intended to broadly cover a single machine, a virtual machine, or a system of communicatively coupled machines, virtual machines, or devices operating together. Exemplary machines include computing devices such as personal computers, workstations, servers, portable computers, handheld devices, phones, tablets, etc., and transportation equipment such as private or public transportation, for example, cars, trains, taxis, etc.
[0125] One or more machines may include embedded controllers, such as programmable or non-programmable logic devices or arrays, application specific integrated circuits (ASICs), embedded computers, smart cards, etc. One or more machines may utilize one or more connections to one or more remote machines, such as through a network interface, modem, or other communication coupling. The machines may be interconnected through a physical and / or logical network, such as an intranet, the Internet, a local area network, a wide area network, etc. Those skilled in the art will appreciate that network communications may utilize a variety of wired and / or wireless short-range or long-range carriers and protocols, including radio frequency (RF), satellite, microwave, Institute of Electrical and Electronics Engineers (IEEE) 802.11, Light, infrared, cable, laser, etc.
[0126] Embodiments of the present disclosure may be described by reference to or in conjunction with associated data including functions, processes, data structures, applications, etc., which, when accessed by a machine, cause the machine to perform a task or define an abstract data type or a low-level hardware context. The associated data may be stored in, for example, volatile and / or non-volatile memory (e.g., RAM, ROM, etc.), or in other storage devices and their associated storage media (including hard disk drives, floppy disks, optical storage, tapes, flash memory, memory sticks, digital video disks, bio-storage, etc.). The associated data may be transmitted in a transmission environment (including physical and / or logical networks) in the form of packets, serial data, parallel data, propagation signals, etc., and may be used in a compressed or encrypted format. The associated data may be used in a distributed environment and stored locally and / or remotely for machine access.
[0127] Embodiments of the present disclosure may include a tangible, non-transitory machine-readable medium including instructions executable by one or more processors, including instructions for performing aspects of the present disclosure as described herein.
[0128] The various operations of the above methods may be performed by any suitable unit capable of performing the operations, such as various hardware and / or software components, circuits and / or modules. Software may include an ordered list of executable instructions for implementing logical functions, and may be embodied in any "processor-readable medium" for use by or in conjunction with an instruction execution system, device or apparatus (such as a single-core or multi-core processor or a system including a processor).
[0129] The blocks or steps of the methods or algorithms and functions described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. If implemented in software, the functions may be stored on or transmitted via a tangible, non-transitory computer-readable medium. The software module may reside in a random access memory (RAM), a flash memory, a read-only memory (ROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a register, a hard disk, a removable disk, a CD ROM, or any other form of storage medium known in the art.
[0130] The principles of the present disclosure have been described and illustrated with reference to the illustrated embodiments, and it will be appreciated that the illustrated embodiments may be modified in arrangement and detail without departing from these principles, and may be combined in any desired manner. Also, although the foregoing discussion has focused on specific embodiments, other configurations are contemplated. In particular, even though expressions such as "according to embodiments of the present disclosure" are used herein, these phrases are generally intended to refer to embodiment possibilities, and are not intended to limit the present disclosure to specific embodiment configurations. As used herein, these terms may refer to the same or different embodiments that may be combined into other embodiments.
[0131] The foregoing illustrative embodiments should not be construed as limiting the disclosure thereof. Although some embodiments have been described, it will be readily appreciated by those skilled in the art that many modifications may be made to these embodiments without substantially departing from the novel teachings and advantages of the present disclosure. Therefore, all such modifications are intended to be included within the scope of the present disclosure as defined in the claims.
[0132] The embodiments of the present disclosure may be extended to the following statements, but are not limited thereto:
[0133] Statement 1. An embodiment of the present disclosure includes an apparatus comprising:
[0134] a storage device for storing content streams;
[0135] a network interface device for sending the filtered content stream; and
[0136] a processing circuit connected to the storage device and the network interface device,
[0137] The processing circuit is configured to apply a filtering policy to the content flow to generate the filtered content flow.
[0138] Statement 2. Embodiments of the present disclosure include a device according to Statement 1, wherein the storage device comprises a solid state drive (SSD).
[0139] Statement 3. An embodiment of the present disclosure includes a device according to Statement 1, wherein the network interface device includes a network interface card.
[0140] Statement 4. Embodiments of the present disclosure include the device of Statement 1, wherein the network interface device is configured to send the filtered content stream to a client.
[0141] Statement 5. An embodiment of the present disclosure includes an apparatus according to Statement 1, wherein:
[0142] The processing circuit comprises:
[0143] a buffer for storing a first content stream portion, the content stream comprising the first content stream portion and a second content stream portion; and
[0144] filtering circuitry configured to apply the filtering policy to the first content stream portion to produce a filtered content stream portion; and
[0145] The network interface device is configured to transmit the filtered content stream portion.
[0146] Statement 6. An embodiment of the present disclosure includes a device according to Statement 5, wherein the filtering circuit includes a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SoC), a single-core processor or a multi-core processor, a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose GPU (GPGPU), a tensor processing unit (TPU), or a neural processing unit (NPU).
[0147] Statement 7. Embodiments of the present disclosure include an apparatus as recited in Statement 5, wherein the processing circuit further comprises a second buffer.
[0148] Statement 8. An embodiment of the present disclosure includes an apparatus according to Statement 7, wherein:
[0149] The second buffer stores a third content stream portion; and
[0150] The filtering circuitry is configured to apply the filtering policy to the third content stream portion to produce a second filtered content stream portion; and
[0151] The network interface device is configured to transmit a second filtered content stream portion.
[0152] Statement 9. An embodiment of the present disclosure comprises an apparatus according to Statement 7, wherein:
[0153] The second buffer stores a third content stream portion;
[0154] The processing circuitry further includes a second filtering circuit configured to apply the filtering policy to the third content stream portion to produce a second filtered content stream portion; and
[0155] The network interface device is configured to transmit a second filtered content stream portion.
[0156] Statement 10. An embodiment of the present disclosure includes an apparatus according to Statement 9, wherein the second filtering circuit comprises an FPGA, an ASIC, a SoC, a single core processor or a multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU.
[0157] Statement 11. An embodiment of the present disclosure includes a device according to Statement 9, wherein the network interface device is configured to transmit the second filtered content stream portion based at least in part on the transmission of the filtered content stream portion.
[0158] Statement 12. An embodiment of the present disclosure includes a device according to Statement 9, wherein the network interface device is configured to send the filtered content stream portion and the second filtered content stream portion to a client.
[0159] Statement 13. An embodiment of the present disclosure includes a device according to Statement 9, wherein the network interface device is configured to send the filtered content stream portion to a first client and send the second filtered content stream portion to a second client.
[0160] Statement 14. An embodiment of the present disclosure includes an apparatus according to Statement 7, wherein:
[0161] The second buffer stores a third content stream portion, the second content stream comprising the third content stream portion and a fourth content stream portion;
[0162] The processing circuitry further includes a second filtering circuit configured to apply a second filtering policy to the third content stream portion to produce a second filtered content stream portion, the second filtered content stream including the second filtered content stream portion; and
[0163] The network interface device is configured to transmit a second filtered content stream portion.
[0164] Statement 15. An embodiment of the present disclosure includes an apparatus according to Statement 14, wherein the second filtering circuit includes an FPGA, an ASIC, a SoC, a single-core processor or a multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU.
[0165] Statement 16. An embodiment of the present disclosure includes a device according to Statement 14, wherein the network interface device is configured to send the filtered content stream portion to a first client and send the second filtered content stream portion to a second client.
[0166] Statement 17. An embodiment of the present disclosure includes an apparatus according to Statement 5, wherein:
[0167] The first content stream portion includes a content type; and
[0168] A filtering policy identifies the type of content to filter.
[0169] Statement 18. An embodiment of the present disclosure includes an apparatus according to Statement 17, wherein the first content stream portion further includes a second content type.
[0170] Statement 19. An embodiment of the present disclosure includes a device according to Statement 17, wherein the storage device is configured to store a content type associated with the first content stream portion.
[0171] Statement 20. An embodiment of the present disclosure includes an apparatus according to Statement 1, wherein the processing circuit includes content detection circuitry for identifying a content type in a first content stream portion, the first content stream including the first content stream portion and a second content stream portion.
[0172] Statement 21. An embodiment of the present disclosure includes a device according to Statement 20, wherein the content detection circuit includes an FPGA, an ASIC, a SoC, a single-core processor or a multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU.
[0173] Statement 22. An embodiment of the present disclosure includes an apparatus according to Statement 20, wherein the content detection circuit is further configured to identify a second content type in the first content stream portion.
[0174] Statement 23. An embodiment of the present disclosure includes an apparatus according to Statement 20, wherein:
[0175] The processing circuit further includes: a buffer storing the first content stream portion; and
[0176] The content detection circuit is configured to identify a content type in the first content stream portion based at least in part on the first content stream portion in the buffer.
[0177] Statement 24. An embodiment of the present disclosure includes a device according to Statement 20, wherein the content detection circuit is configured to identify a content type in the first content stream portion and store the content type on the storage device associated with the first content stream portion.
[0178] Statement 25. An embodiment of the present disclosure includes the apparatus of Statement 20, the processing circuit further comprising:
[0179] a second buffer storing a third content stream portion; and
[0180] Second content detection circuitry is configured to identify a second content type in the third content stream portion based at least in part on the third content stream portion in the second buffer.
[0181] Statement 26. An embodiment of the present disclosure includes an apparatus according to Statement 25, wherein said content stream further includes said third content stream portion.
[0182] Statement 27. An embodiment of the present disclosure includes an apparatus according to Statement 25, wherein the second content stream includes a third content stream portion.
[0183] Statement 28. An embodiment of the present disclosure includes the apparatus of Statement 20, said processing circuitry further comprising second content detection circuitry for identifying a second content type in said third content stream portion and storing said second content type in association with said third content stream portion.
[0184] Statement 29. An embodiment of the present disclosure includes an apparatus according to Statement 28, wherein said content stream further includes said third content stream portion.
[0185] Statement 30. An embodiment of the present disclosure comprises an apparatus according to Statement 28, wherein the second content stream comprises said third content stream portion.
[0186] Statement 31. An embodiment of the present disclosure includes an apparatus as recited in Statement 1, wherein the filtering policy is one of the filtering policy and a second filtering policy.
[0187] Statement 32. An embodiment of the present disclosure includes a device according to Statement 1, wherein the processing circuit includes a delay circuit to delay the network interface device for an interval before sending the filtered content stream.
[0188] Statement 33. An embodiment of the present disclosure includes an apparatus according to Statement 32, wherein said processing circuit is configured to apply said filtering policy during said interval.
[0189] Statement 34. An embodiment of the present disclosure comprises a device according to Statement 32, wherein the interval is configurable by the host.
[0190] Statement 35. An embodiment of the present disclosure includes a device as recited in Statement 1, wherein the storage device is configured to receive the content stream from a source and store the content stream.
[0191] Statement 36. An embodiment of the present disclosure includes an apparatus according to Statement 1, wherein:
[0192] The content stream comprises a content stream portion; and
[0193] The filtering policy specifies that a content flow portion is deleted from the content flow or that a content flow portion in the content flow is replaced with a replacement content flow portion in the content flow.
[0194] Statement 37. An embodiment of the present disclosure includes an apparatus according to Statement 1, further comprising:
[0195] A first bridge for allowing communication between the storage device and the processor; and
[0196] A second bridge is provided, wherein the second bridge is configured to allow communication between the network interface device and the processor.
[0197] Statement 38. An embodiment of the present disclosure includes a method comprising:
[0198] Use the device to access content streams;
[0199] filtering the content stream using processing circuitry of the device to produce a filtered content stream; and
[0200] The filtered content stream is sent using a network interface device of the device.
[0201] Statement 39. An embodiment of the present disclosure includes a method according to Statement 38, wherein accessing the content stream using the device includes accessing the content stream from a storage device of the device.
[0202] Statement 40. An embodiment of the present disclosure includes a method according to Statement 39, wherein accessing the content stream from the storage device of the device includes accessing the content stream from a solid state drive (SSD) of the device.
[0203] Statement 41. An embodiment of the present disclosure includes a method according to Statement 38, wherein accessing the content stream using the device includes receiving the content stream from a source.
[0204] Statement 42. An embodiment of the present disclosure includes a method according to Statement 41, wherein receiving the content stream from the source includes storing the content stream in a storage device of the device.
[0205] Statement 43. An embodiment of the present disclosure includes a method according to Statement 42, wherein storing the content stream in a storage device of the device comprises storing the content stream in a solid state drive (SSD) of the device.
[0206] Statement 44. An embodiment of the present disclosure includes a method according to Statement 38, wherein accessing the content stream using the device includes storing the content stream in the processing circuitry of the device.
[0207] Statement 45. An embodiment of the present invention comprises a method according to Statement 44, wherein storing the content stream in the processing circuit of the device comprises storing a first content stream portion in the processing circuit of the device, the content stream comprising the first content stream portion and a second content stream portion.
[0208] Statement 46. An embodiment of the present disclosure includes a method according to Statement 45, wherein storing the first content stream portion in the processing circuitry of the device comprises storing the first content stream portion in a buffer of the processing circuitry of the device.
[0209] Statement 47. An embodiment of the present disclosure includes a method according to Statement 46, wherein filtering the content stream using the processing circuit of the device to produce a filtered content stream includes: filtering a first content stream portion in a buffer of the processing circuit of the device to produce a filtered content stream portion.
[0210] Statement 48. An embodiment of the present disclosure includes a method according to Statement 47, wherein sending the filtered content stream using a network interface device of the device includes sending the filtered content stream portion using the network interface device.
[0211] Statement 49. An embodiment of the present disclosure includes a method according to Statement 48, wherein sending the filtered content stream portion using the network interface device includes sending the filtered content stream portion to a client using the network interface device.
[0212] Statement 50. An embodiment of the present disclosure includes a method according to Statement 47, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the second content stream portion in the buffer of the processing circuit of the device to produce a second filtered content stream portion.
[0213] Statement 51. Embodiments of the present disclosure include a method according to Statement 50, wherein:
[0214] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0215] Filtering the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion includes applying the filtering policy to the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion.
[0216] Statement 52. An embodiment of the present disclosure includes a method according to Statement 50, wherein filtering the second content flow portion in the buffer of the processing circuit of the device to produce the second filtered content flow portion includes: filtering the second content flow portion in the buffer of the processing circuit of the device to produce the second filtered content flow portion based at least in part on the transmission of the filtered content flow portion.
[0217] Statement 53. An embodiment of the present disclosure includes a method according to Statement 52, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0218] Statement 54. An embodiment of the present disclosure includes a method according to Statement 53, wherein sending the filtered content stream portion and the second filtered content stream portion using the network interface device includes sending the filtered content stream portion and the second filtered content stream portion to a client using the network interface device.
[0219] Statement 55. An embodiment of the present disclosure includes a method according to Statement 47, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the second content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion.
[0220] Statement 56. Embodiments of the present disclosure include a method according to Statement 55, wherein:
[0221] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0222] Filtering the second content flow portion in the second buffer of the processing circuit of the device to produce the second filtered content flow portion includes: applying the filtering policy to the second content flow portion in the second buffer of the processing circuit of the device to produce the second filtered content flow portion.
[0223] Statement 57. Embodiments of the present disclosure include a method according to Statement 55, wherein:
[0224] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a first filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0225] Filtering the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion includes applying a second filtering policy to the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion.
[0226] Statement 58. An embodiment of the present disclosure includes a method according to Statement 55, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0227] Statement 59. An embodiment of the present disclosure includes a method according to Statement 58, wherein sending said filtered content stream portion and said second filtered content stream portion using said network interface device comprises:
[0228] sending the filtered content stream portion to a first client using the network interface device; and
[0229] The second filtered content stream portion is sent to a second client using the network interface device.
[0230] Statement 60. An embodiment of the present disclosure includes a method according to Statement 47, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion, the second content stream including the third content stream portion and a fourth content stream portion.
[0231] Statement 61. Embodiments of the present disclosure include a method according to Statement 60, wherein:
[0232] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0233] Filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion includes applying a filtering policy to the third content stream portion in the second buffer of the processing circuit of the device to produce the second filtered content stream portion.
[0234] Statement 62. Embodiments of the present disclosure include a method according to Statement 60, wherein:
[0235] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a first filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0236] Filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion includes applying a second filtering policy to the third content stream portion in the second buffer of the processing circuit of the device to produce the second filtered content stream portion.
[0237] Statement 63. An embodiment of the present disclosure comprises a method according to Statement 60, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0238] Statement 64. An embodiment of the present disclosure includes a method according to Statement 63, wherein sending said filtered content stream portion and said second filtered content stream portion using said network interface device comprises:
[0239] sending the filtered content stream portion to a first client using the network interface device; and
[0240] The second filtered content stream portion is sent to a second client using the network interface device.
[0241] Statement 65. Embodiments of the present disclosure include a method according to Statement 44, wherein:
[0242] The first content stream portion includes a content type; and
[0243] Filtering the content stream using processing circuitry of the device to produce a filtered content stream includes detecting a type of content to be filtered.
[0244] Statement 66. An embodiment of the present disclosure comprises a method according to Statement 65, wherein the first content stream portion further comprises a second content type.
[0245] Statement 67. An embodiment of the present disclosure includes a method according to Statement 65, wherein filtering the content stream using the processing circuitry of the device to produce the filtered content stream further comprises accessing the content type from a storage device of the device.
[0246] Statement 68. An embodiment of the present disclosure includes a method according to Statement 65, wherein filtering the content stream using the processing circuitry of the device to produce a filtered content stream further comprises detecting, using the processing circuitry of the device, a content type in the first content stream portion.
[0247] Statement 69. An embodiment of the present disclosure includes a method according to Statement 68, wherein detecting the content type in the first content stream portion using processing circuitry of the device comprises detecting the content type in the first content stream portion using content detection circuitry of the processing circuitry of the device.
[0248] Statement 70. An embodiment of the present disclosure includes a method according to Statement 69, wherein the content detection circuit comprises an FPGA, an ASIC, a SoC, a single core processor or a multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU.
[0249] Statement 71. An embodiment of the present disclosure includes a method according to Statement 69, wherein detecting the content type in the first content stream portion using content detection circuitry of the processing circuitry of the device includes detecting the second content type in the first content stream portion using content detection circuitry of the processing circuitry of the device.
[0250] Statement 72. An embodiment of the present disclosure includes a method according to Statement 69, further comprising detecting, using a second content detection circuit of a processing circuit of the device, a content type in the first content stream portion.
[0251] Statement 73. An embodiment of the present disclosure includes a method according to Statement 69, further comprising detecting, using second content detection circuitry of processing circuitry of the device, a second content type in the first content stream portion.
[0252] Statement 74. An embodiment of the present disclosure includes a method according to Statement 69, further comprising detecting, using second content detection circuitry of processing circuitry of the device, a content type in the third content stream portion, the second content stream including the third content stream portion and the fourth content stream portion.
[0253] Statement 75. An embodiment of the present disclosure includes a method according to Statement 69, further comprising detecting, using second content detection circuitry of processing circuitry of the device, a second content type in a third content stream portion, the second content stream including the third content stream portion and a fourth content stream portion.
[0254] Statement 76. An embodiment of the present disclosure includes a method according to Statement 68, wherein detecting the content type in the first content stream portion using processing circuitry of the device includes storing the content type in the first content stream portion associated with the first content stream portion in a storage device of the device.
[0255] Statement 77. An embodiment of the present disclosure includes a method according to Statement 38, wherein filtering the content stream using the processing circuit of the device to produce the filtered content stream includes applying a filtering policy to the content stream using the processing circuit of the device to produce the filtered content stream.
[0256] Statement 78. An embodiment of the present disclosure includes a method according to Statement 38, wherein filtering the content stream using processing circuitry of the device to produce a filtered content stream includes filtering the content stream using filtering circuitry in the processing circuitry of the device to produce the filtered content stream.
[0257] Statement 79. An embodiment of the present disclosure includes a method according to statement 78, wherein the filtering circuit includes a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SoC), a single core processor or a multi-core processor, a central processing unit (CPU), a graphics processing unit (GPU), a general purpose GPU (GPGPU), a tensor processing unit (TPU), or a neural processing unit (NPU).
[0258] Statement 80. Embodiments of the present disclosure include the method of Statement 38, wherein filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes delaying transmission of the content stream by the network interface device of the device by an interval.
[0259] Statement 81. An embodiment of the present disclosure includes a method according to Statement 80, wherein filtering the content stream using the processing circuit of the device to produce the filtered content stream further includes filtering the content stream using the processing circuit of the device during the interval to produce the filtered content stream.
[0260] Statement 82. Embodiments of the present disclosure include a method according to Statement 38, wherein:
[0261] The content stream comprises a content stream portion; and
[0262] Filtering the content stream using the processing circuitry of the apparatus to produce the filtered content stream includes replacing the content stream portion of the content stream with a replacement content stream portion.
[0263] Statement 83. Embodiments of the present disclosure include a method according to Statement 38, wherein:
[0264] The content stream comprises a content stream portion; and
[0265] Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes deleting the content stream portion from the content stream.
[0266] Statement 84. An embodiment of the present disclosure includes a method according to Statement 38, wherein sending the filtered content stream using the network interface device of the device includes sending the filtered content stream using a network interface card of the device.
[0267] Statement 85. Embodiments of the present disclosure include an article of manufacture comprising a non-transitory storage medium having stored thereon instructions that, when executed by a machine, result in:
[0268] Use the device to access content streams;
[0269] filtering the content stream using processing circuitry of the device to produce a filtered content stream; and
[0270] The filtered content stream is sent using a network interface device of the device.
[0271] Statement 86. Embodiments of the present disclosure include an article of manufacture according to Statement 85, wherein accessing the content stream using the device comprises accessing the content stream from a storage device of the device.
[0272] Statement 87. Embodiments of the present disclosure include an article of manufacture according to Statement 86, wherein accessing the content stream from the storage device of the device comprises accessing the content stream from a solid state drive (SSD) of the device.
[0273] Statement 88. Embodiments of the present disclosure include an article of manufacture according to Statement 85, wherein accessing the content stream using the device comprises receiving the content stream from a source.
[0274] Statement 89. Embodiments of the present disclosure include an article of manufacture according to Statement 88, wherein receiving the content stream from the source comprises storing the content stream in a storage device of the device.
[0275] Statement 90. Embodiments of the present disclosure include an article of manufacture according to Statement 89, wherein storing said content stream in said storage device of said device comprises storing said content stream in a solid state drive (SSD) of said device.
[0276] Statement 91. Embodiments of the present disclosure include the article of manufacture of Statement 85, wherein accessing the content stream using the device comprises storing the content stream in the processing circuitry of the device.
[0277] Statement 92. An embodiment of the invention includes an article according to Statement 91, wherein storing the content stream in the processing circuit of the device includes storing a first content stream portion in the processing circuit of the device, the content stream including the first content stream portion and a second content stream portion.
[0278] Statement 93. Embodiments of the present disclosure include the article of manufacture of Statement 92, wherein storing the first content stream portion in the processing circuitry of the device comprises storing the first content stream portion in a buffer of the processing circuitry of the device.
[0279] Statement 94. An embodiment of the present disclosure includes an article according to Statement 93, wherein filtering the content stream using the processing circuit of the device to produce the filtered content stream includes: filtering the first content stream portion in the buffer of the processing circuit of the device to produce a filtered content stream portion.
[0280] Statement 95. An embodiment of the present disclosure includes an article of manufacture according to Statement 94, wherein sending the filtered content stream using the network interface device of the device includes sending the filtered content stream portion using the network interface device.
[0281] Statement 96. Embodiments of the present disclosure include an article of manufacture according to Statement 95, wherein sending the filtered content stream portion using the network interface device comprises sending the filtered content stream portion to a client using the network interface device.
[0282] Statement 97. An embodiment of the present disclosure includes an article according to Statement 94, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the second content stream portion in the buffer of the processing circuit of the device to produce a second filtered content stream portion.
[0283] Statement 98. Embodiments of the present disclosure include an article according to Statement 97, wherein:
[0284] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0285] Filtering the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion includes applying the filtering policy to the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion.
[0286] Statement 99. An embodiment of the present disclosure includes an article according to Statement 97, wherein filtering the second content flow portion in the buffer of the processing circuit of the device to produce the second filtered content flow portion includes: filtering the second content flow portion in the buffer of the processing circuit of the device to produce the second filtered content flow portion based at least in part on the transmission of the filtered content flow portion.
[0287] Statement 100. An embodiment of the present disclosure includes an article of manufacture according to statement 99, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0288] Statement 101. An embodiment of the present disclosure includes an article according to statement 100, wherein sending the filtered content stream portion and the second filtered content stream portion using the network interface device includes sending the filtered content stream portion and the second filtered content stream portion to a client using the network interface device.
[0289] Statement 102. An embodiment of the present disclosure includes an article according to Statement 94, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the second content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion.
[0290] Statement 103. Embodiments of the present disclosure include an article according to statement 102, wherein:
[0291] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0292] Filtering the second content flow portion in the second buffer of the processing circuit of the device to produce the second filtered content flow portion includes: applying the filtering policy to the second content flow portion in the second buffer of the processing circuit of the device to produce the second filtered content flow portion.
[0293] Statement 104. Embodiments of the present disclosure include an article according to statement 102, wherein:
[0294] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a first filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0295] Filtering the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion includes applying a second filtering policy to the second content flow portion in the buffer of the processing circuitry of the device to produce the second filtered content flow portion.
[0296] Statement 105. An embodiment of the present disclosure comprises an article of manufacture according to statement 102, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0297] Statement 106. An embodiment of the present disclosure includes the article of manufacture of statement 105, wherein sending the filtered content stream portion and the second filtered content stream portion using the network interface device comprises:
[0298] sending the filtered content stream portion to a first client using the network interface device; and
[0299] The second filtered content stream portion is sent to a second client using the network interface device.
[0300] Statement 107. An embodiment of the present disclosure includes an article according to Statement 94, wherein filtering the first content stream portion in the buffer of the processing circuit of the device to produce the filtered content stream portion includes: filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion, the second content stream including the third content stream portion and a fourth content stream portion.
[0301] Statement 108. Embodiments of the present disclosure include an article according to Statement 107, wherein:
[0302] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0303] Filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion includes applying a filtering policy to the third content stream portion in the second buffer of the processing circuit of the device to produce the second filtered content stream portion.
[0304] Statement 109. Embodiments of the present disclosure include an article according to Statement 107, wherein:
[0305] Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a first filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion;
[0306] Filtering the third content stream portion in the second buffer of the processing circuit of the device to produce a second filtered content stream portion includes applying a second filtering policy to the third content stream portion in the second buffer of the processing circuit of the device to produce the second filtered content stream portion.
[0307] Statement 110. An embodiment of the present disclosure includes an article of manufacture according to statement 107, wherein sending the filtered content stream using a network interface device of the device comprises sending the filtered content stream portion and the second filtered content stream portion using the network interface device.
[0308] Statement 111. An embodiment of the present disclosure includes an article of manufacture according to statement 110, wherein sending said filtered content stream portion and said second filtered content stream portion using said network interface device comprises:
[0309] sending the filtered content stream portion to a first client using the network interface device; and
[0310] The second filtered content stream portion is sent to a second client using the network interface device.
[0311] Statement 112. Embodiments of the present disclosure include an article according to Statement 91, wherein:
[0312] The first content stream portion includes a content type; and
[0313] Filtering the content stream using processing circuitry of the device to produce a filtered content stream includes detecting a type of content to be filtered.
[0314] Statement 113. An embodiment of the present disclosure comprises an article of manufacture according to Statement 112, wherein the first content stream portion further comprises a second content type.
[0315] Statement 114. An embodiment of the present disclosure includes an article of manufacture according to statement 112, wherein filtering the content stream using the processing circuitry of the device to produce a filtered content stream further comprises accessing the content type from a storage device of the device.
[0316] Statement 115. An embodiment of the present disclosure includes an article of manufacture according to Statement 112, wherein filtering the content stream using the processing circuitry of the device to produce a filtered content stream further comprises detecting, using the processing circuitry of the device, a content type in the first content stream portion.
[0317] Statement 116. An embodiment of the present disclosure includes an article of manufacture according to Statement 115, wherein detecting, using processing circuitry of the device, a type of content in the first content stream portion comprises detecting, using content detection circuitry of processing circuitry of the device, a type of content in the first content stream portion.
[0318] Statement 117. Embodiments of the present disclosure include an article of manufacture according to statement 116, wherein the content detection circuit comprises an FPGA, an ASIC, a SoC, a single core processor or a multi-core processor, a CPU, a GPU, a GPGPU, a TPU, or a NPU.
[0319] Statement 118. An embodiment of the present disclosure includes an article according to Statement 116, wherein detecting the content type in the first content stream portion using the content detection circuitry of the processing circuitry of the device includes detecting a second content type in the first content stream portion using the content detection circuitry of the processing circuitry of the device.
[0320] Statement 119. An embodiment of the present disclosure includes an article according to Statement 116, wherein the non-transitory storage medium has additional instructions stored thereon, which when executed by the machine, cause the use of a second content detection circuit of the processing circuit of the device to detect the content type in the first content stream portion.
[0321] Statement 120. An embodiment of the present disclosure includes an article according to Statement 116, wherein the non-transitory storage medium has additional instructions stored thereon, and the additional instructions, when executed by the machine, cause the detection of a second content type in the first content stream portion using a second content detection circuit of the processing circuit of the device.
[0322] Statement 121. An embodiment of the present disclosure includes an article according to Statement 116, wherein the non-transitory storage medium has additional instructions stored thereon, and when the additional instructions are executed by the machine, a second content detection circuit of the processing circuit of the device is used to detect the content type in a third content stream portion, and the second content stream includes the third content stream portion and a fourth content stream portion.
[0323] Statement 122. An embodiment of the present disclosure includes an article according to Statement 116, wherein the non-transitory storage medium has additional instructions stored thereon, and the additional instructions, when executed by the machine, cause a second content detection circuit of the processing circuit of the device to detect a second content type in a third content stream portion, the second content stream including the third content stream portion and a fourth content stream portion.
[0324] Statement 123. An embodiment of the present disclosure includes an article of manufacture according to Statement 115, wherein detecting, using processing circuitry of the device, the content type in the first content stream portion comprises storing the content type in the first content stream portion associated with the first content stream portion in a storage device of the device.
[0325] Statement 124. An embodiment of the present disclosure includes an article according to Statement 85, wherein filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes applying a filtering policy to the content stream using the processing circuitry of the device to produce the filtered content stream.
[0326] Statement 125. An embodiment of the present disclosure includes an article according to Statement 85, wherein filtering the content stream using the processing circuit of the device to produce the filtered content stream includes filtering the content stream using filtering circuitry in the processing circuit of the device to produce the filtered content stream.
[0327] Statement 126. Embodiments of the present disclosure include an article according to statement 125, wherein the filtering circuit comprises a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SoC), a single core processor or a multi-core processor, a central processing unit (CPU), a graphics processing unit (GPU), a general purpose GPU (GPGPU), a tensor processing unit (TPU), or a neural processing unit (NPU).
[0328] Statement 127. Embodiments of the present disclosure include an article of manufacture according to Statement 85, wherein filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes delaying transmission of the content stream by the network interface device of the device by an interval.
[0329] Statement 128. An embodiment of the present disclosure includes an article according to Statement 127, wherein filtering the content stream using the processing circuit of the device to produce the filtered content stream further includes filtering the content stream using the processing circuit of the device during the interval to produce the filtered content stream.
[0330] Statement 129. Embodiments of the present disclosure include an article according to Statement 85, wherein:
[0331] The content stream comprises a content stream portion; and
[0332] Filtering the content stream using the processing circuitry of the apparatus to produce the filtered content stream includes replacing the content stream portion of the content stream with a replacement content stream portion.
[0333] Statement 130. Embodiments of the present disclosure include an article according to Statement 85, wherein:
[0334] The content stream comprises a content stream portion; and
[0335] Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes deleting the content stream portion from the content stream.
[0336] Statement 131. An embodiment of the present disclosure includes an article of manufacture according to Statement 85, wherein sending the filtered content stream using the network interface device of the device includes sending the filtered content stream using a network interface card of the device.
[0337] Therefore, in view of the various changes in the embodiments described herein, this detailed description and the accompanying materials are intended to be illustrative only and should not be taken as limiting the scope of the disclosure. Therefore, the disclosure claims all such modifications that may fall within the scope and spirit of the appended claims and their equivalents.
Claims
1. A device, include: a storage device for storing content streams; A network interface device for sending the filtered content stream; as well as a processing circuit connected to the storage device and the network interface device, The processing circuit is configured to apply a filtering policy to the content flow to generate the filtered content flow.
2. The device according to claim 1, in: The processing circuit comprises: a buffer for storing a first content stream portion, the content stream comprising the first content stream portion and a second content stream portion; and filtering circuitry configured to apply the filtering policy to the first content stream portion to produce a filtered content stream portion, and The network interface device is configured to transmit the filtered content stream portion.
3. The device according to claim 2, in: The processing circuit further comprises: a second buffer, the second buffer storing a third content stream portion, the second content stream comprising the third content stream portion and a fourth content stream portion; The processing circuit further includes a second filtering circuit configured to apply a second filtering policy to the third content stream portion to generate a second filtered content stream portion, the second filtered content stream including the second filtered content stream portion, and The network interface device is configured to transmit a second filtered content stream portion.
4. The device according to claim 3, in, The network interface device is configured to send the filtered content stream portion to a first client and to send the second filtered content stream portion to a second client.
5. The device according to claim 2, in: The first content stream portion includes a content type; and A filtering policy identifies the type of content to filter.
6. The device according to claim 1, in, The processing circuitry includes content detection circuitry for identifying a type of content in a first content stream portion, the first content stream including the first content stream portion and a second content stream portion.
7. The device according to claim 6, in: The processing circuit further includes: a buffer storing the first content stream portion; and The content detection circuit is configured to identify a content type in the first content stream portion based at least in part on the first content stream portion in the buffer.
8. The device according to claim 6, wherein the processing circuit further include: a second buffer storing a third content stream portion; as well as Second content detection circuitry is configured to identify a second content type in the third content stream portion based at least in part on the third content stream portion in the second buffer.
9. The device according to claim 1, in, The processing circuitry includes a delay circuit for delaying the network interface device for an interval before sending the filtered content stream.
10. The device according to claim 9, in, The processing circuit is configured to apply the filtering policy during the interval.
11. The device according to claim 1, in: The content stream includes a content stream portion; as well as The filtering policy specifies that a content flow portion is deleted from the content flow or that a content flow portion in the content flow is replaced with a replacement content flow portion in the content flow.
12. A method, include: Use the device to access content streams; filtering the content stream using processing circuitry of the device to produce a filtered content stream; as well as The filtered content stream is sent using a network interface device of the device.
13. The method according to claim 12, in, Accessing the content stream using the device includes: receiving the content stream from a source; and The content stream is stored in a storage device of the device.
14. The method according to claim 12, in: accessing the content stream using the device comprises storing a first content stream portion in a buffer of the processing circuitry of the device, the content stream comprising the first content stream portion and a second content stream portion; as well as Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes filtering the first content stream portion in the buffer of the processing circuitry of the device to produce a filtered content stream portion.
15. The method according to claim 14, in: Filtering the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion includes: applying a filtering policy to the first content stream portion in the buffer of the processing circuitry of the device to produce the filtered content stream portion; The method also includes applying a second filtering policy to the second content stream portion in the buffer of the processing circuitry of the device to produce a second filtered content stream portion.
16. The method according to claim 15, in, Sending the filtered content stream using a network interface device of the device comprises: sending the filtered content stream portion to a first client using the network interface device; and The second filtered content stream portion is sent to a second client using the network interface device.
17. The method according to claim 12, in, Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes detecting, using the processing circuitry of the device, a content type in the first content stream portion.
18. The method according to claim 12, in, Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes delaying transmission of the content stream by the network interface device of the device for an interval.
19. The method according to claim 18, in, Filtering the content stream using the processing circuitry of the device to produce the filtered content stream further includes filtering the content stream using the processing circuitry of the device during the interval to produce the filtered content stream.
20. The method according to claim 12, in: The content stream includes a content stream portion; as well as Filtering the content stream using the processing circuitry of the device to produce the filtered content stream includes replacing the content stream portion of the content stream with a replacement content stream portion.
