NPU Resource Allocation via Dynamic Grouping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mobile networks with dynamic contexts and high session rates, the traditional NPU programming paradigm becomes impractical due to the need for continuous CPU involvement in resource management, especially when handling multiple hardware resources and high traffic rates.

Innovation Solution

Implementing a network functional element that dynamically allocates NPU resources in the data plane without host CPU involvement, using a determination module to assess provisioning information and an assignment module to allocate data plane resources based on subscriber information, allowing for fast and efficient resource management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If CPU is involved in programming NPU resources using control channel, then resource management can be performed, but network operation speed slows down due to CPU bottleneck at high traffic rates

Engineering Contradiction:
Improvenetwork operation speedVSAvoidcontrol plane involvement
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments resource management functions by creating separate resource management circuits within the NPU that operate independently from the CPU. This allows the NPU to manage its own resources (forwarding entries, policers, counters) without requiring continuous CPU intervention through control channels, thereby resolving the bottleneck while maintaining resource management capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The NPU is designed with self-service capabilities through integrated resource management circuits that automatically allocate and manage data plane resources. The NPU can autonomously program its own resource allocation based on flow information, eliminating the need for CPU-mediated resource management and enabling high-speed operation without control plane involvement.

Inventive Principle:
Principle #25Self-service

2Productivity

If static resource allocation is used in NPU, then resource management is simplified, but resource utilization efficiency decreases in dynamic mobile networks

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoiddynamic context handling
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic resource allocation within the NPU by creating resource management circuits that can adaptively allocate resources based on real-time flow information and network conditions. The system dynamically creates, modifies, and deallocates forwarding entries, policers, and counters as flows are established and terminated, enabling efficient resource utilization in mobile networks with dynamic contexts.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If CPU programs NPU resources for each subscriber service, then resource allocation is precise, but processing time increases due to high session rates

Engineering Contradiction:
Improveresource allocation precisionVSAvoidresource allocation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The NPU performs self-service resource allocation by automatically allocating resources when flow information is received. The resource management circuits within the NPU handle resource allocation, modification, and deallocation autonomously based on subscriber service requirements, eliminating the time-consuming CPU intervention while maintaining precise resource allocation for each flow.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary resource allocation actions by pre-configuring resource management circuits and allocation logic within the NPU. When flow information arrives, the NPU can immediately allocate resources using pre-established rules and circuits, avoiding the time delay of CPU processing while ensuring precise resource allocation for subscriber services.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9385970B2Method and apparatus for assigning resources in a network node
Publication Date: 2016.07.05 WICHORUS LLC
  • US9385970B2 patent drawing
  • US9385970B2 patent drawing
  • US9385970B2 patent drawing

AI summary

Achieving resource management within a network processing unit (NPU) can be challenging due to the NPU's fixed and limited instruction set. In the case of large mobile networks, contexts are dynamic, and each subscriber in the network consumes multiple hardware resources, where a central processing unit (CPU) is typically employed to program individual resources even though generally impractical in high-session rates. To avoid programming individual resources, an example embodiment of the present invention creates a group of resources depending on a category, the group being shared dynamically among subscribers when a subscriber is active in the network. The example embodiment may include a network service processor (NSP) located in a forwarding path, such that the NPU may operate in connection with the NSP to allocate NPU resources using a packetized interface. The example embodiment achieves resource management within the NPU without a host CPU's involvement and without statically delaying resources.