Infrastructure Processing Unit for Microservice Coordination and Security
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data center architectures face challenges in managing the complexity and overhead associated with microservices, requiring high-bandwidth, low-latency connectivity, virtualization, and zero-trust security for efficiently processing and moving data across distributed resources.
Innovation Solution
The implementation of Infrastructure Processing Units (IPUs) integrated with smart NICs and storage or memory, which are used to manage and coordinate microservices, providing centralized management and security across distributed resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional data center architectures are used to manage microservices, then basic data processing can be performed, but system complexity and overhead increase significantly
Solution Approach 1:
The patent introduces an Infrastructure Processing Unit (IPU) as an intermediary component between the CPU and distributed data center resources. The IPU acts as a specialized mediator that handles infrastructure-specific tasks such as network communication, storage management, and device coordination, thereby reducing the complexity burden on the main CPU while improving overall data processing efficiency through dedicated hardware acceleration
2Speed
If high-bandwidth connectivity is implemented across distributed resources, then data communication speed improves, but infrastructure costs and complexity increase
Solution Approach 1:
The patent merges multiple connectivity and communication functions into the IPU, which integrates network interface capabilities, storage interface capabilities, and coordination logic into a single unified component. This consolidation achieves high-bandwidth data communication across distributed resources while reducing infrastructure complexity by eliminating the need for separate dedicated hardware for each communication function
3Adaptability or versatility
If virtualization is implemented across distributed resources, then resource utilization improves, but security requirements and management overhead increase
Solution Approach 1:
The IPU serves as a trusted intermediary that manages virtualization operations across distributed resources. It handles resource allocation, isolation, and access control for virtualized environments, thereby improving resource utilization while maintaining security through dedicated hardware-based virtualization support and reduced management overhead compared to software-only approaches
Data Source
AI summary
Examples described herein relate to an Infrastructure Processing Unit (IPU) that comprises: interface circuitry to provide a communicative coupling with a platform; network interface circuitry to provide a communicative coupling with a network medium; and circuitry to expose infrastructure services to be accessed by microservices for function composition and to selectively provide a barrier to halt operation of at least one microservice based on event data from a composite node that performs the at least one microservice.