Chiplet Hub Private Memory Architecture for Scalable Interconnects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Chiplet-based systems are limited to a few large manufacturers due to proprietary interconnections, preventing small to medium entities from realizing the performance and cost advantages of chiplet technology, and existing SoCs face yield and optimization issues with complex designs.
Innovation Solution
A chiplet hub architecture that integrates multiple specialized chiplets with a central fabric, utilizing a hub manager and HDMA controller to facilitate interconnectivity and memory management, allowing for a modular and scalable system design.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If proprietary chiplet interconnections are used, then manufacturing control and performance are improved, but device complexity and development cost increase, limiting access to large manufacturers only
Solution Approach 1:
The patent applies universality by creating a standardized chiplet interconnection platform that serves multiple functions: it enables different chiplet types (accelerators, memory, I/O) to interconnect through common protocols, allows various manufacturers to participate using the same interface standards, and provides a unified memory management architecture that works across diverse chiplet configurations. This universal platform resolves the contradiction by maintaining high performance through standardized protocols while reducing complexity compared to proprietary solutions.
2Stability of the object's composition
If monolithic SoC design is used, then integration is achieved, but yield decreases and production cost increases due to large die size
Solution Approach 1:
The patent applies segmentation by dividing the monolithic SoC into multiple independent chiplets that can be manufactured separately on smaller dies, thereby improving yield. Each chiplet contains specific functionality (accelerators, memory controllers, I/O interfaces) and is interconnected through standardized interfaces to form a complete system. This segmentation maintains system integration while enabling parallel manufacturing of smaller, higher-yield components.
3Stability of the object's composition
If monolithic SoC design is used, then all functions are integrated, but portions not optimized for specific functions reduce performance
Solution Approach 1:
The patent applies local quality by allowing each chiplet to be manufactured using semiconductor processes specifically optimized for its function. For example, accelerators can use processes optimized for high-speed computation, memory chiplets for high-density storage, and I/O chiplets for high-bandwidth communication. Each chiplet maintains its function-specific optimization while being integrated into a unified system through standardized interconnections, resolving the contradiction between integration and function-specific performance.
Data Source
AI summary
A chiplet hub for interconnecting a series of connected chiplets and internal resources. An HBM is mounted on top of the chiplet hub to provide multiple party access to the HBM and to save System in Package (SIP) area. The chiplet hub can form system instances to combine connected chiplets and internal resources, with the system instances being isolated. One type of system instance is a private memory system instance with private memory gathered from multiple different memory devices. The chiplet hubs can be interconnected to form a clustered chiplet hub to provide for a larger number of chiplet connections and more complex system. A DMA controller can receive DMA service requests from devices other than a system hosted, including in cases where the chiplet hub is non-hosted.


