System and method for semiconductor device with extended high band memory (HBM) offset
By providing multiple connectors on HBM and intelligently selecting connectors, the HBM offset problem caused by IC size differences is solved, signal transmission efficiency and component connectivity is improved, and a smaller ASIC design and reduced power consumption is achieved.
Patent Information
- Application Number
- CN202410553302.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-09-26
- Filing Date
- 2024-05-07
- Publication Date
- 2024-12-03
AI Technical Summary
The prior art is difficult to effectively adapt to high bandwidth memory (HBM) offset caused by IC size differences, resulting in limited signal transmission efficiency and signal integrity.
By providing multiple connectors covering extended distances on the HBM, intelligent selection of HBM connectors is leveraged to achieve enhanced offset adaptability, ensuring minimized routing length and signal integrity, thereby improving operational speed and thermal efficiency of interfaces and IC components .
Without increasing the IC size, the expansion of HBM offset is achieved, improving signal transmission efficiency and connectivity between components, reducing power consumption, and allowing smaller ASICs to be designed to accommodate different IC sizes.
Smart Images

Figure CN119070068A_ABST
Abstract
Description
[0001] CROSS REFERENCE TO RELATED APPLICATIONS
[0002] This application is a non-provisional application of U.S. patent application No. 63 / 505,934, filed by Ali et al. on June 2, 2023 and entitled “Extended HBM Offsets Using Wide Interfaces,” and all of the teachings of the application are incorporated herein by reference for all purposes. Technical Field
[0003] The present technology relates to systems and methods for semiconductor devices with extended high bandwidth memory (HBM) offset. Background Art
[0004] In the past few decades, great progress has been made in the field of semiconductor integration, especially in the strategic positioning and interconnection of integrated circuit (IC) devices. Various methods involve placing IC devices side by side on an interposer, which promotes high-density connections between IC components, allowing efficient and compact designs. For example, in a 2.5D interposer configuration, one or more high-bandwidth memories (HBMs) can be connected to an application-specific IC (ASIC) according to a set of predetermined routing rules. For example, HBM refers to a memory that provides a high-speed computer memory interface for 3D stacked synchronous dynamic random access memory (SDRAM), and it is a standardized stacked memory technology that provides very wide channels for data within the stack and between memory and logic. Due to differences in IC size, one or more HBMs may not be aligned with the ASIC and need to be offset from their designated pins on the ASIC. However, it remains challenging to extend these offsets to accommodate various IC size variations and ensure efficient signal transmission.
[0005] Various approaches for increasing HBM offset have been explored, but have proven to be inadequate.It is important to recognize the need for new and improved semiconductor devices with extended HBM offset. Summary of the invention
[0006] On the one hand, the present disclosure relates to an apparatus comprising: a circuit comprising a first connector and a second connector, the circuit being configured to send a first signal using the first connector to indicate a first selection, the second connector being positioned at a first position; an interposer comprising a first interconnect and a second interconnect; and a first memory device comprising a first selector and a third connector and a fourth connector, the first selector being coupled to the first connector via the first interconnect, the first selector being configured to couple the third connector to the second connector via the second interconnect based on the first signal, the third connector being positioned closer to the first position than the fourth connector.
[0007] On the other hand, the present disclosure relates to a device, comprising: a circuit, comprising a first connector and a second connector, the circuit being configured to send a first signal using the first connector to indicate a first selection, the second connector being positioned at a first position; an interposer, comprising a first interconnect and a second interconnect; and a first buffer die, comprising a first selector and a third connector and a fourth connector, the first selector being coupled to the first connector via the first interconnect, the first selector being configured to couple the third connector to the second connector via the second interconnect based on the first signal, the third connector being positioned closer to the first position than the fourth connector.
[0008] On the other hand, the present disclosure relates to an apparatus comprising: a circuit comprising a first connector and a second connector, the circuit being configured to send a first signal using the first connector to indicate a first selection, the second connector being positioned at a first position; an interposer coupled to the circuit, the interposer comprising a first interconnect; and a first memory device comprising a first selector and a third connector and a fourth connector, the first selector being coupled to the first connector via the first interconnect, the first selector being configured to couple the third connector to the second connector based on the first signal, the third connector being positioned closer to the first position than the fourth connector. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] A further understanding of the nature and advantages of particular embodiments may be achieved by reference to the remainder of the specification and drawings, wherein like reference numerals are used to refer to like components. In some instances, a sub-label is associated with a reference numeral to indicate one of multiple similar components. When a reference is made to a reference numeral without specifying an existing sub-label, it is intended to refer to all such multiple similar components.
[0010] Figure 1 is a simplified diagram illustrating a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0011] Figure 2 is a simplified diagram illustrating a cross-sectional view of a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0012] Figure 3 is a simplified diagram illustrating a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0013] Figure 4 is a simplified diagram illustrating a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0014] Figure 5 is a simplified diagram illustrating a cross-sectional view of a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0015] Figure 6 is a simplified diagram illustrating a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology.
[0016] Figure 7 is a simplified diagram illustrating a cross-sectional view of a semiconductor device characterized by an integration scheme in accordance with an embodiment of the present technology. DETAILED DESCRIPTION
[0017] The present technology relates to systems and methods for semiconductor devices with extended high bandwidth memory (HBM) offset. In an embodiment, the present technology provides an apparatus comprising a circuit including a first connector and a second connector. The circuit is configured to send a first signal using the first connector to indicate a first selection. The apparatus further comprises a first memory device including a first selector and a third connector and a fourth connector. The first selector is configured to couple the third connector to the second connector based on the first signal. One or more connectors of the first memory device cover a wide distance to ensure robust connectivity between the circuit and the first memory device. Other embodiments exist.
[0018] Some methods of implementing semiconductor integration involve connecting one or more HBMs to an ASIC via interconnects in an interposer. For example, the HBM may be centered on its associated physical layer (PHY) circuit (e.g., transceiver) within the ASIC to ensure minimum routing distance and optimal signal transmission. However, this is not always possible due to IC size mismatch. Therefore, the HBM may be offset from its corresponding PHY circuit on the ASIC. Due to the dense nature of the interconnects—for example, there may be thousands of wires across a limited width on a limited layer—geometric boundaries constitute a significant constraint in such integration schemes. These geometric and spatial restrictions dictate the allowed distance that the HBM can be offset relative to its corresponding PHY circuit within the ASIC. In addition, when considering vertical dimension differences, the complexity is further increased. For example, one or more HBMs may be stacked vertically together and connected to the ASIC. The potential height difference between the stacked HBM and the ASIC may cause an offset between the HBM and the ASIC that is too challenging to route effectively.
[0019] In various embodiments, the present technology provides a semiconductor device that accommodates extended HBM offset without including routing efficiency or signal integrity. By providing several connectors (e.g., IO pins) covering the extended distance on the HBM for establishing a connection with the ASIC, an increased HBM offset can be achieved without increasing the size of the IC. With the capacity for extending the HBM offset, the ASIC can potentially be designed to be smaller because it no longer necessarily matches the size of the HBM. In addition, enhanced product performance can be achieved by intelligently selecting HBM connectors, which ensures that the routing length is minimized, thereby improving the signal integrity and operating speed of both the interface and the IC components. The culmination of these features leads to improved thermal efficiency, thanks to minimized wire length and reduced power consumption. It should be understood that the present technology is applicable to any semiconductor integration scheme and is not limited to HBM and ASIC connections.
[0020] The following description is presented to enable one of ordinary skill in the art to make and use the invention and to incorporate it into the context of a particular application. Various modifications and various uses in different applications will be apparent to those skilled in the art, and the general principles defined herein may be applied to a wide range of embodiments. Therefore, the present technology is not intended to be limited to the embodiments presented, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.
[0021] In the detailed description below, numerous specific details are set forth in order to provide a more thorough understanding of the present technology. However, it will be apparent to those skilled in the art that the present technology may be practiced without being limited to these specific details. In other cases, well-known structures and devices are shown in block diagram form rather than in detail in order to avoid obscuring the present technology.
[0022] The reader is advised to pay attention to all papers and documents filed concurrently with this specification and disclosed for public inspection with this specification, and the contents of all such papers and documents are incorporated herein by reference. Unless otherwise expressly stated, all features disclosed in this specification (including any accompanying claims, abstracts and drawings) may be replaced by alternative features serving the same, equivalent or similar purposes. Therefore, unless otherwise expressly stated, each feature disclosed is only an example of a general series of equivalent or similar features.
[0023] Furthermore, any element in the claims that does not explicitly state a "means" for performing a specified function or a "step" for performing a specified function should not be construed as a "means" or "step" clause as referred to in 35 U.S.C. § 112, paragraph 6. Specifically, the use of "step" or "action" in the claims herein is not intended to invoke the provisions of 35 U.S.C. § 112, paragraph 6.
[0024] When an element is referred to herein as being "connected" or "coupled" to another element, it is understood that the element may be directly connected to the other element, or that there may be intervening elements between the elements. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, it is understood that there are no intervening elements in the "direct" connection between the elements. However, the presence of a direct connection does not exclude other connections in which there may be intervening elements.
[0025] When an element is referred to herein as being "disposed" in some manner relative to another element (e.g., disposed on, disposed between, disposed below, disposed adjacent to, or disposed in some other relative manner), it is understood that the element may be disposed directly relative to the other element (e.g., disposed directly on the other element) or that there may be intervening elements between the elements. In contrast, when an element is referred to as being "directly disposed" relative to another element, it is understood that there are no intervening elements in the "direct" instance. However, the presence of a direct placement does not exclude other instances in which there may be intervening elements.
[0026] Similarly, when an element is referred to herein as being "joined" to another element, it is understood that the element may be joined directly to the other element (without any intervening elements), or that there may be intervening elements between the joined elements. In contrast, when an element is referred to as being "directly joined" to another element, it is understood that there are no intervening elements in the "direct" joining between the elements. However, the presence of direct joining does not exclude other forms of joining in which there may be intervening elements.
[0027] Similarly, when an element is referred to herein as a "layer," it is understood that the layer may be a single layer or may include multiple layers. For example, a conductive layer may include multiple different conductive materials or multiple layers of different conductive materials, and a dielectric layer may include multiple dielectric materials or multiple layers of dielectric materials. When a layer is described as being coupled or connected to another layer, it is understood that the coupled or connected layer may include intervening elements present between the coupled or connected layers. In contrast, when a layer is referred to as being "directly" connected or coupled to another layer, it is understood that there are no intervening elements between the layers. However, the presence of a directly coupled or connected layer does not exclude other connections in which intervening elements may be present.
[0028] In addition, the terms left, right, front, back, top, bottom, forward, reverse, clockwise, and counterclockwise are used for explanation purposes only and are not limited to any fixed direction or orientation. Instead, they are only used to indicate the relative position and / or direction between the various parts of an object and / or component.
[0029] In addition, for ease of description, the methods and processes described herein may be described in a particular order. However, it should be understood that unless the context indicates otherwise, intervening processes may occur before and / or after any portion of the described process, and various other procedures may be reordered, added, and / or omitted according to various embodiments.
[0030] Unless otherwise indicated, all numbers used herein to express quantities, dimensions, and the like are to be understood as being modified in all instances by the term "about". In this application, the use of the singular includes the plural unless otherwise specifically indicated, and the use of the terms "and" and "or" means "and / or" unless otherwise indicated. In addition, the use of the terms "including" and "having" and other forms such as "includes", "included", "has", "have" and "had" should be considered non-exclusive. In addition, terms such as "element" or "component" encompass elements and components comprising one unit and elements and components comprising more than one unit, unless otherwise specifically indicated.
[0031] As used herein, the phrase "at least one of..." preceding a series of items using the terms "and" or "or" to separate any of the items modifies the list as a whole, rather than each member of the list (i.e., each item). The phrase "at least one of..." does not require selection of at least one of each item listed; in contrast, the phrase allows for a meaning that includes at least one of any of the items and / or at least one of any combination of items. By way of example, the phrase "at least one of A, B, and C" or "at least one of A, B, or C" each refers to only A, only B, or only C; and / or any combination of A, B, and C. Where selection of "at least one of each of A, B, C" or alternatively "at least one of A, at least one of B, and at least one of C" is desired, it is so explicitly described.
[0032] A general aspect includes an apparatus including a circuit. The circuit includes a first connector and a second connector. The circuit is configured to send a first signal using the first connector to indicate a first selection. The second connector is positioned at a first location. The apparatus also includes an interposer having a first interconnect and a second interconnect. In some embodiments, a first memory device includes a first selector, a third connector, and a fourth connector. The first selector is coupled to the first connector through the first interconnect. The first selector is configured to couple the third connector to the second connector through the second interconnect based on the first signal. The third connector is positioned closer to the first location than the fourth connector.
[0033] The embodiment may include one or more of the following features. The circuit may further include a second memory device. The circuit may further include a fifth connector and a sixth connector. The circuit is configured to send a second signal using the fifth connector to indicate a second selection. The sixth connector is positioned at a second position. The interposer may further include a third interconnect and a fourth interconnect. The second memory device may include a second selector and a seventh connector and an eighth connector, the second selector being coupled to the fifth connector via a third interconnect, the second selector being configured to couple the sixth connector to the seventh connector based on the second signal. The seventh connector may be closer to the second position than the eighth connector. The circuit may include an application specific integrated circuit. The first memory device may include a high bandwidth memory. The first connector may include a physical layer circuit. The third connector may be coupled to the second connector according to a predetermined routing rule.
[0034] According to another embodiment, the present technology provides an apparatus comprising a circuit including a first connector and a second connector. The circuit may be configured to send a first signal using the first connector to indicate a first selection. The second connector may be positioned at a first position. The apparatus may further include an interposer including a first interconnect and a second interconnect. The apparatus may further include a first buffer die including a first selector and a third connector and a fourth connector. The first selector may be coupled to the first connector through the first interconnect. The first selector may be configured to couple the third connector to the second connector through the second interconnect based on the first signal. The third connector may be positioned closer to the first position than the fourth connector.
[0035] Embodiments may include one or more of the following features. The apparatus may further include a first memory device coupled to the first buffer die. The apparatus may further include a first memory device coupled to the interposer. The first memory device may include a high bandwidth memory. The circuit may include an application specific integrated circuit. The first buffer die may be coupled to the interposer. The third connector may be coupled to the second connector according to a predetermined routing rule characterized by the first routing angle.
[0036] The first routing angle may be less than or equal to 45 degrees.The third connector may be coupled to the second connector via a second interconnect.
[0037] The first selector may include a multiplexer.The first connector may include a physical layer circuit.
[0038] According to yet another embodiment, the present technology provides an apparatus comprising a circuit including a first connector and a second connector. The circuit may be configured to send a first signal using the first connector to indicate a first selection. The second connector may be positioned at a first position. The apparatus may further include an interposer coupled to the circuit, the interposer including a first interconnect. The apparatus may further include a first memory device. The first memory device may include a first selector and a third connector and a fourth connector. The first selector may be coupled to the first connector via a first interconnect. The first selector may be configured to couple the third connector to the second connector based on the first signal. The third connector may be positioned closer to the first position than the fourth connector. In some embodiments, the circuit may include an application specific integrated circuit. The first memory device may include a high bandwidth memory. The first selector may include a multiplexer.
[0039] Figure 11 is a simplified diagram illustrating a semiconductor device 100 characterized by an integration scheme according to an embodiment of the present technology. This figure provides an example only, which should not unduly limit the scope of the claims. As shown, the semiconductor device 100 includes a circuit 104. For example, the circuit 104 may include an application specific integrated circuit (ASIC). The term "application specific integrated circuit" may refer to an integrated circuit (IC) chip customized for a specific purpose, including (but not limited to) digital signal processing, image processing, network data routing, machine learning, and / or any application requiring specific computing requirements. In some embodiments, the circuit 104 includes a first connector 106a and a second connector 106b. The second connector 106b may be positioned at a first position. As an example, the first connector 106a and the second connector 106b may include a physical layer (PHY) circuit. The term "PHY circuit" or "PHY circuit pin" may refer to a section of a semiconductor chip that handles physical and data link layer connectivity and can be used in a network interface or a communication transceiver.
[0040] The semiconductor device 100 may further include an interposer 102. The term "interposer" may refer to an electrical interface that redirects electrical connections between electrical components, which may spread the connections to a wider pitch, or reroute the connections to different connections. For example, the interposer 102 may include a substrate that facilitates electrical connections between an ASIC (e.g., the first circuit 104) and other components (e.g., a memory device) using one or more interconnects, thereby allowing high-speed data transfer and compact semiconductor integration. In various implementations, the semiconductor device 100 further includes a first memory device 108. For example, the first memory device 108 may include a high bandwidth memory (HBM). The term "high bandwidth memory" may refer to a high-speed random access memory interface designed for high-performance applications, such as graphics cards, high-performance computing, machine learning, and / or the like.
[0041] The connection between the circuit 104 and the first memory device 108 can be established via the interposer 102, which serves as a bridging substrate to ensure high-fidelity data exchange between the memory and the processing components. According to various embodiments, the circuit 104 can be coupled to the one or more memory devices via one or more connectors. For example, the first memory device 108 includes a third connector 110a and a fourth connector 110b. The third connector 110a and the fourth connector 110b may include one or more interface (IO) pins. For example, the term "IO pin" may refer to a physical pin on an integrated circuit or an electronic circuit board, whose function is input or output. For example, the third connector 110a may be coupled to the second connector 106b, so that the first memory device 108 is coupled to the circuit 104, thereby establishing data exchange and signaling between components.
[0042] Depending on the implementation, the first memory device 108 and the circuit 104 may be characterized by a size mismatch. In an example, the circuit 104 has a size of 20×13 mm and the first memory device 108 has a size of 11×11 mm. According to some embodiments, the number of connectors on the first memory device 108 may be greater than the number of connectors on the circuit 104. In some cases, not all connectors on the first memory device 108 are utilized.
[0043] As in Figure 1 , the first memory device 108 may be offset from the circuit 104 and / or its corresponding connector (e.g., the second connector 106b) by a certain angle or distance instead of being aligned with the first circuit 104. For example, the circuit 104 is configured to send a first signal 112 through the first connector 106a to indicate a first selection (e.g., determining which connector on the first memory device 108 is used to couple to the second connector 106b). The first selection may be determined based on various factors (e.g., predetermined routing rules, routing lengths, routing angles, signal integrity, power efficiency, thermal considerations, and / or the like). In some embodiments, the first memory device 108 further includes a first selector, which is configured to couple the third connector 110a to the second connector 106b based on the first signal 112. The third connector 110a may be positioned closer to the first position than the fourth connector 106, thereby allowing a reduction in routing distance. Depending on the implementation, the third connector 110a is coupled to the second connector 106b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle or others (e.g., routing length, routing angle, etc.). The first routing angle may be less than or equal to 45 degrees.
[0044] In various implementations, the semiconductor 100 further includes a second memory device 116. For example, the second memory device 116 may include an HBM. For example, the circuit 104 further includes a fifth connector 114a and a sixth connector 114b. The fifth connector 114a and the sixth connector 114b may include a PHY circuit (e.g., a transceiver). As an example, the circuit 104 is configured to send a second signal 120 using the fifth connector 114a to indicate a second selection (e.g., determining which connector on the second memory device 116 is used to couple to the sixth connector 114b). The second selection may be determined based on various factors (e.g., predetermined routing rules, routing lengths, routing angles, signal integrity, power efficiency, thermal considerations, and / or the like).
[0045] In some embodiments, the second memory device 116 includes a seventh connector 118a and an eighth connector 118b. The seventh connector 118a and the eighth connector 118b may include one or more interface (IO) pins. The sixth connector 114b may be coupled to the seventh connector 118a based on the second signal 120. In some cases, the second signal 120 may determine the selection of the connector on the second memory device 116 based on its distance to the sixth connector 114b to ensure that the routing length is minimized. For example, the sixth connector 114b may be positioned at the second position. The sixth connector 114b may be coupled to the seventh connector 118a. The seventh connector 118a may be closer to the second position than the eighth connector 118b.
[0046] Figure 2 2 is a simplified diagram illustrating a cross-sectional view of a semiconductor device 200 characterized by an integration scheme according to an embodiment of the present technology. This figure provides an example only, which should not unduly limit the scope of the claims. As shown, the semiconductor device 200 includes a circuit 204. For example, the circuit 204 may include an ASIC. The circuit 204 includes a first connector 206a and a second connector 206b. The second connector 206b is positioned at a first position. As an example, the first connector 206a and the second connector 206b may include a PHY circuit that may be configured to facilitate electrical bridging, mechanical bridging, and / or process bridging between electrical components.
[0047] According to some embodiments, semiconductor 200 further includes an interposer 202. Interposer 202 may be configured to provide electrical connections for circuit 204 and / or other components. As an example, interposer 202 includes a first interconnect 212 and a second interconnect 220. The term "interconnect" may refer to an electrical structure that establishes an electrical pathway between different components or sections of a semiconductor device, thereby allowing data, signal, and / or power transmission. For example, first interconnect 212 and second interconnect 220 may include, but are not limited to, metal traces, vias, and / or other conductive materials and structures.
[0048] In various implementations, the first memory device 208 may be coupled to the circuit 204 via the interposer 202. For example, the first memory device 208 may include HBM and be configured to increase bandwidth and reduce power consumption. The first memory device 208 may be coupled to the circuit 204 to facilitate fast data processing and transmission for computationally intensive applications. The circuit 204 is coupled to the first memory device 208 via one or more connectors. In some cases, the number of connectors on the first memory device 208 may be greater than the number of connectors on the first circuit 204. As an example, the first memory 208 includes a first selector 224, a third connector 210, and a fourth connector (not shown). The third connector 210 and the fourth connector may include one or more IO pins.
[0049] As previously described, when considering the large number of connectors available on the first memory device 208, only a subset of these connectors may be selected for routing toward the circuit 204. Intelligent selection of connectors results in enhanced connectivity, consistent with the goal of minimizing routing length and ensuring effective electrical connection between the first memory device 208 and the circuit 204. As an example, the circuit 204 is configured to send a first signal using the first connector 206a to indicate a first selection (e.g., determining which connector on the first memory device 208 is used to couple to the second connector 206b). The first selection may be determined based on various factors (e.g., predetermined routing rules, routing length, routing angle, signal integrity, power efficiency, thermal considerations, and / or the like).
[0050] Depending on the implementation, a data path selection mechanism may be employed to implement the first selection, thereby establishing an optimized electrical connection between the first memory device 208 and the circuit 204. For example, the first selector 224 includes a multiplexer (MUX). The term "multiplexer" may refer to an electrical component that can select an input from multiple available inputs and provide the selected input at its output. The first selector 224 may be coupled to the first connector 206a via the first interconnect 212.
[0051] To implement the data path selection mechanism, the first selector 224 may be configured to select one or more connectors on the first memory device 208 according to the first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first memory device 208 and its corresponding connector (e.g., the second connector 206b) on the circuit 204. For example, the third connector 210 may be located closer to the first position than the fourth connector. Thus, the first selector 224 may be configured to couple the third connector 210 to the second connector 206b based on the first signal. The second connector 206b may be coupled to the third connector 210 via the second interconnect 220. Thus, an electrical connection between the circuit 204 and the first memory device 208 may be established, thereby facilitating data exchange and signaling between the components.
[0052] Depending on the implementation, the circuit 204 may be coupled to a plurality of memory devices. For example, the semiconductor 200 further includes a second memory device 214 coupled to the circuit 204. According to some embodiments, the circuit 204 further includes a fifth connector 206c and a sixth connector 206d. For example, the fifth connector 206c and the sixth connector 206d may include a PHY circuit that may be configured to facilitate electrical connections, mechanical connections, and / or process bridges among electrical components. The sixth connector 206d is positioned at a second location. The interposer 202 further includes a third interconnect 218 and a fourth interconnect 222. The interposer 202 may be configured to establish an electrical connection between the circuit 204 and the second memory device 214.
[0053] In various embodiments, the second memory device 214 may include a second selector 228, a seventh connector 216, and an eighth connector (not shown). To implement the data path selection mechanism, the circuit 204 may be configured to send a second signal using the fifth connector 206c to indicate the second selection. The second selector 228 may be coupled to the fifth connector 206c via the third interconnect 218. For example, the second selector 228 may include a multiplexer that acts as a data selector by selecting one or more connectors on the second memory device 214 to route to the sixth connector 206d according to the second selection.
[0054] As an example, the second selection may be determined based on the spatial proximity of a connector on the second memory device 214 and its corresponding connector on the circuit 204 (e.g., the sixth connector 206d). For example, the seventh connector 216 may be closer to the second location than the eighth connector. Thus, the second selector 228 may be configured to couple the sixth connector 206d to the seventh connector 216 based on the second signal. The seventh connector 216 may be coupled to the sixth connector 206d through the fourth interconnect 222. Thus, an electrical connection between the circuit 204 and the second memory device 214 may be established, thereby facilitating data exchange and signaling between the components.
[0055] Figure 3300 is a simplified diagram illustrating a semiconductor device 300 characterized by an integrated scheme according to an embodiment of the present technology. This figure provides an example only, which should not overly limit the scope of the claims. As shown, the semiconductor device 300 includes a circuit 302, which may include a first connector 304a and a second connector 304b. The second connector 304b may be positioned at a first position. For example, the circuit 302 includes an ASIC. The first connector 304a and the second connector 304b may include a PHY circuit, which may be configured to facilitate electrical bridging, mechanical bridging and / or process bridging between electrical components. In some embodiments, the circuit 302 is coupled to a first memory device 306 via one or more connectors. The first memory device 306 may include an HBM. For example, the first memory device 306 includes a first selector 308, a third connector 310a and a fourth connector 310b. The third connector 310a and the fourth connector 310b may include one or more IO pins.
[0056] In various implementations, the number of connectors on the first memory device 306 may be greater than the number of connectors on the first circuit 302. For example, a data path selection mechanism may be implemented to select a subset of the connectors of the first memory device 306 for routing toward the circuit 302. In an example, the circuit 302 may be configured to send a first signal 312 using the first connector 304a to indicate a first selection. The first selector 308 may be configured to select one or more connectors on the first memory device 306 according to the first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first memory device 306 and its corresponding connector (e.g., the second connector 304b) on the circuit 302. The first selector 308 may include a multiplexer. For example, the third connector 310a may be positioned closer to the first position than the fourth connector 310b. Thus, the first selector 308 may be configured to couple the third connector 310a to the second connector 304b based on the first signal 312. Thus, an electrical connection between the circuit 302 and the first memory device 306 may be established, thereby facilitating data exchange and signaling between the components.
[0057] It should be appreciated that the inclusion of a surplus of connectors (e.g., the fourth connector 310b)—which may remain unused in some configurations—emphasizes a strategic approach to increasing HBM offset. This excess, rather than redundancy, provides tremendous design flexibility, enabling optimized routing schemes. By providing a plethora of connectors, the first memory device 306 can accommodate a variety of circuit sizes, enabling a potential size reduction of the circuit 302 (e.g., an ASIC). In addition, embodiments of the present technology ensure reusability of memory devices (e.g., the first memory device 306), enabling seamless integration with the circuit 302 in a variety of configurations and orientations.
[0058] Figure 4 4 is a simplified diagram illustrating a semiconductor device 400 characterized by an integration scheme according to an embodiment of the present technology. This figure provides an example only, which should not unduly limit the scope of the claims. As shown, the semiconductor device 400 includes a circuit 404. For example, the circuit 404 includes an ASIC, a dedicated electrical component designed to perform a specific function with optimized efficiency. The circuit 404 may include a first connector 414a and a second connector 414b. The second connector 414b is positioned at a first position. As an example, the first connector 414a and the second connector 414b may include a PHY circuit, which may be configured to facilitate electrical bridging, mechanical bridging, and / or process bridging between electrical components.
[0059] According to some embodiments, semiconductor device 400 further includes an interposer 402. Interposer 402 may be configured to provide electrical connections for circuit 404 and / or other components. In various implementations, a first buffer die 406 may be coupled to circuit 404 via interposer 402. The term "buffer die" may refer to an intermediate silicon component used to mediate communications and manage data transfers between semiconductor modules. The term "die" or "semiconductor die" may refer to a piece or section of semiconductor material (e.g., silicon) containing an integrated circuit system. This integrated circuit system may include various electronic components, such as transistors, capacitors, resistors, and other microelectronic structures, which together perform specific electronic functions.
[0060] In some embodiments, a first buffer die 406 is coupled to the interposer 402. The first buffer die 406 may also be coupled to a first memory device 412. Depending on the implementation, the first memory device 412 includes HBM and is configured to increase bandwidth and reduce power consumption. The first memory device 412 may be coupled to the circuit 404 via the first buffer die 406 to facilitate fast data processing and transmission for computationally intensive applications. For example, the first memory device 412 may be assembled on the first buffer die 406 and coupled to the circuit 404 via the first buffer die 406.
[0061] In various embodiments, the first buffer die 406 includes an HBM buffer die configured to convert the HBM protocol to an interposer interconnect compatible protocol (e.g., an advanced scalable interface). The ability to translate between different communication standards allows the first buffer die 406 to regulate the data flow between modules operating at different speeds, thereby advantageously enhancing signal integrity and system reliability. The first buffer die 406 can be coupled to the circuit 404 via one or more interconnects in the interposer 402, as will be described in further detail below.
[0062] As an example, the first buffer die 406 may include a first selector (not shown), a third connector 410a, and a fourth connector 410b. The third connector 410a and the fourth connector 410b may include one or more IO pins. In various embodiments, a data path selection mechanism may be implemented to select a subset of the connectors of the first buffer die 406 for routing toward the circuit 404. The circuit 404 may be configured to send a first signal 408 using the first connector 414a to indicate a first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first buffer die 406 and its corresponding connector (e.g., the second connector 414b) on the circuit 404. In an example, the third connector 410a may be positioned closer to the first position than the fourth connector 410b. The first selector may be configured to couple the third connector 410a to the second connector 414b based on the first signal 408. Depending on the implementation, the third connector 410a is coupled to the second connector 414b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle. In an example, the first routing angle is less than or equal to 45 degrees.
[0063] Figure 5 5 is a simplified diagram illustrating a cross-sectional view of a semiconductor device 500 characterized by an integration scheme according to an embodiment of the present technology. This figure provides an example only, which should not unduly limit the scope of the claims. As shown, the semiconductor device 500 includes a circuit 504. For example, the circuit 504 may include an ASIC. The circuit 504 includes a first connector 506a and a second connector 506b. The second connector 506b is positioned at a first position. As an example, the first connector 506a and the second connector 506b may include a PHY circuit, which may be configured to facilitate electrical bridging, mechanical bridging, and / or process bridging between electrical components.
[0064] According to some embodiments, semiconductor 500 further includes interposer 502. For example, circuit 504 is coupled to interposer 502. Interposer 502 can be configured to provide electrical connections for circuit 504 and / or other components. In various implementations, interposer 502 includes first interconnect 514 and second interconnect 516. First interconnect 514 and second interconnect 516 can include, but are not limited to, metal traces, vias, and / or other conductive materials and structures.
[0065] In various implementations, the first buffer die 508 may be coupled to the circuit 504 via the interposer 502. For example, the first buffer die 508 is coupled to the interposer 502. The first buffer die 508 includes a first selector 510, a third connector 518, and a fourth connector (not shown). The third connector 518 and the fourth connector may include one or more IO pins. Depending on the implementation, the first buffer die 508 may be coupled to a first memory device 512. For example, the first memory device 512 includes HBM and is configured to increase bandwidth and reduce power consumption. The first memory device 512 may be coupled to the circuit 504 via the first buffer die 508 to facilitate fast data processing and transmission for computationally intensive applications.
[0066] In various embodiments, a data path selection mechanism may be implemented to select a subset of the connectors of the first buffer die 508 for routing toward the circuit 504. The circuit 504 may be configured to send a first signal using the first connector 506a to indicate a first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first buffer die 508 and its corresponding connector (e.g., the second connector 506b) on the circuit 504. In an example, the third connector 518 may be positioned closer to the first position than the fourth connector. The first selector 510 may include a multiplexer and is configured to couple the third connector 518 to the second connector 506b based on the first signal. For example, the first selector 510 is coupled to the first connector 506a by the first interconnect 514. The third connector 518 is coupled to the second connector 506b by the second interconnect 516. Depending on the implementation, the third connector 518 is coupled to the second connector 506b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle. In an example, the first routing angle is less than or equal to 45 degrees.
[0067] Figure 6 6 is a simplified diagram illustrating a semiconductor device 600 characterized by an integration scheme according to an embodiment of the present technology. This figure provides an example only, which should not unduly limit the scope of the claims. As shown, the semiconductor device 600 includes a circuit 604. For example, the circuit 604 includes an ASIC, a dedicated electrical component designed to perform a specific function with optimized efficiency. The circuit 604 may include a first connector 612a and a second connector 612b. The second connector 612b is positioned at a first position. As an example, the first connector 612a and the second connector 612b may include a PHY circuit, which may be configured to facilitate electrical bridging, mechanical bridging, and / or process bridging between electrical components.
[0068] According to some embodiments, the semiconductor device 600 further includes an interposer 602. The interposer 602 may be configured to provide electrical connections for the circuit 604 and / or other components. For example, the first buffer die 614 may be coupled to the circuit 604 via the interposer 602. The first buffer die 614 may also be coupled to the first memory device 606. In an example, the first memory device 606 includes HBM and is configured to increase bandwidth and reduce power consumption. The first memory device 606 may be coupled to the circuit 604 via the first buffer die 614 to facilitate fast data processing and transmission for computationally intensive applications. In some cases, the first buffer die 614 includes an HBM buffer die configured to convert the HBM protocol to an interposer interconnect compatible protocol (e.g., an advanced scalable interface). The ability to translate between different communication standards allows the first buffer die 614 to regulate the data flow between modules operating at different speeds, thereby advantageously enhancing signal integrity and system reliability.
[0069] As an example, the first buffer die 614 may include a first selector, a third connector 610a and a fourth connector 610b. The third connector 610a and the fourth connector 610b may include one or more IO pins. In various embodiments, a data path selection mechanism may be implemented to select a subset of the connectors of the first buffer die 614 for routing toward the circuit 604. The circuit 604 may be configured to use the first connector 612a to send a first signal 608 to indicate a first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first buffer die 614 and its corresponding connector (e.g., the second connector 612b) on the circuit 604. In an example, the third connector 610a may be positioned closer to the first position than the fourth connector 610b. The first selector may be configured to couple the third connector 610a to the second connector 612b based on the first signal 608. Depending on the implementation, the third connector 610a is coupled to the second connector 612b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle. In an example, the first routing angle is less than or equal to 45 degrees.
[0070] According to some embodiments, the semiconductor device 600 further includes an interposer 602. The interposer 602 may be configured to provide electrical connections for the circuit 604 and / or other components. For example, the first buffer die 614 may be coupled to the circuit 604 via the interposer 602. The first buffer die 614 may also be coupled to the first memory device 606. In an example, the first memory device 606 includes HBM and is configured to increase bandwidth and reduce power consumption. The first memory device 606 may be coupled to the circuit 604 via the first buffer die 614 to facilitate fast data processing and transmission for computationally intensive applications. In some cases, the first buffer die 614 includes an HBM buffer die configured to convert the HBM protocol to an interposer interconnect compatible protocol (e.g., an advanced scalable interface). The ability to translate between different communication standards allows the first buffer die 614 to regulate the data flow between modules operating at different speeds, thereby advantageously enhancing signal integrity and system reliability.
[0071] As an example, the first buffer die 614 may include a first selector, a third connector 610a and a fourth connector 610b. The third connector 610a and the fourth connector 610b may include one or more IO pins. In various embodiments, a data path selection mechanism may be implemented to select a subset of the connectors of the first buffer die 614 for routing toward the circuit 604. The circuit 604 may be configured to use the first connector 612a to send a first signal 608 to indicate a first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first buffer die 614 and its corresponding connector (e.g., the second connector 612b) on the circuit 604. In an example, the third connector 610a may be positioned closer to the first position than the fourth connector 610b. The first selector may be configured to couple the third connector 610a to the second connector 612b based on the first signal 608. Depending on the implementation, the third connector 610a is coupled to the second connector 612b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle. In an example, the first routing angle is less than or equal to 45 degrees.
[0072] As in Figure 6606. As shown in FIG. 60 , both the first buffer die 614 and the first memory device 606 can be coupled to the interposer 602. The electrical connection between the first buffer die 604 and the first memory device 606 can be established through the interposer 602. In some cases, the first buffer die 614 is coupled between the first memory device 606 and the circuit 604. This strategic placement facilitates the increase of the HBM offset and provides design flexibility, allowing design modifications to be made without requiring direct changes to the first memory device 606 or the circuit 604. In addition, the spatial buffer introduced by the first buffer die 614 assists in better thermal management by providing spatial separation, thereby ensuring effective heat dissipation and preventing excessive thermal loads on adjacent components.
[0073] Figure 7 706a and 706b. The second connector 706b is positioned at a first position. As an example, the first connector 706a and the second connector 706b may include a PHY circuit that can be configured to facilitate electrical bridging, mechanical bridging, and / or process bridging between electrical components.
[0074] According to some embodiments, semiconductor 700 further includes an interposer 702. For example, circuit 704 is coupled to interposer 702. Interposer 702 can be configured to provide electrical connections for circuit 704 and / or other components. In various implementations, interposer 702 includes a first interconnect 714 and a second interconnect 716. First interconnect 714 and second interconnect 716 can include, but are not limited to, metal traces, vias, and / or other conductive materials and structures.
[0075] In various implementations, the first buffer die 708 may be coupled to the circuit 704 via the interposer 702. For example, the first buffer die 708 is coupled to the interposer 702. The first buffer die 708 includes a first selector 710, a third connector 718, and a fourth connector (not shown). The third connector 718 and the fourth connector may include one or more IO pins. Depending on the implementation, the first buffer die 708 may be coupled to the first memory device 712. For example, the first memory device 712 includes HBM and is configured to increase bandwidth and reduce power consumption. The first memory device 712 may be coupled to the circuit 704 via the first buffer die 708 to facilitate fast data processing and transmission for computationally intensive applications. In some cases, the first buffer die 708 is coupled between the first memory device 712 and the circuit 704 to provide an increased HBM offset.
[0076] In various embodiments, a data path selection mechanism may be implemented to select a subset of the connectors of the first buffer die 708 for routing toward the circuit 704. The circuit 704 may be configured to send a first signal using the first connector 706a to indicate a first selection. As an example, the first selection may be determined based on the spatial proximity of the connector on the first buffer die 708 and its corresponding connector (e.g., the second connector 706b) on the circuit 704. In an example, the third connector 718 may be positioned closer to the first position than the fourth connector. The first selector 710 may be configured to couple the third connector 718 to the second connector 706b based on the first signal. The first selector 710 may include a multiplexer. For example, the first selector 710 is coupled to the first connector 706a by the first interconnect 714. The third connector 718 is coupled to the second connector 706b by the second interconnect 716. Depending on the implementation, the third connector 718 is coupled to the second connector 706b according to a predetermined routing rule. The predetermined routing rule may be characterized by a first routing angle. In an example, the first routing angle is less than or equal to 45 degrees.
[0077] While the above is a complete description of specific embodiments, various modifications, alternative constructions, and equivalents may be used. Therefore, the above description and illustrations should not be taken as limiting the scope of the present technology, which is defined by the appended claims.
Claims
1. A device comprising: a circuit comprising a first connector and a second connector, the circuit being configured to send a first signal to indicate a first selection using the first connector, the second connector being positioned at a first position; an interposer including a first interconnect and a second interconnect; and A first memory device includes a first selector and a third connector and a fourth connector, the first selector being coupled to the first connector through the first interconnect, the first selector being configured to couple the third connector to the second connector through the second interconnect based on the first signal, the third connector being positioned closer to the first position than the fourth connector.
2. The apparatus of claim 1 , further comprising a second memory device, wherein: The circuit further includes a fifth connector and a sixth connector, the circuit being configured to send a second signal to indicate a second selection using the fifth connector, the sixth connector being positioned at a second position; The interposer further includes a third interconnect and a fourth interconnect; and The second memory device includes a second selector and a seventh connector and an eighth connector, the second selector being coupled to the fifth connector through the third interconnect, the second selector being configured to couple the sixth connector to the seventh connector through the fourth interconnect based on the second signal, the seventh connector being closer to the second position than the eighth connector.
3. The apparatus of claim 1, wherein the circuit comprises an application specific integrated circuit.
4. The apparatus of claim 1, wherein the first memory device comprises a high bandwidth memory. The device of claim 1 , wherein the first connector comprises a physical layer circuit. The device of claim 1 , wherein the third connector is coupled to the second connector according to a predetermined routing rule.
7. A device comprising: a circuit comprising a first connector and a second connector, the circuit being configured to send a first signal to indicate a first selection using the first connector, the second connector being positioned at a first position; an interposer including a first interconnect and a second interconnect; and A first buffer die includes a first selector and a third connector and a fourth connector, wherein the first selector is coupled to the first connector through the first interconnect, the first selector is configured to couple the third connector to the second connector through the second interconnect based on the first signal, and the third connector is positioned closer to the first position than the fourth connector.
8. The apparatus of claim 7, further comprising a first memory device coupled to the first buffer die.
9. The apparatus of claim 7, further comprising a first memory device coupled to the interposer.
10. The apparatus of claim 9, wherein the first memory device comprises a high bandwidth memory.
11. The apparatus of claim 7, wherein the circuit comprises an application specific integrated circuit.
12. The apparatus of claim 7, wherein the first buffer die is coupled to the interposer.
13. The apparatus of claim 7, wherein the third connector is coupled to the second connector according to a predetermined routing rule.
14. The apparatus of claim 7, wherein the third connector is coupled to the second connector through the second interconnect.
15. The apparatus of claim 7, wherein the first selector comprises a multiplexer.
16. The apparatus of claim 7, wherein the first connector comprises a physical layer circuit.
17. An apparatus comprising: a circuit comprising a first connector and a second connector, the circuit being configured to send a first signal to indicate a first selection using the first connector, the second connector being positioned at a first position; an interposer coupled to the circuit, the interposer comprising a first interconnect; and A first memory device includes a first selector and a third connector and a fourth connector, the first selector being coupled to the first connector through the first interconnect, the first selector being configured to couple the third connector to the second connector based on the first signal, the third connector being positioned closer to the first position than the fourth connector.
18. The apparatus of claim 17, wherein the circuit comprises an application specific integrated circuit.
19. The apparatus of claim 17, wherein the first memory device comprises a high bandwidth memory.
20. The apparatus of claim 17, wherein the first selector comprises a multiplexer.
Citation Information
Patent Citations
Extended HBM offsets in 2.5 D interposers
CN115117034A
Power distribution for stacked memory
CN115206391A
High bandwidth memory (HBM) bandwidth aggregation switch
US20180358313A1
High bandwidth memory package for high performance processors
US20190312002A1
