3D stacked chip

By placing the logic die on the outside in a three-dimensional stacked chip and optimizing the heat dissipation path using buffer die, thermal conductive layer, and heat dissipation elements, the problem of low heat dissipation performance in traditional three-dimensional stacked packaging is solved, improving chip reliability and signal integrity.

CN123124864APending Publication Date: 2026-11-17ZHIHAOTONG (TIANJIN) INFORMATION TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611316142.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-08-27
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

In traditional 3D stacked packaging solutions, the heat from high-power logic dies is difficult to dissipate quickly, resulting in poor heat dissipation performance, which affects the working performance of DRAM dies and the reliability of 3D stacked chips.

Method used

The logic die is placed on the outside of the three-dimensional stacked chip. The buffer die is electrically connected to the packaging substrate and the memory die to achieve signal shaping and connection. A thermally conductive medium layer and heat dissipation elements are placed between the logic die and the packaging substrate to optimize the heat dissipation path.

Benefits of technology

It improves the heat dissipation performance and operational reliability of 3D stacked chips, reduces the temperature gradient and heat accumulation of bare memory dies, improves signal integrity, and simplifies the wiring design of the packaging substrate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123124864A_ABST
    Figure CN123124864A_ABST
Patent Text Reader

Abstract

This application provides a three-dimensional stacked chip to improve its heat dissipation performance and operational reliability. The three-dimensional stacked chip includes a packaging substrate and buffer dies, at least one memory die, and a logic die stacked sequentially on a first surface of the packaging substrate. The packaging substrate is used for electrical connection to an external controller, and the buffer die is electrically connected to the packaging substrate, at least one memory die, and the logic die. The buffer die shapes and connects the electrical signals between the logic die and the memory die. The memory die stores data information. The logic die runs control or calculation programs and accesses the data information within the memory die to generate stored data or calculation results. The logic die can also transmit the obtained stored data or calculation results back to the packaging substrate via the buffer die.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of chip design technology, and in particular to a three-dimensional stacked chip. Background Technology

[0002] In artificial intelligence accelerators, high-performance computing, and data centers, 3D stacked packaging is commonly used to integrate logic chips with high-bandwidth memory in order to balance bandwidth, integration, and system energy efficiency.

[0003] Traditional three-dimensional stacked packaging solutions place high-power logic bare dies or substrate bare dies of integrated logic circuits at the bottom of the DRAM stack, adjacent to the packaging substrate, to facilitate the docking of logic circuits with the packaging substrate and to enable data interaction with external circuit boards.

[0004] However, in traditional 3D stacked packaging solutions, high-power logic dies or integrated logic circuit substrate dies have high power consumption, generate a lot of heat, and have limited heat dissipation paths, making it difficult to quickly dissipate the generated heat. Furthermore, this heat is transferred to DRAM dies, degrading their performance and resulting in low reliability of the 3D stacked chips. Therefore, traditional 3D stacked packaging solutions suffer from poor heat dissipation and operational reliability. Summary of the Invention

[0005] This application provides a three-dimensional stacked chip to improve its heat dissipation performance and operational reliability.

[0006] This application provides a three-dimensional stacked chip, including a packaging substrate, a buffer die, at least one memory die, and a logic die. The packaging substrate includes a first surface located on one side of the thickness direction. Along the thickness direction of the packaging substrate, the buffer die, at least one memory die, and the logic die are stacked sequentially on the first surface. The packaging substrate is used for electrical connection with an external controller and for electrical connection with the buffer die, at least one memory die, and the logic die. The buffer die is used for shaping and connecting electrical signals between the memory die and the logic die. The memory die is used for storing data information. The logic die is used for running control or calculation programs and accessing the data information in the memory die to generate storage read data or calculation results. The logic die can also transmit the obtained storage read data or calculation results back to the packaging substrate via the buffer die.

[0007] In one possible embodiment, the power density or thermal density of the buffer die is less than that of the logic die.

[0008] In one possible embodiment, the three-dimensional stacked chip includes a thermally conductive dielectric layer; along the thickness direction of the package substrate, the thermally conductive dielectric layer is attached to the surface of the logic die away from the memory die.

[0009] In one possible embodiment, the three-dimensional stacked chip includes a heat dissipation element; along the thickness direction of the packaging substrate, the heat dissipation element is located on the side of the logic die away from the memory die, and a thermally conductive dielectric layer is located between the heat dissipation element and the logic die.

[0010] In one possible embodiment, the three-dimensional stacked chip includes a vertical interconnect structure and a vertical thermal conductive structure; the vertical interconnect structure extends through the memory die along the thickness direction of the packaging substrate and electrically connects the memory die to the buffer die and the logic die; the vertical thermal conductive structure is disposed within the memory die and spaced apart from the vertical interconnect structure; the vertical thermal conductive structure extends along the thickness direction of the packaging substrate, and one end of the vertical thermal conductive structure in the extension direction contacts the logic die.

[0011] In one possible embodiment, the storage die includes at least one active array region and a passive region, the active array region including multiple storage cells arranged in an array; a vertical heat-conducting structure is disposed in the passive region.

[0012] In one possible embodiment, along the thickness direction of the packaging substrate, the projected area of ​​the buffer die on the packaging substrate is greater than or equal to the projected area of ​​the storage die on the packaging substrate.

[0013] In one possible embodiment, the buffer die includes a buffer control unit and a buffer auxiliary unit; the buffer control unit is electrically connected to the packaging substrate, the memory die, and the logic die; the buffer auxiliary unit includes at least one temperature sensor; the at least one temperature sensor is electrically connected to the buffer control unit; the temperature sensor is used to collect local temperature information of the memory die and / or the buffer die and / or the packaging substrate, and feeds back the temperature information to the logic die or an external controller through the buffer control unit; the logic die or the external controller is configured to generate power consumption or heat dissipation control commands based on the temperature information.

[0014] In one possible embodiment, the buffer auxiliary unit includes a power management auxiliary circuit, an electrostatic discharge (ESD) protection structure, test pads, a thermally conductive component, and a redistribution fan-out structure. The power management auxiliary circuit, ESD protection structure, test pads, and redistribution fan-out structure are electrically connected to the buffer control unit.

[0015] In one possible embodiment, the buffer die includes a buffer main board, a buffer control unit, and a buffer auxiliary unit disposed on the buffer main board; along the thickness direction of the packaging substrate, the orthographic projection area of ​​the buffer main board on the packaging substrate is larger than the orthographic projection area of ​​the storage die on the packaging substrate; the buffer main board includes a main body and an edge portion, the edge portion extending circumferentially around the main body; along the thickness direction of the packaging substrate, the main body is disposed opposite to the storage die; the edge portion is located on the outer periphery of the storage die; the buffer control unit is disposed on the main body, and the buffer auxiliary unit is disposed on the edge portion.

[0016] The 3D stacked chip of this application, on the one hand, by placing the logic bare die on the side away from the packaging substrate, that is, on the outside of the 3D stacked chip, allows the heat of the logic bare die to be directly dissipated, shortening the heat dissipation path of the logic bare die, significantly reducing the heat generated by the logic bare die flowing through the memory bare die, reducing the overall temperature and local temperature gradient of the memory bare die, and improving the heat dissipation performance and operational reliability of the 3D stacked chip. On the other hand, by placing a buffer bare die between the memory bare die and the packaging substrate, and electrically connecting the buffer bare die to the packaging substrate, the memory bare die, and the logic bare die, the electrical signals between the memory bare die and the logic bare die can be shaped and connected, preventing the original electrical signals from directly passing through the memory bare die, improving signal integrity and simplifying the wiring design of the packaging substrate. At the same time, since the buffer bare die only performs low-power functions such as signal relay, it generates little heat and will not affect the adjacent memory bare die, further ensuring the operational reliability of the 3D stacked chip. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] Figure 1 This is a schematic diagram of the structure of a three-dimensional stacked chip according to an embodiment of this application;

[0019] Figure 2 A schematic diagram of the structure of a three-dimensional stacked chip according to another embodiment of this application;

[0020] Figure 3 A schematic diagram showing the distribution of the active array region and the passive region in the storage die provided in this application.

[0021] Reference numerals: 1. Packaging substrate; 11. First surface; 12. Second surface; 2. Buffer die; 21. Buffer motherboard; 211. Main body; 212. Edge; 3. Memory die; 31. Active array area; 32. Passive area; 4. Logic die; 5. Thermal conductive layer; 6. Heat dissipation element; 7. Vertical interconnect structure; 8. Vertical thermal conductive structure.

[0022] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0023] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application.

[0024] 3D stacked chip technology is mainly used in scenarios such as artificial intelligence accelerators, high-performance computing platforms, and data center servers. In such systems, it is usually necessary to tightly integrate logic chips that perform computing tasks with memory chips that perform high-capacity, high-bandwidth data access tasks, in order to improve bandwidth density, computing efficiency, and overall energy efficiency within a limited package area.

[0025] The relevant system typically includes a packaging substrate, logic chips, and one or more memory chips, which are vertically stacked to form a highly integrated packaging structure, enabling external controllers to work in conjunction with the internal computing and storage units of the chips, thereby meeting the needs of large-scale data processing and high-speed memory access.

[0026] In existing 3D stacking schemes, logic chips are tightly stacked between the packaging substrate and the memory chip. An external controller inputs control signals, address signals, data signals and power supply signals to the logic chip through the interface of the packaging substrate. After the logic chip executes the calculation or control program, it accesses the data in the memory chip and outputs the corresponding results.

[0027] In high-power operation, the logic chip of this type of structure generates a large amount of heat, which needs to be transferred to the memory chip and then dissipated from the memory chip. This heat tends to accumulate on the memory chip. Since memory chips are highly sensitive to temperature, excessively high local junction temperatures and temperature gradients can affect their refresh power consumption, data retention capability, timing margin, and package thermal reliability, thereby impacting their stable operational reliability.

[0028] Furthermore, simply moving the logic die to the side of the memory chip away from the packaging substrate, i.e. stacking the memory chip between the packaging substrate and the logic chip, will lead to problems such as longer interface distance for transmitting electrical signals from the packaging substrate to the logic chip, reduced signal integrity, more complex power distribution, and more difficult packaging and testing. Moreover, the wiring design of the packaging substrate needs to be more complex.

[0029] To address the aforementioned issues, this application provides a three-dimensional stacked chip. This involves sequentially stacking a buffer die, at least one memory die, and a logic die along the thickness direction on the first surface of a packaging substrate. The buffer die is electrically connected to the packaging substrate, the memory die, and the logic die. The buffer die shapes and connects the electrical signals between the memory die and the logic die. The logic die receives the shaped signals, runs control or computation programs, accesses data information in the memory die, and then transmits the read data or computation results back to the memory die via the buffer die. This provides a foundation for improving the heat dissipation performance and operational reliability of the stacked chip.

[0030] Specifically, such as Figure 1 and Figure 2 As shown, the three-dimensional stacked chip includes a packaging substrate 1, a buffer die 2, at least one memory die 3, and a logic die 4.

[0031] The packaging substrate 1 includes a first surface 11 and a second surface 12 disposed opposite to each other, with the first surface 11 and the second surface 12 respectively disposed on opposite sides in the thickness direction of the packaging substrate 1. Along the thickness direction of the packaging substrate 1, a buffer die 2, at least one storage die 3 and a logic die 4 are sequentially stacked on the first surface 11.

[0032] Among them, the thickness direction of the packaging substrate 1 is also... Figure 1 and Figure 2 The vertical direction within the stacked chip. Understandably, the thickness direction of the packaging substrate 1 is also the stacking direction of the three-dimensional stacked chip of this application. Along the stacking direction, the buffer die 2 and at least one memory die 3 are located between the packaging substrate 1 and the logic die 4, with the logic die 4 located on the outside of the three-dimensional stacked chip.

[0033] In some cases, the stacking direction is the height direction. In this case, the packaging substrate 1 is located at the bottom of the three-dimensional stacked chip, and the logic die 4 is located at the top of the three-dimensional stacked chip.

[0034] Furthermore, the packaging substrate 1 is used for electrical connection with an external controller. The buffer die 2 is electrically connected to the packaging substrate 1, at least one storage die 3, and a logic die 4. The buffer die 2 is used to shape and connect the electrical signals between the storage die 3 and the logic die 4. The storage die 3 is used to store data information. The logic die 4 is used to run control or calculation programs and access the data information in the storage die 3 to generate stored read data or calculation results. Furthermore, the logic die 4 can transmit the obtained stored read data or calculation results back to the packaging substrate 1 via the buffer die 2, and then back to the external controller.

[0035] It should be noted that the above-mentioned packaging substrate 1 is a basic support structure used to support the above-mentioned buffer bare core 2, storage bare core 3 and logic bare core 4, and to provide an electrical connection channel to the external controller. Its function is to form a mechanical support, power distribution and signal output platform.

[0036] The buffer die 2 is a semiconductor chip disposed between the packaging substrate 1 and the storage die 3, used for signal shaping, connection, and interface adaptation. Its functions include receiving control signals, address signals, data signals, and power supply signals from the packaging substrate 1, shaping and connecting the electrical signals between the storage die 3 and the logic die 4, and receiving storage read data or calculation results returned by the logic die 4. The buffer die 2 can be equipped with appropriate semiconductor materials and circuit structures according to functional requirements to meet signal relay and interface connection requirements.

[0037] Furthermore, the specific circuit structure of the buffer die 2 can be adaptively adjusted according to application requirements. For example, the circuit structure of the buffer die 2 may include passive or semi-active signal buffering, ESD (Electro-Static Discharge) and power distribution structures. For example, the circuit structure of the buffer die 2 may also include low-power serial-to-parallel conversion, clock recovery, training calibration, test scan chain, temperature detection, fuse configuration reading, or safe startup auxiliary circuitry, etc. However, the buffer die 2 preferably does not undertake major high-power computing tasks.

[0038] The storage die 3 is a semiconductor chip used to store data information. Its function is to respond to the access request of the logic die 4 and output the corresponding data. Exemplarily, one storage die 3 may be provided. Exemplarily, multiple storage dies 3 may be provided along the thickness direction of the packaging substrate 1, such as 2, 3, 4, 5, or other numbers. When multiple storage dies 3 are provided, the multiple storage dies 3 are stacked sequentially along the thickness direction of the packaging substrate 1, and adjacent storage dies 3 are electrically connected.

[0039] For example, the storage die 3 can be any one of HBM (High Bandwidth Memory), SRAM (Static Random-Access Memory), MRAM (Magnetoresistive Random-Access Memory), RRAM (Resistive Random-Access Memory), Flash Memory, PCM (Phase-Change Memory), and DRAM (Dynamic Random-Access Memory). When multiple storage dies 3 are provided, DRAM can also be combined with other types of storage dies 3 to form a hybrid stacked structure.

[0040] The logic die 4 is a semiconductor chip that is responsible for the execution of control or calculation programs. Its function is to run the control or calculation process according to the electrical signals transmitted after the buffer die 2 is shaped, and to access the data information in one or more storage dies 3.

[0041] For example, logic die 4 can be a CPU (Central Processing Unit), GPU (Graphics Processing Unit), AI accelerator (Artificial-Intelligence Accelerator), network processor, near-memory computing unit, programmable logic, or dedicated control logic. Logic die 4 can select an appropriate device structure and process configuration according to the functional requirements of the 3D stacked chip to support program execution and data processing.

[0042] In the 3D stacked chip tooling of this application, the external controller inputs electrical signals such as control, address, data signals and power supply signals to the buffer die 2 through the packaging substrate 1. The buffer die 2 shapes the electrical signals and forwards them to the logic die 4. The logic die 4 executes the calculation or control program and accesses the data information stored in the die 3. The result is then sent back to the packaging substrate 1 through the buffer die 2 and transmitted to the external controller by the packaging substrate 1.

[0043] In this embodiment, on the one hand, by placing the logic die 4 on the side away from the packaging substrate 1, i.e., on the outside of the three-dimensional stacked chip, the heat of the logic die 4 can be directly dissipated, shortening the heat dissipation path of the logic die 4. This significantly reduces the amount of heat generated by the logic die 4 flowing through the storage die 3, lowering the overall temperature and local temperature gradient of the storage die 3, and improving the heat dissipation performance and operational reliability of the three-dimensional stacked chip. On the other hand, by placing a buffer die 2 between the storage die 3 and the packaging substrate 1, and electrically connecting the buffer die 2 to the packaging substrate 1, the storage die 3, and the logic die 4, the electrical signals between the storage die 3 and the logic die 4 can be shaped and connected, preventing the original electrical signals from directly passing through the storage die 3, improving signal integrity and simplifying the wiring design of the packaging substrate 1. At the same time, since the buffer die 2 only performs low-power functions such as signal relay, it generates little heat and will not affect the adjacent storage die 3, further ensuring the operational reliability of the three-dimensional stacked chip.

[0044] Furthermore, in some embodiments, the power density or thermal density of the buffer die 2 is lower than that of the logic die 4. Since the power density or thermal density of the buffer die 2 is lower than that of the logic die 4, it generates less heat and will not form a significant heat source superposition between the storage die 3 and the logic die 4. Therefore, the intensity of heat transfer to the storage area along the stacking direction can be reduced, thereby reducing the temperature rise and thermal disturbance of the storage die 3.

[0045] Building upon the foregoing embodiments, the three-dimensional stacked chip further includes a thermally conductive dielectric layer 5. Along the thickness direction of the packaging substrate 1, the thermally conductive dielectric layer 5 is attached to the surface of the logic die 4 away from the memory die 3.

[0046] In this application, the thermally conductive medium layer 5 is a heat dissipation medium structure disposed on the side of the logic die 4 away from the storage die 3 and thermally coupled to its surface. Its function is to preferentially dissipate the heat generated by the logic die 4 during operation along the thickness direction. The thermally conductive medium layer 5 can be located between the upper surface of the logic die 4 and the heat dissipation component above it, or it can directly cover the exposed back side of the logic die 4, reducing the interface thermal resistance by means of surface contact, local tight adhesion, or filling micro-gaps.

[0047] For example, the thermally conductive dielectric layer 5 can be implemented using one or more of the following: thermally conductive silicone grease, thermally conductive gel, metal thermal interface material, graphite sheet, sintered silver layer, or thermally conductive insulating sheet. It can also be made into a continuous film, a partially filled layer, or a composite sandwich layer. The thickness of the thermally conductive dielectric layer 5 can be from several micrometers to hundreds of micrometers, and the specific value is determined based on the chip warpage, assembly tolerance, and target thermal conductivity. The compressibility and elastic modulus are used to match the packaging stress.

[0048] During operation, the logic die 4 generates localized heat when performing control or computation tasks. The thermally conductive layer 5, being attached to the surface of the logic die 4 furthest from the memory die 3, receives this heat first and rapidly diffuses it outwards via the high thermal conductivity material and low interfacial thermal resistance. This preferential guidance of heat to the heat dissipation components on the back side of the package reduces the tendency for heat to transfer along the stacking direction to the memory die 3, thereby reducing the temperature rise in the memory die 3 region and suppressing heat accumulation. Based on the synergistic effect of the above structure and materials, the thermal coupling between the logic die 4 and the memory die 3 is weakened, resulting in a more uniform temperature distribution in the stacked area. This, in turn, improves access stability, data retention reliability, and overall package reliability during long-term operation.

[0049] Furthermore, in some embodiments, the three-dimensional stacked chip includes a heat dissipation element 6. Along the thickness direction of the packaging substrate 1, the heat dissipation element 6 is located on the side of the logic die 4 away from the memory die 3, and the thermally conductive dielectric layer 5 is located between the heat dissipation element 6 and the logic die 4.

[0050] Understandably, the heat dissipation element 6 is also the heat dissipation component that cooperates with the heat-conducting medium layer 5 as described above.

[0051] For example, the heat dissipation element 6 can be a heat sink, a metal cover plate, a heat dissipation sheet, a heat vapor chamber, a back heat dissipation layer, a liquid cooling plate, or a graphite-based thermal conductive plate, etc. The thickness of the heat dissipation element 6 can be set from about 50 μm to several millimeters depending on the package height and thermal design power, and the thickness of the thermally conductive medium layer 5 can be from several micrometers to several hundred micrometers to achieve a balance between mechanical bonding, thermal conduction, and package stress, and its contact area preferably covers the main heat-generating area of ​​the logic die 4.

[0052] In one possible embodiment, the heat dissipation element 6 can directly cover the outside of the thermally conductive medium layer 5 and be connected to the packaging structure by press-fitting, welding, brazing, adhesive bonding, or mechanical fastening. It can also be coupled with an air-cooled, liquid-cooled, or heat pipe system to form an active or passive heat dissipation path. The thermally conductive medium layer 5 can also be a composite material in which boron nitride, alumina, aluminum nitride, or silver particles are dispersed in a high thermal conductivity polymer matrix to balance thermal conductivity, processability, and interface conformability.

[0053] For example, in Figure 1 In the illustrated embodiment, the heat dissipation element 6 is a metal cover plate, which is disposed on top of the three-dimensional stacked chip and connected to the packaging substrate 1 to form a sealing structure. Alternatively, in some embodiments not shown in the figures, the metal cover plate may also be connected to an external heat sink or liquid cooling plate.

[0054] In this embodiment, by setting the heat dissipation element 6, it can further cooperate with the thermal conductive medium layer 5 to improve heat dissipation performance, improve the heat distribution uniformity of stacked chips, reduce the heat impact on the storage area, and improve thermal stability and packaging reliability under high load operation.

[0055] Furthermore, the three-dimensional stacked chip includes a vertical interconnect structure 7 and a vertical thermal conduction structure 8. The aforementioned buffer die 2 is electrically connected to the memory die 3 and logic die 4 through the vertical interconnect structure 7. Understandably, the vertical interconnect structure 7 is a vertical electrical connection path for transmitting data, control signals, and power supply signals in the stacking direction.

[0056] Specifically, along the thickness direction of the packaging substrate 1, the vertical interconnect structure 7 penetrates the memory die 3 and electrically connects the memory die 3 to the buffer die 2 and the logic die 4. For example, the vertical interconnect structure 7 can be disposed in the via area or bonding area of ​​the memory die 3 and electrically connected to the corresponding pads, vias, or redistribution layers of the buffer die 2 and the logic die 4.

[0057] More specifically, multiple vertical interconnect structures 7 can be configured, and each vertical interconnect structure 7 can perform different functions. For example, some vertical interconnect structures 7 are used to form data signal channels, some vertical interconnect structures 7 are used to form command / address channels, some vertical interconnect structures 7 are used to form clock channels, and some vertical interconnect structures 7 are used to form power / ground channels, etc.

[0058] For example, the vertical interconnect structure 7 may be one or more of the following: through-silicon via, copper pillar, microbump interconnect, hybrid bonding via, redistribution layer bridging, and silicon interposer bridging pathway, and its cross-section may be cylindrical, square, or waist-shaped to adapt to different chip pitches and interconnect densities.

[0059] Understandably, when there are multiple storage bare dies 3, each storage bare die 3 is provided with the vertical interconnect structure 7, and the multiple storage bare dies 3 are electrically connected through the vertical interconnect structure 7.

[0060] In this embodiment, a high-speed electrical path is established between multiple bare dies along the stacking direction through the vertical interconnect structure 7, which shortens the signal transmission distance, reduces transmission delay and signal loss, improves the transmission bandwidth of data, address commands and clock signals, improves signal integrity, realizes reliable and stable electrical interconnection between buffer bare die 2, multi-layer storage bare die 3 and logic bare die 4, and improves the integration of three-dimensional stacked chips.

[0061] Furthermore, the vertical thermal conductive structure 8 is disposed within the memory die 3 and spaced apart from the vertical interconnect structure 7. More specifically, the vertical thermal conductive structure 8 is isolated from the surrounding vertical interconnect structure 7 by an insulating medium. The vertical thermal conductive structure 8 extends along the thickness direction of the packaging substrate 1, and one end of the vertical thermal conductive structure 8 in the extension direction contacts the logic die 4.

[0062] Understandably, the vertical heat conduction structure 8 is a heat conduction bypass located inside the memory die 3. Specifically, along the stacking direction, the vertical heat conduction structure 8 can be aligned with the non-sensitive area of ​​the logic die 4, so that the heat of the logic die 4 can diffuse along the vertical heat conduction structure 8, achieving an auxiliary diffusion function. The main heat dissipation path of the logic die 4 is preferentially led out from the side furthest from the memory die 3.

[0063] For example, the vertical heat-conducting structure 8 can be one or more of the following: heat-conducting pillars, thermally conductive insulating filler pillars, metal-filled holes, dummy through-holes, thermally conductive redistribution structures, metal-filled walls, and thermally conductive frames. Its materials may include copper, tungsten, aluminum, graphitized carbon materials, thermally conductive ceramics, or insulating composite materials containing thermally conductive particles. Its structural form can be a single continuous pillar, an array of multiple pillars, or a local annular thermal channel. Its thickness length can extend through the entire layer thickness or a portion of the bare core 3, while the lateral spacing is limited to not affecting the wiring and bonding of adjacent electrical interconnects. Alternatively, in some possible embodiments, some of the above-described vertical interconnect structures 7 can be reused as vertical heat-conducting structures 8. For example, the power / ground channel formed by the vertical interconnect structure 7 can be reused as a vertical heat-conducting channel.

[0064] Exemplarily, one end of the vertical thermally conductive structure 8 that contacts the logic bare die 4 can be thermally coupled to the logic bare die 4 through a thermally conductive adhesive layer, a metal bonding layer, or a direct contact interface, while the other end can extend to a heat dissipation path close to the package substrate 1. For example, in some possible embodiments, one end of the vertical thermally conductive structure 8 extending in the direction of extension contacts the logic bare die 4, and the other end contacts the buffer bare die 2, or the package substrate 1. Exemplarily, the other end of the vertical thermally conductive structure 8 that contacts the buffer bare die 2 or the package substrate 1 can also be thermally coupled through a thermally conductive adhesive layer, a metal bonding layer, or a direct contact interface.

[0065] In this embodiment, the heat generated by the logic die 4 and the local heat passing through the storage die 3 can be quickly transferred and dispersed through the vertical heat conduction structure 8, reducing the heat retention inside the storage die 3 and the interconnect neighborhood, thereby reducing the impact of local temperature rise on storage retention characteristics, interconnect resistance stability and stack reliability.

[0066] Furthermore, in some embodiments, such as Figure 3 As shown, the storage die 3 includes at least one active array region 31 and a passive region 32. The active array region 31 includes multiple storage cells arranged in an array. The aforementioned vertical heat conduction structure 8 can be disposed in the passive region 32.

[0067] Understandably, the active array area 31 is the array functional area in the storage die 3 that undertakes data storage, read / write, and retention functions. Multiple storage cells can be arranged in a matrix array, stripe array, or partitioned array configuration. The number of active array areas 31 in each storage cell can be adjusted adaptively according to requirements, and is usually set to multiple.

[0068] Specifically, the passive region 32 is a non-array functional area that is adjacent to or separated from the storage cell array. It can be located at the outer edge of the array, between array partitions, in the process reserve area, or in the redundancy area.

[0069] In this embodiment, the vertical heat-conducting structure 8 is disposed within the passive region 32 and avoids the active array region 31. Heat is prevented from traversing the sensitive read / write paths of the memory cells, reducing the impact of the heat from the logic die 4 on the active array region 31. Because the heat path avoids the densely distributed area of ​​the memory cells, the local temperature rise, leakage current fluctuations, and hold-time degradation of the memory cells are limited, thereby keeping read / write stability, array consistency, and device reliability within a controllable range and ensuring the operational stability of the memory cells.

[0070] For example, the storage die 3 may also include row and column decoding circuits, sensing amplifiers, local input / output circuits, etc.

[0071] Furthermore, in some embodiments, along the thickness direction of the packaging substrate 1, the projected area of ​​the buffer die 2 on the packaging substrate 1 is greater than or equal to the projected area of ​​the storage die 3 on the packaging substrate 1. In this embodiment, since the buffer die 2 has a projected coverage area not less than that of the storage die 3, a larger signal fan-out area and heat diffusion contact area can be formed on it, thereby reducing signal path congestion and improving the impact of local heat accumulation on the storage die 3.

[0072] In some embodiments, such as Figure 2 As shown, along the thickness direction of the packaging substrate 1, the projected area of ​​the buffer core 2 on the packaging substrate 1 is larger than the projected area of ​​the storage core 3 on the packaging substrate 1. This area relationship allows the buffer core 2 to cover all or most of the projected area of ​​the storage core 3, and form a usable arrangement area around it.

[0073] Specifically, the buffer bare die 2 includes a buffer main board 21, a buffer control unit, and a buffer auxiliary unit, which are disposed on the buffer main board 21. The buffer control unit is electrically connected to the packaging substrate 1, the storage bare die 3, and the logic bare die 4. The buffer control unit is used to shape and connect the electrical signals between the storage bare die 3 and the logic bare die 4.

[0074] Along the thickness direction of the packaging substrate 1, the projected area of ​​the buffer main board 21 on the packaging substrate 1 is larger than the projected area of ​​the bare memory die 3 on the packaging substrate 1. The buffer main board 21 includes a main body portion 211 and an edge portion 212, with the edge portion 212 extending circumferentially around the main body portion 211. Along the thickness direction of the packaging substrate 1, the main body portion 211 is disposed opposite to the bare memory die 3. The edge portion 212 is located on the outer periphery of the bare memory die 3. A buffer control unit is disposed in the main body portion 211, and a buffer auxiliary unit is disposed in the edge portion 212.

[0075] In this application, the buffer motherboard 21 is a chip substrate that carries the buffer control unit and the buffer auxiliary unit. The main body 211 corresponds to the alignment area of ​​the storage bare die 3, and the edge part 212 surrounds the main body 211 and extends outward to form a surrounding arrangement space. The buffer control unit is disposed in the main body 211 and may include signal buffering circuits, interface conversion circuits, or relay circuits, etc.; the buffer auxiliary unit is disposed in the edge part 212 and may include temperature sensors, power management auxiliary circuits, electrostatic protection structures, test pads, heat-conducting components, or redistribution fan-out structures, etc.

[0076] In one possible embodiment, the main body 211 may be a rectangular, rounded rectangle or a near-circular chip area, and the edge 212 may be a continuous ring around the perimeter, a locally widened border or an asymmetrical extension area. The material may be a silicon substrate, an insulating layer and a metal interconnect layer.

[0077] The projected area of ​​the buffer motherboard 21 is larger than that of the bare memory die 3, allowing the edge portion 212 to have a routing margin around the outer periphery of the bare memory die 3. The area difference can be determined based on wiring density, heat dissipation requirements, and package size. Typically, auxiliary functional units and core control units can be arranged in separate zones. The main body 211 maintains a short electrical connection path with the bare memory die 3, while the edge portion 212 is used to arrange peripheral circuits and test / heat dissipation units, etc. Since the main body 211 is positioned opposite to the bare memory die 3, the critical interconnect path is shortened. The edge portion 212 is located on the outer periphery of the bare memory die 3 and provides additional wiring and functional isolation space, thereby reducing signal detours and coupling interference. This allows control and auxiliary functions to operate collaboratively on the same buffer motherboard 21 and maintains the interconnect stability, thermal management consistency, and package integration of the stacked structure.

[0078] More specifically, in some embodiments, the buffer control unit includes a first interface unit, a second interface unit, a signal retiming unit, a clock distribution unit, a power / ground distribution unit, a test access unit, and a temperature detection unit.

[0079] The first interface unit is disposed on the second surface 12 of the packaging substrate 1 and is electrically connected to the packaging substrate 1. This first interface unit is used to receive external command signals, address signals, data signals, clock signals, power signals, and ground signals from the packaging substrate. The second interface unit is disposed on the first surface 11 of the packaging substrate 1 and is electrically connected to the buffer die 2. The second interface unit is also electrically connected to the first interface unit. The second interface unit is used to convert or organize the electrical signals received by the first interface unit into internal signals suitable for vertical transmission, and transmit these signals to the storage die 3 and the logic die 4 through the vertical interconnect structure 7.

[0080] The signal retiming unit may include a latch, a delay compensation circuit, a low-swing transceiver, a de-skew circuit, or a clock data recovery auxiliary circuit. The signal retiming unit is used to compensate for the delay and jitter of the signal after passing through the multi-layer vertical interconnect structure 7.

[0081] The clock distribution unit is used to distribute external clocks or internal reference clocks to storage die 3 and logic die 4, and can perform clock gating based on temperature or operating mode.

[0082] The power / ground distribution unit is electrically connected to the first interface unit. The power / ground distribution unit is used to filter and regulate the power supply signal and ground signal transmitted from the first interface unit and to distribute the potential, and to distribute the appropriate voltage and reference ground potential to the storage bare die 3 and the logic bare die 4.

[0083] The test access unit receives external test commands and sends test stimulus signals to the storage die 3 and logic die 4 through internal channels. At the same time, it collects the operation feedback signals of each die to realize fault diagnosis, parameter verification and reliability testing in the stacked state, which facilitates chip factory inspection and subsequent fault investigation.

[0084] The temperature detection unit monitors the temperature data of buffer die 2, storage die 3, and logic die 4 in real time, and can feed the temperature information back to the clock distribution unit and the power / ground distribution unit. Alternatively, the temperature information can be fed back to logic die 4 or an external controller.

[0085] Optionally, the buffer control unit may also include a low-power configuration register. This register receives external configuration commands and stores parameter configurations corresponding to different operating modes. The low-power configuration register can send configuration parameters to the clock distribution unit and the power / ground distribution unit respectively, reducing the clock frequency or cutting off power to some branches during idle periods to dynamically manage the power consumption of the storage die 3 and logic die 4. Simultaneously, it adaptively adjusts the power consumption strategy based on the temperature measurement results from the temperature detection unit, reducing overall power consumption while ensuring normal chip operation, further optimizing the energy efficiency of the 3D stacked chip.

[0086] Furthermore, the buffer auxiliary unit includes at least one temperature sensor. The at least one temperature sensor is electrically connected to the buffer control unit to enable electrical signal transmission with the logic die 4 and the external controller. The temperature sensor is used to collect and store local temperature information of at least one of the die 3, the buffer die 2, and the packaging substrate 1, and feeds the temperature information back to the logic die 4 or the external controller via the buffer control unit. The logic die 4 or the external controller is configured to generate power consumption or heat dissipation control commands based on the temperature information.

[0087] Specifically, the at least one temperature sensor is electrically connected to the temperature detection unit. The temperature sensor transmits the collected temperature information to the temperature detection unit, which then transmits it to the logic bare die 4 or an external controller.

[0088] For example, the temperature sensor can be a diode, a thermistor, or an on-chip temperature sensing device, positioned near the bottom of the storage die 3, near the vertical heat-conducting structure 8, or near the power supply hotspot of the package substrate 1. The temperature information collected by the temperature sensor is forwarded to the logic die 4 or an external controller via a buffer control unit. The external controller can then adjust the power supply rail voltage, frequency, or heat dissipation strategy accordingly, or use it to trigger frequency reduction, refresh parameter adjustment, data channel current limiting, etc.

[0089] In some embodiments, the buffer auxiliary unit further includes a power management auxiliary circuit, an electrostatic protection structure, test pads, a heat-conducting component, and a redistribution fan-out structure, wherein the power management auxiliary circuit, the electrostatic protection structure, the test pads, and the redistribution fan-out structure are electrically connected to the buffer control unit.

[0090] The power management auxiliary circuit can be electrically connected to the aforementioned power / ground distribution unit to assist in voltage filtering, current limiting, branch power supply monitoring, and power anomaly protection. The electrostatic discharge (ESD) protection structure can be installed on various signal and power supply paths of the buffer bare core 2 and electrically connected to the aforementioned first and second interface units. It provides ESD protection for externally accessed and inter-layer transmitted electrical signals and power / ground signals, quickly absorbing transient ESD pulses and high-voltage surges in the path. The test pads can be electrically connected to the test access unit to receive external test excitation signals and power supply test signals.

[0091] The heat-conducting component can be a metal heat diffusion layer, a heat-conducting pillar, or a high thermal conductivity filler, etc., preferably a heat-conducting pillar.

[0092] The redistribution fan-out structure can be a multi-layer metal redistribution network, fan-out conductors, or cross-layer interconnection channels. The redistribution fan-out structure can be electrically connected to the first interface unit and the second interface unit of the buffer control unit to realize the line fan-out and wiring adaptation between the pin 1 of the package substrate, the TSV via, and the various functional units of the buffer control unit.

[0093] In this embodiment, the temperature sensor collects the local temperature rise in the stacking path in real time and uploads it through the buffer control unit. This enables the logic bare die 4 or the external controller to generate control commands such as frequency reduction, current limiting, starting and stopping local units, or enhancing heat dissipation based on the temperature distribution. At the same time, the power management auxiliary circuit corrects the power supply stability, the electrostatic protection structure suppresses transient overvoltage, and the heat-conducting component diffuses the hot spot heat outward. Thus, signal relay, temperature monitoring, and auxiliary management are executed collaboratively within the same buffer bare die 2.

[0094] Understandably, the buffer bare die 2 in this application is not the high-power logic bare die 4 that undertakes the main computing tasks, but is set as a low-power signal and power auxiliary layer.

[0095] Furthermore, the logic die 4 may include a processor core, an AI acceleration unit, a near-memory computing unit, a data scheduling unit, memory access control logic, an on-chip network interface, or other high-power logic. The surface of the logic die 4 furthest from the memory die 3 forms a low thermal resistance contact through the aforementioned thermally conductive layer 5 and heat dissipation element 6. The majority of the heat generated by the logic die 4 is preferentially transferred to the thermally conductive layer 5 and heat dissipation element 6; a small amount of heat can be transferred by the aforementioned vertical heat conduction structure 8 and dissipated after passing through multiple memory dies 3.

[0096] In a preferred embodiment, a high-speed memory access interface is provided on the side of the logic die 4 facing the memory die 3. This high-speed memory access interface is electrically connected to the memory die 3 via a vertical interconnect structure 7. The logic die 4 is also electrically connected to the buffer die 2 via a portion of the vertical interconnect structure 7 passing through the memory die 3. Thus, external commands, configurations, tests, and some data can enter the buffer die 2 via the packaging substrate 1, and then be processed by the buffer die 2 before being transmitted to the logic die 4. High-bandwidth access from the logic die 4 to the memory die 3 can be accomplished through the high-speed memory access interface with a shorter top-side or vertical interconnect path.

[0097] The operation of the three-dimensional stacked chip in this application is as follows: When the chip is working, the external controller provides electrical signals such as power, ground, clock, command, address, and data to the packaging substrate 1 through the packaged solder balls or packaged pins. The packaging substrate 1 transmits the above electrical signals to the buffer die 2. After the buffer die 2 performs level adaptation, retiming, buffering, de-skewing, and protocol adaptation on the electrical signals, it sends them to the storage die 3 and logic die 4 along the vertical interconnect structure 7. The logic die 4 executes control or calculation programs according to the received commands and accesses the storage die 3 in a high-bandwidth manner, ultimately generating storage read data or calculation results. The logic die 4 returns the storage read data or calculation results to the packaging substrate 1 through the vertical interconnect structure 7 and the buffer die 2, and then outputs them to the external controller.

[0098] In the three-dimensional stacked chip of this application, the buffer die 2 undertakes low-power, low-heat-density signal shaping and interconnect relay tasks, rather than undertaking the main computing tasks. High-power computing tasks are concentrated in the logic die 4, and heat is dissipated through the heat dissipation path of the logic die 4 away from the storage die 3. Because the buffer die 2 has low power consumption, even if its heat needs to be transferred through the storage die 3, it will not cause localized heating of the storage die 3.

[0099] The three-dimensional stacked chip of this application introduces a low-power buffer die 2 between the packaging substrate 1 and the memory die 3, and places the high-power logic die 4 on the side of the memory die 3 away from the packaging substrate 1. By separating the high-power logic function from the low-power buffer function, the heat dissipation path of the high-power logic die 4 is mainly concentrated on the side away from the memory die 3, reducing the proportion of heat passing through the memory die 3 and improving heat dissipation performance. At the same time, it solves the problem of electrical signal relay on the packaging substrate 1 side, so that the logic die 4, even after being moved away from the packaging substrate 1, still maintains a high-speed, low-latency, and testable signal path with the packaging substrate 1.

[0100] Furthermore, since the buffer die 2 only undertakes low-power buffering and switching functions, its heat will not affect the operation of the storage die 3. Therefore, the three-dimensional stacked chip of this application, while taking into account signal transmission, power integrity and heat dissipation path, enables the storage die 3 to operate in a more uniform and lower temperature environment, thus ensuring the reliability of the operation of the storage die 3.

[0101] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope.

Claims

1. A three-dimensional stacked chip, characterized by, The package includes a packaging substrate (1), a buffer die (2), at least one storage die (3), and a logic die (4); the packaging substrate (1) includes a first surface (11) located on one side of the thickness direction; along the thickness direction of the packaging substrate (1), the buffer die (2), the at least one storage die (3), and the logic die (4) are stacked sequentially on the first surface (11). The packaging substrate (1) is used for electrical connection with an external controller; the buffer die (2) is electrically connected to the packaging substrate (1), the at least one storage die (3), and the logic die (4); the buffer die (2) is used for shaping and connecting the electrical signals between the logic die (4) and the storage die (3); the storage die (3) is used for storing data information; the logic die (4) is used for running control or calculation programs and accessing the data information in the storage die (3) to generate storage read data or calculation results, and the logic die (4) can transmit the obtained storage read data or calculation results back to the packaging substrate (1) via the buffer die (2).

2. The three-dimensional stacked chip of claim 1, wherein, The power consumption density or thermal density of the buffer bare die (2) is less than that of the logic bare die (4).

3. The three-dimensional stacked chip of claim 1, wherein, The three-dimensional stacked chip includes a thermally conductive dielectric layer (5); along the thickness direction of the packaging substrate (1), the thermally conductive dielectric layer (5) is attached to the surface of the logic die (4) away from the storage die (3).

4. The three-dimensional stacked chip of claim 3, wherein, The three-dimensional stacked chip includes a heat dissipation element (6); along the thickness direction of the packaging substrate (1), the heat dissipation element (6) is located on the side of the logic die (4) away from the storage die (3), and the thermally conductive medium layer (5) is located between the heat dissipation element (6) and the logic die (4).

5. The three-dimensional stacked chip of claim 1, wherein, The three-dimensional stacked chip includes a vertical interconnect structure (7) and a vertical heat conduction structure (8). Along the thickness direction of the packaging substrate (1), the vertical interconnect structure (7) penetrates the memory die (3) and electrically connects the memory die (3) to the buffer die (2) and the logic die (4); The vertical heat-conducting structure (8) is disposed within the storage die (3) and spaced apart from the vertical interconnect structure (7); the vertical heat-conducting structure (8) extends along the thickness direction of the packaging substrate (1), and one end of the vertical heat-conducting structure (8) extends into contact with the logic die (4).

6. The three-dimensional stacked chip of claim 5, wherein, The storage die (3) includes at least one active array region (31) and a passive region (32). The active array region (31) includes multiple storage cells arranged in an array. The vertical heat conduction structure (8) is disposed in the passive region (32).

7. The three-dimensional stacked chip of any one of claims 1-6, wherein, Along the thickness direction of the packaging substrate (1), the projected area of ​​the buffer core (2) on the packaging substrate (1) is greater than or equal to the projected area of ​​the storage core (3) on the packaging substrate (1).

8. The three-dimensional stacked chip of claim 7, wherein, The buffer die (2) includes a buffer control unit and a buffer auxiliary unit; the buffer control unit is electrically connected to the packaging substrate (1), the storage die (3), and the logic die (4); the buffer auxiliary unit includes at least one temperature sensor; the at least one temperature sensor is electrically connected to the buffer control unit; the temperature sensor is used to collect local temperature information of the storage die (3) and / or the buffer die (2) and / or the packaging substrate (1), and feeds back the temperature information to the logic die (4) or the external controller through the buffer control unit; the logic die (4) or the external controller is configured to generate power consumption or heat dissipation control commands based on the temperature information.

9. The three-dimensional stacked chip of claim 8, wherein, The buffer auxiliary unit includes a power management auxiliary circuit, an electrostatic protection structure, a test pad, a heat-conducting component, and a redistribution fan-out structure. The power management auxiliary circuit, the electrostatic protection structure, the test pad, and the redistribution fan-out structure are electrically connected to the buffer control unit.

10. The three-dimensional stacked chip of claim 8, wherein, The buffer bare core (2) includes a buffer main board (21); along the thickness direction of the packaging substrate (1), the positive projection area of ​​the buffer main board (21) on the packaging substrate (1) is greater than the positive projection area of ​​the storage bare core (3) on the packaging substrate (1). The buffer motherboard (21) includes a main body (211) and an edge portion (212), the edge portion (212) extending circumferentially around the main body (211); along the thickness direction of the packaging substrate (1), the main body (211) is disposed opposite to the storage die (3); the edge portion (212) is located on the outer periphery of the storage die (3); The buffer control unit is disposed on the main body (211), and the buffer auxiliary unit is disposed on the edge (212).