High-bandwidth DRAM memory with wide prefetch

Abstract

To provide a technique for wide prefetch (WP) in a DRAM memory for using high bandwidth.SOLUTION: A memory circuit of an electronic device 10 includes: an array block 11 of memory tiles coupled to a silicon substrate; a first set of global amplifiers 12 that are coupled to the silicon substrate and the memory tiles, and are arranged along a first side surface of the array block; a first set of write drivers that are coupled to the silicon substrate and the memory tiles, and are arranged along the first side surface of the array block; a second set of global amplifiers 14 that are coupled to the silicon substrate and the memory tiles, and are arranged along a second side surface of the array block opposite to the first side surface of the array block; and a second set of write drivers 15 that are coupled to the silicon substrate and the memory tiles, and are arranged along the second side surface of the array block.SELECTED DRAWING: Figure 1

Description

[Background technology]

[0001] High Bandwidth Memory (HBM) Dynamic Random Access Memory (DRAM) interface standards have been published by JEDEC (www.jedec.org). Updates to these standards include HBM2 and HMB2E. HBM technology offers higher bandwidth with lower power consumption compared to some other memory technologies. HBM technology can include a memory die stack and a much wider memory bus compared to some other memory technologies. [Brief description of the drawings]

[0002] The materials described herein are shown by way of example and not limitation in the accompanying drawings. For simplicity and clarity of illustration, elements shown in the figures are not necessarily drawn to scale. For example, dimensions of some elements may be exaggerated relative to other elements for clarity. Furthermore, where considered appropriate, reference numerals have been repeated among the figures to indicate corresponding or similar elements. The drawings are as follows: [Figure 1] 1 is a block diagram of an example memory device according to an embodiment. [Diagram 2] FIG. 2 is a block diagram of an example electronic device according to an embodiment. [Figure 3A] FIG. 2 is a block diagram of an example array block according to an embodiment. [Figure 3B] FIG. 2 is a more detailed block diagram of an example of a memory tile from an array block according to an embodiment. [Figure 4] FIG. 2 is a block diagram of an example wide prefetch memory device according to an embodiment. [Figure 5A] FIG. 2 is a front view of an example of an electronic device according to an embodiment. [Figure 5B] FIG. 2 is a top view block diagram of an example electronic device according to an embodiment. [Figure 6] FIG. 1 is an example block diagram of a computing system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0003] One or more embodiments or implementations are described herein with reference to the accompanying drawings. Although specific configurations and arrangements are discussed, it should be understood that this is done for illustrative purposes only. Those skilled in the art will recognize that other configurations and arrangements can be used without departing from the spirit and scope of the present specification. Those skilled in the art will recognize that the techniques and / or arrangements described herein can also be used in various other systems and applications other than those described herein.

[0004] Although the following description describes various implementations that may be manifested in architectures such as, for example, system-on-chip (SoC) architectures, implementations of the techniques and / or arrangements described herein are not limited to a particular architecture and / or computing system, but may be implemented by any architecture and / or computing system of similar purpose. For example, various architectures using, for example, multiple integrated circuit (IC) chips and / or packages and / or various computing devices and / or consumer electronics (CE) devices such as set-top boxes, smartphones, etc. may implement the techniques and / or arrangements described herein. Furthermore, although the following description may set forth numerous specific details, such as, for example, logic implementations, types and interrelationships of system components, logic partitioning / integration choices, etc., the claimed subject matter may be practiced without such specific details. In other instances, some material, such as, for example, control structures and complete software instruction sequences, may not be shown in detail so as not to obscure the material disclosed herein.

[0005] The materials disclosed herein may be implemented in hardware, firmware, software, or any combination thereof. The materials disclosed herein may also be implemented as instructions stored in a machine-readable medium that can be read and executed by one or more processors. A machine-readable medium may include any medium and / or mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing device). For example, a machine-readable medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium, an optical storage medium, a flash memory device, an electrical, optical, acoustic, or other form of propagated signal (e.g., carrier wave, infrared signal, digital signal, etc.), and others.

[0006] References herein to "one implementation," "implementation," "exemplary implementation," and the like indicate that the implementation being described may include a particular feature, structure, or characteristic, but all embodiments may not necessarily include such a particular feature, structure, or characteristic. Moreover, such phrases do not necessarily refer to the same implementation. Furthermore, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is stated that it is within the knowledge of one of ordinary skill in the art to effect such feature, structure, or characteristic in connection with other implementations, whether or not explicitly described herein.

[0007] Methods, devices, systems and articles are described herein in the context of storage systems. More specifically, some embodiments relate to an improved dynamic single level cell memory controller.

[0008] Various embodiments described herein may include memory components and / or interfaces for memory components. Such memory components may include volatile memory and / or non-volatile (NV) memory. Volatile memory may be a storage medium that requires power to maintain the state of the data it stores. Non-limiting examples of volatile memory may include various types of RAM, such as DRAM or static RAM (SRAM). One particular type of DRAM that may be used in a memory module is synchronous dynamic RAM (SDRAM). In particular embodiments, the DRAM of the memory component may conform to standards promulgated by the Joint Electron Device Engineering Council (JEDEC), such as JESD79F for Double Data Rate (DDR) SDRAM, JESD79-2F for DDR2 SDRAM, JESD79-3F for DDR3 SDRAM, JESD79-4A for DDR4 SDRAM, JESD209 for Low Power DDR (LPDDR), JESD209-2 for LPDDR2, JESD209-3 for LPDDR3, and JESD209-4 for LPDDR4 (which standards are available at jedec.org). Such standards (and similar standards) may be referred to as DDR-based standards, and communication interfaces of storage devices that implement such standards may be referred to as DDR-based interfaces.

[0009] NV memory (NVM) may be a storage medium that does not require power to maintain the state of the data it stores. In one embodiment, the memory device may include a block addressable memory device, such as one based on NAND or NOR technology. The memory device may also include future generation non-volatile devices, such as three-dimensional (3D) cross-point memory devices or other byte addressable write-in-place non-volatile memory devices. In one embodiment, the memory device may be or include a chalcogenide glass based memory device, a multi-threshold level NAND flash memory, a NOR flash memory, a single-level or multi-level phase change memory (PCM), a resistive memory, a nanowire memory, a ferroelectric transistor RAM (FeTRAM), an antiferroelectric memory, a magnetoresistive RAM (MRAM) memory integrating memristor technology, a resistive memory including metal oxide based, oxygen vacancy based and conductive bridge RAM (CB-RAM), or a spin-transfer torque (STT)-MRAM, a spintronics magnetic junction memory based device, a magnetic tunneling junction (MTJ) based device, a domain wall (DW) and a spin orbit transfer (SOT) based device, a thyristor based memory device, or any combination of the above or other memories. The memory device may refer to the die itself and / or the packaged memory product. In particular embodiments, memory components having non-volatile memory may comply with one or more standards promulgated by JEDEC, such as JESD218, JESD219, JESD220-1, JESD223B, JESD223-1, or other suitable standards (JEDEC standards cited herein are available at jedec.org).

[0010] 1, an embodiment of a memory device 10 may include an array block 11 of memory tiles, a first set of global amplifiers 12 coupled to the memory tiles of the array block 11 and disposed along a first side 11a of the array block 11, and a second set of global amplifiers 14 coupled to the memory tiles of the array block 11 and disposed along a second side 11c of the array block 11 opposite the first side 11a of the array block 11. Some embodiments of the device 10 may further include a first set of write drivers 13 coupled to the memory tiles of the array block 11 and disposed along the first side 11a of the array block 11, and a second set of write drivers 15 coupled to the memory tiles of the array block 11 and disposed along the second side 11c of the array block 11. For example, the array block 11 may have an overall rectangular shape with four nominal sides 11a, 11b, 11c, and 11d. The overall rectangular shape corresponds to the outline of the memory tiles of the array block having a row and column arrangement aligned in two nominal directions (e.g., sometimes referred to as row and column, x and y, slice and tile, etc.) that are perpendicular to each other. Any orientation (top, bottom, row, column, etc.) or order (first, second, etc.) described herein is nominal and depends on the particular memory implementation and memory orientation. For example, in another embodiment, a first set of global amplifiers 12 and write driver 13 may be disposed along side 11c, and an opposing second set of global amplifiers 14 and write driver 15 may be disposed along side 11a. In another non-limiting exemplary embodiment, global amplifiers 12 and write driver 13 may be disposed along side 11d, and opposing global amplifiers 14 and write driver 15 may be disposed along side 11b.

[0011] In some embodiments, memory device 10 further includes a first set of global input / output (IO) signals GIO1 arranged from the memory tiles along a second side 11c of array block 11 to a first set of global amplifiers 12, and a second set of global IO signals GIO2 arranged from the memory tiles along a first side 11a of array block 11 to a second set of global amplifiers 14. For example, a first subset of the first set of global IO signals may be coupled to a first memory tile of array block 11 and a first subset of the first set of global amplifiers 12, respectively, and a first subset of the second set of global IO signals may be coupled to a first memory tile of array block 11 and a first subset of the second set of global amplifiers 14, respectively (e.g., as described in further detail herein). In some embodiments, the array block 11 may include a matrix of M rows and N columns arranged in a general rectangular shape (e.g., where M>1 and N>1), with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction. The array block 11 provides a large page size (e.g., a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte). For example, the first set of global IO signals and the second set of global IO signals may provide a wide prefetch (e.g., a combined prefetch size W bits, where the ratio of P to W is less than or equal to 8 to 1). In any of the embodiments herein, the memory tiles may comprise a random access memory, such as a dynamic random access memory.

[0012] Each of the above-described embodiments of the array block 11, global amplifiers 12, 14, write drivers 13, 15, global IO, and other system components may be implemented in any suitable memory technology, including hardware, software, or any suitable combination thereof. For example, a hardware implementation may include configurable logic, such as a programmable logic array (PLA), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), or fixed function logic hardware, using, for example, an application specific integrated circuit (ASIC), a circuit technology such as complementary metal oxide semiconductor (CMOS) or transistor-transistor logic (TTL) technology, or any combination thereof.

[0013] In some embodiments, the memory component may be located within or co-located with various other components, including the controller (e.g., on the same die). Suitable controller embodiments may include general purpose controllers, special purpose controllers, memory controllers, storage controllers, microcontrollers, general purpose processors, special purpose processors, central processing units (CPUs), execution units, and the like. Alternatively or additionally, all or portions of the controller may be implemented in one or more modules as set logic instructions stored in a machine-readable or computer-readable storage medium, such as a random access memory (RAM), a read-only memory (ROM), a programmable ROM (PROM), firmware, flash memory, and the like, for execution by a processor or computing device. For example, computer program code for carrying out operations of the components may be written in any combination of one or more operating system (OS) applicable / compatible programming languages, including object-oriented programming languages, such as PYTHON, PERL, JAVA, SMALLTALK, C++, C#, and the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.

[0014] Referring now to FIG. 2, an embodiment of an electronic device 20 may include a silicon substrate 21 and a memory circuit 22 coupled to the silicon substrate 21. The memory circuit 22 includes an array block of memory tiles, a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block, and a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block. In some embodiments, the memory circuit 22 also includes a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block, and a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block. The memory circuit 22 may further include a first set of global IO signals arranged on the array from the memory tiles to the first set of global amplifiers along the second side of the array block, and a second set of global IO signals arranged on the array from the memory tiles to the second set of global amplifiers along the first side of the array block. For example, the memory circuit 22 may further include a first subset of the first set of global IO signals respectively coupled to a first memory tile of the array block and a first subset of the first set of global amplifiers, and a first subset of the second set of global IO signals respectively coupled to the first memory tile of the array block and a first subset of the second set of global amplifiers.

[0015] In some embodiments, an array block may include an M by N matrix (e.g., M>1 and N>1) arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction. The array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte. For example, the first set of global IO signals and the second set of global IO signals may advantageously provide a combined wide prefetch size W bits. The ratio of P to W is less than or equal to 8 to 1. In any of the embodiments herein, the memory tiles may comprise random access memory, such as dynamic random access memory. In some memory devices, multiple embodiments of the apparatus 10 may be coupled together using multiple through silicon vias (TSVs), for example, as may be used in various HBM technologies. The silicon substrate 21, memory circuitry 22, and TSV embodiments may be fabricated using any suitable silicon / memory fabrication technology.

[0016] For example, electronic device 10 may be implemented on a semiconductor device including a silicon substrate 21 to which memory circuitry 22 is coupled. In some embodiments, memory circuitry 22 may be implemented at least partially in one or more of the memory components on silicon substrate 21. For example, memory circuitry 22 may include a transistor array and / or other integrated circuit components coupled to silicon substrate 21 having transistor channel regions located within silicon substrate 21. The interface between memory circuitry 22 and silicon substrate 21 may not be an abrupt junction. Memory circuitry 22 may also be considered to include an epitaxial layer grown on an initial wafer of silicon substrate 21.

[0017] Some embodiments may advantageously provide a technique for wide prefetch (WP) in DRAM memory for high bandwidth applications. In conventional DRAM IO architectures, the page size activated by row commands is large, e.g., 1 kilobyte (KB), 2KB, etc. However, the prefetch size that a user can provide to an IO driver for output is small, e.g., 64 bits (b), 128b, etc. (e.g., the P:W ratio of page size to prefetch size is 128:1). In conventional architectures, to increase memory bandwidth with higher frequencies or higher pin counts, the page size needs to be increased or multiple operations need to be performed internally. However, these approaches result in higher power consumption, longer access latency, etc.

[0018] In a conventional HBM2 DRAM IO architecture and array, after a ROW Activation command, 9Kb (1KB) of information (e.g., including a redundant 9th Error Code Correction (ECC) tile) is sensed and latched in the sense amplifier (SA) band. After a read / write command is issued with a column address, only 8b per tile can be transferred through the global IO lines from the sense amplifier (SA) to the global amplifier located after the last row of the array block. Typically, the global IO lines are located in the gap between the memory tiles. In traditional architectures, the global IO connection between the SA and the global amplifier / write driver is narrow (e.g., about 8b per tile). This structure can reduce the feasibility of utilizing higher memory bandwidth and reasonably lower power consumption in DRAM memory chips for some high performance computing (HPC) applications, such as artificial intelligence (AI) applications.

[0019] Another approach for higher bandwidth may include a high bandwidth low latency (HBLL) architecture, which may improve the P:W ratio from 128:1 to 16:1 (e.g., about 8x better). The HBLL architecture may increase the global IO bandwidth between the SA and the global amplifiers / write drivers. The HBLL architecture changes the column select line (CSL) decode method from vertical (e.g., column-based) to horizontal (e.g., row-based) and moves the global IO line routing from the gap area between memory tiles to the "on-array" area. These changes may result in a wider global IO connection (e.g., an 8x increase to 64b per tile).

[0020] As memory requirements become more demanding, it is desirable to further improve the P:W ratio. Advantageously, some embodiments provide techniques to further improve the P:W ratio for high bandwidth WP (HBWP) DRAM devices. In some embodiments of HBWP DRAM architectures, global amplifiers and write drivers may be placed at the nominal top and bottom of the array block (e.g., before the first slice and after the last slice of the memory tile matrix) on both sides of the routing double of the global IO lines on the array (e.g., 128b per tile for a page size of 1KB). Advantageously, some embodiments may increase the prefetch size by a factor of two and improve the P:W ratio to 8:1. For example, some embodiments may provide a prefetch size of 1Kb for a page size of 1KB. This corresponds to a 16x improvement from conventional DRAM architectures (e.g., HBM or HBM2) and a 2x improvement compared to HBLL architectures.

[0021] 3A-3B, an embodiment of an array block 30 may include a matrix of memory tiles 31 nominally arranged in slices 0 through 10 and tile numbers 0 through 8. When an SA is activated, a 9Kb page size corresponding to tile numbers 0 through 8 may be activated for the activated slice (e.g., SA 32 for slice 2 shown in FIG. 3A is activated by a main write driver (MWD) signal). As shown in FIGS. 3A and 3B, array block 30 includes double the global IO lines on the array. For example, each of tile numbers 0 through 9 may include 64 global IO lines GIO1 that go from slice 10 to slice 0 (and continue to a first set of global amplifiers / write drivers) and 64 global IO lines GIO2 that go from slice 0 to slice 10 (and continue to a second set of global amplifiers / write drivers), providing 128 global IO line pairs (e.g., 64 GIO1 lines + 64 GIO2 lines = 128 total global IO line pairs per tile). One skilled in the art will appreciate that the global IO lines GIO1 and GIO2 for the column of tile number 0 pass through each of slices / rows 0 through 10 and are connected to the appropriate memory tile when the SA for that slice is activated by the MWD signal. As used herein, "on the array" refers to the routing of global IO lines that correspond to the memory tiles. As shown in FIG. 3B, global IO lines may be routed on the top surface of the memory tiles, with 64 global IO lines routed up and 64 global IO lines routed down for each memory tile.

[0022] Any given manufacturing technology limits the number of global amplifiers / write drivers that can be placed along one side of an array block. For example, some manufacturing technologies may not be feasible to place 128 global amplifiers / write drivers on one side of an array block. However, those same manufacturing technologies may easily place double the amount of global IO lines on an array according to some embodiments. Advantageously, in some embodiments, placing global amplifiers / write drivers on opposite sides of an array block 30 (e.g., 64 sets on the top side in addition to 64 sets on the bottom side) with half of the global IO lines connected to the set on the bottom side of the array block 30 and the other half of the global IO lines connected to the set on the top side of the array block 30 doubles the effective number of global amplifiers / write drivers for the array block 30. While utilizing the space between array blocks for more global amplifiers / write drivers increases the size of the die, some offset is provided in more efficient memory access by better utilizing memory bandwidth from the provided WP.

[0023] In the illustrated example, for an array block with a page size of 9Kb (8Kb data + 1Kb ECC), the array block provides a total ECC prefetch size of 1024b plus 128b, with an ECC prefetch size of 512b + 64b for the first set of global amplifiers / write drivers, plus an ECC prefetch size of 512b + 64b for the second set of global amplifiers / write drivers. Advantageously, some embodiments double (2x) the prefetch size compared to HBLL architectures, improving the P:W ratio from 128:1 (e.g., HBM2) or 16:1 (e.g., HBLL) to 8:1. Advantageously, WP DRAM embodiments with larger prefetch sizes may result in even higher memory bandwidth while maintaining the same capacity and lower energy consumption (pJ / bit) in DRAM device technology. Those skilled in the art will appreciate that the 9 row by 11 column matrix shown in FIG. 3A is just one exemplary embodiment. Other embodiments may be readily adapted to other memory tile arrangements as may be appropriate for different memory vendors, different memory generations, different DRAM types such as DDR, LPDDR, GDDR, etc.

[0024] 4, an embodiment of a WP memory device 40 includes a substrate 41 having a plurality of WP memory blocks 42 coupled thereto. For example, substrate 41 may include a semiconductor substrate such as a silicon substrate. For example, each of the WP memory blocks 42 may be configured similarly to memory device 10 (FIG. 1) and / or memory circuit 22 (FIG. 2), and the array blocks may be configured similarly to array block 30 (see FIGS. 3A-3B). In some embodiments, the WP memory device 40 may include RAM, such as DRAM, TSVs, and may be configured as a WP DRAM die 40 suitable for stacking in an HBM memory device.

[0025] 5A-5B, an embodiment of an electronic device 50 may include an interposer 51, a processor 52 coupled to the interposer 51, and at least one WP memory stack device 53 coupled to the interposer 51 and communicatively coupled to the processor 52 through the interposer 51. The at least one WP memory stack device 53 may include a stack of dies including at least one logic die 54 and at least two WP memory dies 55. Inter-die connections for the memory die 55 and / or logic die 54 may be made, for example, with through silicon vias (TSVs) 56. The at least two WP memory dies 55 may each include multiple WP memory blocks (e.g., as described in connection with FIG. 4). In some embodiments, the device 50 may further include a package substrate 57 coupled to the interposer 51. For example, the package substrate 57 may include an SoC package or a printed circuit board, such as a graphics board, an HPC board, or the like.

[0026] According to some embodiments, the WP memory blocks of the WP memory die 55 may each include an array block having memory tiles arranged in a matrix along two perpendicular directions, a first set of global amplifiers coupled to the memory tiles and arranged along a first side of the matrix, and a second set of global amplifiers coupled to the memory tiles and arranged along a second side of the matrix opposite the first side of the matrix. In some embodiments, the WP memory blocks each further include a first set of write drivers coupled to the memory tiles and arranged along the first side of the matrix, and a second set of write drivers coupled to the memory tiles and arranged along the second side of the matrix. The WP memory blocks each may further include a first set of global IO signals arranged from the memory tiles to the first set of global amplifiers along the second side of the matrix, and a second set of global IO signals arranged from the memory tiles to the second set of global amplifiers along the first side of the matrix. For example, each WP memory block may also include a first subset of a first set of global IO signals respectively coupled to a first memory tile of the matrix and a first subset of a first set of global amplifiers, and a first subset of a second set of global IO signals respectively coupled to a first memory tile of the matrix and a first subset of a second set of global amplifiers.

[0027] In some embodiments, the matrix includes a 9-by-11 matrix arranged in a general rectangular shape with 9 rows of memory tiles arranged substantially linearly in a first direction and 11 columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, the matrix providing a page size of 1 kilobyte of data when activated by an access command. For example, the first set of global IO signals and the second set of global IO signals provide a combined prefetch size for the matrix having a data width of at least 1024 bits. In some embodiments, the memory tiles may include RAM such as DRAM, and the WP memory die 55 may be considered a WP DRAM 55 and the WP memory stack device 53 may be considered a WP DRAM stack 53.

[0028] The techniques discussed herein may be provided in a variety of computing systems, including non-mobile computing devices such as desktops, workstations, servers, rack systems, etc.; mobile computing devices such as smartphones, tablets, ultra-mobile personal computers (UMPCs), laptop computers, ultrabook computing devices, smart watches, smart glasses, smart bracelets, etc.; and / or client / edge devices such as Internet of Things (IoT) devices (e.g., sensors, cameras, etc.).

[0029] 6, an embodiment of a computing system 100 may include one or more processors 102-1 through 102-N (generally referred to herein as “processor 102” or “processor 102”). The processors 102 may communicate via an interconnect or bus 104. Each processor 102 may include various components, some of which are discussed only with reference to processor 102-1 for clarity. Thus, each of the remaining processors 102-2 through 102-N may include the same or similar components as those discussed with reference to processor 102-1.

[0030] In some embodiments, processor 102-1 may include one or more processor cores 106-1 through 106-M (referred to herein as “cores 106” or more generally as “cores 106”), a cache 108 (which may be a shared cache or a private cache in various embodiments), and / or a router 110. Processor core 106 may be implemented on a single integrated circuit (IC) chip. In addition, the chip may include one or more shared and / or private caches (such as cache 108), a bus or interconnect (such as bus or interconnect 112), a memory controller, or other components.

[0031] In some embodiments, router 110 may be used to communicate between processor 102-1 and / or various components of system 100. Additionally, processor 102-1 may include more than one router 110. Additionally, multiple routers 110 may communicate to enable data routing between various components internal or external to processor 102-1.

[0032] The cache 108 may store data (including, e.g., instructions) used by one or more components of the processor 102-1, such as the cores 106. For example, the cache 108 may locally cache data stored in the memory 114 for faster access by the components of the processor 102. As shown in FIG. 6, the memory 114 may communicate with the processor 102 via the interconnect 104. In some embodiments, the cache 108 (which may be shared) may have various levels. For example, the cache 108 may be a mid-level cache and / or a last-level cache (LLC). Additionally, each of the cores 106 may include a level 1 (L1) cache (116-1) (generally referred to herein as “L1 cache 116”). Various components of the processor 102-1 may communicate with the cache 108 directly, through a bus (e.g., the bus 112) and / or through a memory controller or hub.

[0033] 6, memory 114 may be coupled to other components of system 100 through memory controller 120. Memory 114 may include volatile memory and may interchangeably be referred to as main memory. Although memory controller 120 is shown as being coupled between interconnect 104 and memory 114, memory controller 120 may be located elsewhere in system 100. For example, in some embodiments, memory controller 120, or portions thereof, may be provided within one of processors 102.

[0034] System 100 may communicate with other devices / systems / networks via network interface 128 (e.g., communicating with a computer network and / or cloud 129 via a wired or wireless interface). For example, network interface 128 may include an antenna (not shown) for wireless communication with network / cloud 129 (e.g., via an Institute of Electrical and Electronics Engineers (IEEE 802.11 interface (including IEEE 802.11a / b / g / n / ac, etc.), a cellular interface, 3G, 4G, LTE, Bluetooth, etc.).

[0035] System 100 may also include a storage device, such as SSD device 130, coupled to interconnect 104 via SSD controller logic 125. Thus, logic 125 may control access to SSD device 130 by various components of system 100. Additionally, even though logic 125 is shown in FIG. 6 as being directly coupled to interconnect 104, logic 125 may alternatively communicate with one or more other components of system 100 via a storage bus / interconnect (e.g., a Serial Advanced Technology Attachment (SATA) bus, a Peripheral Component Interconnect (PCI) (or PCI EXPRESS (PCIe) interface), an NVM EXPRESS (NVMe), etc.) (e.g., where a storage bus is coupled to interconnect 104 via some other logic, such as a bus bridge, chipset, etc.). Additionally, in various embodiments, logic 125 may be incorporated into the memory controller logic or may be provided on the same integrated circuit (IC) device (e.g., on the same circuit board device as SSD device 130 or in the same enclosure as SSD device 130).

[0036] Additionally, logic 125 and / or SSD device 130 may be coupled to one or more sensors (not shown) to receive information (e.g., in the form of one or more bits or signals) indicating the status of or values ​​detected by the one or more sensors. These sensors may be located in proximity to components of system 100 (or other computing systems discussed herein), including cores 106, interconnects 104 or 112, components external to processor 102, SSD device 130, SSD bus, SATA bus, logic 125, etc., to sense changes in various factors that affect the power / thermal behavior of the system / platform, such as, for example, temperature, operating frequency, operating voltage, power consumption, and / or inter-core communication activity.

[0037] Advantageously, memory 114, or other memory communicatively coupled to processor 102, may include techniques to implement one or more aspects of apparatus 10 (FIG. 1), apparatus 20 (FIG. 2), array block 30 (FIG. 3A), memory tile 31 (FIG. 3B), device 40 (FIG. 4), or apparatus 50 (FIGS. 5A and 5B), and / or any of the features discussed herein. For example, memory 114 may include an embodiment of an HBM-compliant DRAM device with wide prefetching having one or more of the features discussed herein (e.g., double global IO routing, global amplifiers on opposing sides of an array block, etc.). [Additional notes and examples]

[0038] Example 1 includes an electronic device comprising a silicon substrate and a memory circuit coupled to the silicon substrate, the memory circuit having an array block of memory tiles coupled to the silicon substrate, a first set of global amplifiers coupled to the silicon substrate and the memory tiles and disposed along a first side of the array block, and a second set of global amplifiers coupled to the silicon substrate and the memory tiles and disposed along a second side of the array block opposite the first side of the array block.

[0039] Example 2 includes the apparatus of Example 1, wherein the memory circuit further includes a first set of global input / output signals coupled to the silicon substrate and arranged on the array from memory tiles along the second side of the array block to the first set of global amplifiers, and a second set of global input / output signals coupled to the silicon substrate and arranged on the array from memory tiles along the first side of the array block to the second set of global amplifiers.

[0040] Example 3 includes the apparatus of Example 2, wherein the memory circuit further comprises a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and a first subset of the first set of global amplifiers, and a first subset of the second set of global input / output signals respectively coupled to the first memory tile of the array block and a first subset of the second set of global amplifiers.

[0041] Example 4 includes the apparatus of any of Examples 2-3, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block, when activated by an access command, provides a page size P of data, where P is greater than or equal to 1 kilobyte.

[0042] Example 5 includes the apparatus of example 4, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1.

[0043] Example 6 includes the apparatus of any of Examples 1 to 5, further including a first set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the first side of the array block, and a second set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the second side of the array block.

[0044] Example 7 includes the apparatus of any of Examples 1-6, further comprising a plurality of through silicon vias configured to couple to another substrate.

[0045] Another example includes the apparatus of any of Examples 1 to 7, wherein the memory tile comprises a random access memory, such as a dynamic random access memory.

[0046] Example 8 includes a memory device comprising an array block of memory tiles, a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block, and a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block.

[0047] Example 9 includes the apparatus of Example 8, further comprising: a first set of global input / output signals arranged along the second side of the array block from memory tiles to the first set of global amplifiers; and a second set of global input / output signals arranged along the first side of the array block from memory tiles to the second set of global amplifiers.

[0048] Example 10 includes the apparatus of Example 9, further comprising: a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and a first subset of the first set of global amplifiers; and a first subset of the second set of global input / output signals respectively coupled to the first memory tile of the array block and a first subset of the second set of global amplifiers.

[0049] Example 11 includes the apparatus of any of Examples 9-10, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block, when activated by an access command, provides a page size P of data, where P is greater than or equal to 1 kilobyte.

[0050] Example 12 includes the apparatus of example 11, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1.

[0051] Example 13 includes the apparatus of any of Examples 8 to 12, further comprising a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block, and a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block.

[0052] Example 14 includes the apparatus of any of examples 8 to 13, wherein the memory tile comprises a random access memory, such as a dynamic random access memory.

[0053] Example 15 includes an electronic device comprising an interposer, a processor coupled to the interposer, and at least one wide prefetch memory stack device coupled to the interposer and communicatively coupled to the processor through the interposer, the at least one wide prefetch memory stack device having a die stack including at least one logic die and at least two wide prefetch memory dies, each of the at least two wide prefetch memory dies including a plurality of wide prefetch memory blocks, each of the wide prefetch memory blocks including an array block with memory tiles arranged in a matrix along two perpendicular directions, a first set of global amplifiers coupled to the memory tiles and arranged along a first side of the matrix, and a second set of global amplifiers coupled to the memory tiles and arranged along a second side of the matrix opposite the first side of the matrix.

[0054] Example 16 includes the apparatus of Example 15, wherein each of the wide prefetch memory blocks further includes a first set of global input / output signals arranged from memory tiles along the second side of the matrix to the first set of global amplifiers, and a second set of global input / output signals arranged from memory tiles along the first side of the matrix to the second set of global amplifiers.

[0055] Example 17 includes the apparatus of Example 16, wherein each of the wide prefetch memory blocks further includes a first subset of the first set of global input / output signals coupled to a first memory tile of the matrix and a first subset of the first set of global amplifiers, respectively, and a first subset of the second set of global input / output signals coupled to the first memory tile of the matrix and a first subset of the second set of global amplifiers, respectively.

[0056] Example 18 includes the apparatus of any of Examples 16-17, wherein the matrix includes a 9 row by 11 column matrix arranged in a general rectangular shape with 9 rows of memory tiles arranged substantially linearly in a first direction and 11 columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, the matrix providing a page size of 1 kilobyte of data when activated by an access command.

[0057] Example 19 includes the apparatus of Example 18, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size for the matrix having a data width of at least 1024 bits.

[0058] Example 20 includes the apparatus of any of Examples 15-19, wherein the wide prefetch memory blocks each further include a first set of write drivers coupled to the memory tiles and arranged along the first side of the matrix, and a second set of write drivers coupled to the memory tiles and arranged along the second side of the matrix.

[0059] Example 21 includes the apparatus of any of examples 15 to 20, wherein the memory tile comprises a dynamic random access memory.

[0060] Example 22 includes a method of increasing memory bandwidth comprising providing an array block of memory tiles; providing a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block; and providing a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block.

[0061] Example 23 includes the method of Example 22, further comprising providing a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block, and providing a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block.

[0062] Example 24 includes the method of Example 22, further comprising providing a first set of global input / output signals arranged along the second side of the array block from memory tiles to the first set of global amplifiers, and providing a second set of global input / output signals arranged along the first side of the array block from memory tiles to the second set of global amplifiers.

[0063] Example 25 includes the method of Example 24, further comprising providing a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and a first subset of the first set of global amplifiers, and providing a first subset of the second set of global input / output signals respectively coupled to the first memory tile of the array block and a first subset of the second set of global amplifiers.

[0064] Example 26 includes the method of any of Examples 24-25, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte.

[0065] Example 27 includes the method of example 26, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1.

[0066] Example 28 includes the method of any of examples 22-27, wherein the memory tile comprises a random access memory.

[0067] Example 29 includes the method of any of examples 22-28, wherein the memory tile comprises a dynamic random access memory.

[0068] Example 30 includes a memory device comprising: means for providing an array block of memory tiles; means for providing a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block; and means for providing a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block.

[0069] Example 31 includes the apparatus of Example 30, further comprising: means for providing a first set of write drivers coupled to the memory tiles and arranged along the first side of the array block; and means for providing a second set of write drivers coupled to the memory tiles and arranged along the second side of the array block.

[0070] Example 32 includes the apparatus of Example 30, further comprising: means for providing a first set of global input / output signals arranged along the second side of the array block from memory tiles to the first set of global amplifiers; and means for providing a second set of global input / output signals arranged along the first side of the array block from memory tiles to the second set of global amplifiers.

[0071] Example 33 includes the apparatus of Example 32, further comprising: means for providing a first subset of the first set of global input / output signals coupled respectively to a first memory tile of the array block and a first subset of the first set of global amplifiers; and means for providing a first subset of the second set of global input / output signals coupled respectively to the first memory tile of the array block and a first subset of the second set of global amplifiers.

[0072] Example 34 includes the apparatus of any of Examples 32-33, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block, when activated by an access command, provides a page size P of data, where P is greater than or equal to 1 kilobyte.

[0073] Example 35 includes the apparatus of Example 34, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1.

[0074] Example 36 includes the apparatus of any of examples 30 to 35, wherein the memory tile comprises a random access memory.

[0075] Example 37 includes the apparatus of any of examples 30 to 36, wherein the memory tile comprises dynamic random access memory.

[0076] The term "coupled" may be used herein to refer to any type of direct or indirect relationship between subject components and may apply to electrical, mechanical, fluid, optical, electromagnetic, electromechanical or other connections. In addition, terms such as "first," "second," etc. may be used herein for ease of description only and do not imply any particular temporal or temporal connotation unless otherwise stated.

[0077] As used in the present application and claims, a list of items joined by the term "one or more of" may refer to any combination of the listed terms. For example, the phrases "one or more of A, B, and C" and "one or more of A, B, or C" may both refer to A, B, C, A and B, A and C, B and C, or A, B, and C. Various components of the systems described herein may be implemented in software, firmware, and / or hardware, and / or any combination thereof. For example, various components of the systems or devices discussed herein may be provided, at least in part, by the hardware of a computing SoC, such as those that may be found in a computing system, such as a smartphone. Those skilled in the art may recognize that the systems described herein may include additional components not shown in the corresponding figures. For example, the systems discussed herein may include additional components, such as a bitstream multiplexer module or demultiplexer module, not shown for clarity.

[0078] Although implementations of the example processes discussed herein may include performance of all of the operations shown in the order illustrated, the disclosure is not limited in this respect and in various examples, implementations of the example processes herein may include only a subset of the operations shown, operations performed in an order different from those illustrated, or additional operations.

[0079] In addition, any one or more of the operations discussed herein may be performed in response to instructions provided by one or more computer program products. Such program products may include, for example, signal-bearing media providing instructions that may provide the functionality described herein when executed by a processor. A computer program product may be provided in one or more machine-readable media in any form. Thus, for example, a processor including one or more graphic processing units or processor cores may perform one or more of the blocks of the exemplary processes herein in response to program code and / or instructions or instruction sets being conveyed to the processor by one or more machine-readable media. In general, a machine-readable medium may convey software in the form of program code and / or instructions or instruction sets that may cause any of the devices and / or systems described herein to implement at least a portion of the operations discussed herein and / or any portion of the devices, systems, or any modules or components discussed herein.

[0080] As used in any implementation described herein, the term "module" refers to any combination of software logic, firmware logic, hardware logic, and / or circuitry configured to provide the functionality described herein. Software may be embodied as a software package, code, and / or instruction set or instructions, and "hardware" as used in any implementation described herein may include, for example, hardwired circuitry, programmable circuitry, state machine circuitry, fixed function circuitry, execution unit circuitry, and / or firmware that stores instructions executed by programmable circuitry, alone or in any combination. These modules may be embodied collectively or individually as circuitry that forms part of a larger system, such as, for example, an integrated circuit (IC) system on a chip (SoC).

[0081] Various embodiments may be implemented using a combination of hardware elements, software elements, or both. Examples of hardware elements may include processors, microprocessors, circuits, circuit elements (e.g., transistors, resistors, capacitors, and inductors, etc.), integrated circuits, application specific integrated circuits (ASICs), programmable logic devices (PLDs), digital signal processors (DSPs), field programmable gate arrays (FPGAs), logic gates, registers, semiconductor devices, chips, microchips, and chipsets, etc. Examples of software may include software components, programs, applications, computer programs, application programs, system programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions, methods, procedures, software interfaces, application program interfaces (APIs), instruction sets, computing code, computer code, code segments, computer code segments, words, values, symbols, or any combination thereof. The decision whether an embodiment is implemented using hardware and / or software elements may depend on any number of factors, such as desired computation rates, power levels, thermal tolerances, processing cycle budgets, input data rates, output data rates, memory resources, data bus speeds, and other design or performance constraints.

[0082] One or more aspects of at least one embodiment may be implemented by representative instructions stored on a machine-readable medium that represent various logic within a processor, which, when read by a machine, cause the machine to assemble logic to perform the techniques described herein. Such representations, known as IP cores, may be stored on tangible machine-readable media and supplied to various customers or manufacturing facilities for inclusion in manufacturing machines that actually produce the logic or processors.

[0083] While certain features described herein have been described with reference to various implementations, this description is not intended to be construed in a limiting sense. Thus, various modifications of the implementations described herein and other implementations that are apparent to those skilled in the art to which the disclosure pertains are deemed to be within the spirit and scope of the disclosure.

[0084] It will be recognized that these embodiments are not limited to the embodiments so described, but may be practiced with modification and alteration without departing from the scope of the appended claims. For example, the above-described embodiments may include a particular combination of features. However, the above-described embodiments are not limited in this respect, and in various implementations, the above-described embodiments may include implementing only a subset of such features, implementing such features in a different order, implementing such features in different combinations, and / or implementing additional features beyond those features explicitly recited. The scope of these embodiments should therefore be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. [Other possible items] [Item 1] A silicon substrate; a memory circuit coupled to the silicon substrate; Equipped with The memory circuit comprises: an array block of memory tiles coupled to the silicon substrate; a first set of global amplifiers coupled to the silicon substrate and the memory tiles and disposed along a first side of the array block; a second set of global amplifiers coupled to the silicon substrate and the memory tiles and disposed along a second side of the array block opposite the first side of the array block; having electronic equipment. [Item 2] The memory circuit comprises: a first set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the first side of the array block; a second set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the second side of the array block; Further comprising Item 1. The device according to item 1. [Item 3] The memory circuit comprises: a first set of global input / output signals coupled to the silicon substrate and disposed on the array from memory tiles along the second side of the array block to the first set of global amplifiers; a second set of global input / output signals coupled to the silicon substrate and disposed on the array from the memory tiles along the first side of the array block to the second set of global amplifiers; Further comprising Item 1. The device according to item 1. [Item 4] The memory circuit comprises: a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and to a first subset of the first set of global amplifiers; a first subset of the second set of global input / output signals respectively coupled to the first memory tile of the array block and to a first subset of the second set of global amplifiers; Further comprising Item 3. The apparatus according to item 3. [Item 5] 4. The apparatus of claim 3, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte. [Item 6] 6. The apparatus of claim 5, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1. [Item 7] A plurality of through silicon vias configured to couple to another substrate Item 1. The apparatus of item 1, further comprising: [Item 8] an array block of memory tiles; a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block; a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block; A memory device comprising: [Item 9] a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block; a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block; 9. The apparatus of claim 8, further comprising: [Item 10] a first set of global input / output signals disposed along the second side of the array block from memory tiles to the first set of global amplifiers; a second set of global input / output signals disposed along the first side of the array block from the memory tiles to the second set of global amplifiers; 9. The apparatus of item 8, further comprising: [Item 11] a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and to a first subset of the first set of global amplifiers; a first subset of the second set of global input / output signals respectively coupled to the first memory tile of the array block and to a first subset of the second set of global amplifiers; Item 11. The apparatus of item 10, further comprising: [Item 12] 11. The apparatus of claim 10, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte. [Item 13] Item 13. The apparatus of item 12, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, and a ratio of P to W is less than or equal to 8 to 1. [Item 14] 9. The apparatus of claim 8, wherein the memory tiles comprise dynamic random access memory. [Item 15] An interposer; a processor coupled to the interposer; at least one wide prefetch memory stack device coupled to the interposer and communicatively coupled to the processor through the interposer; Equipped with the at least one wide prefetch memory stack device has a die stack including at least one logic die and at least two wide prefetch memory dies; each of the at least two wide prefetch memory dies includes a plurality of wide prefetch memory blocks; Each of the wide prefetch memory blocks is an array block having memory tiles arranged in rows and columns along two perpendicular directions; a first set of global amplifiers coupled to the memory tiles and arranged along a first side of the matrix; a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the matrix opposite the first side of the matrix; Including, electronic equipment. [Item 16] Each of the wide prefetch memory blocks is a first set of global input / output signals disposed along the second side of the matrix from the memory tiles to the first set of global amplifiers; a second set of global input / output signals arranged along the first side of the matrix from the memory tiles to the second set of global amplifiers; Further comprising: Item 16. The apparatus according to item 15. [Item 17] Each of the wide prefetch memory blocks is a first subset of the first set of global input / output signals coupled to a first memory tile of the matrix and a first subset of the first set of global amplifiers, respectively; a first subset of the second set of global input / output signals coupled to the first memory tile of the matrix and to a first subset of the second set of global amplifiers, respectively; Further comprising: Item 17. The device according to item 16. [Item 18] Item 17. The apparatus of item 16, wherein the matrix includes a 9 row by 11 column matrix arranged in a general rectangular shape with 9 rows of memory tiles arranged substantially linearly in a first direction and 11 columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, the matrix providing a page size of 1 kilobyte of data when activated by an access command. [Item 19] Item 19. The apparatus of item 18, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size for the matrix having a data width of at least 1024 bits. [Item 20] Each of the wide prefetch memory blocks is a first set of write drivers coupled to the memory tiles and disposed along the first side of the matrix; a second set of write drivers coupled to the memory tiles and disposed along the second side of the matrix; Further comprising: Item 16. The apparatus according to item 15.

Claims

1. A silicon substrate; a memory circuit coupled to the silicon substrate; Equipped with The memory circuit includes: an array block of memory tiles coupled to the silicon substrate; a first set of global amplifiers coupled to the silicon substrate and the memory tiles and disposed along a first side of the array block; a first set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the first side of the array block; a second set of global amplifiers coupled to the silicon substrate and to the memory tiles and disposed along a second side of the array block opposite the first side of the array block; a second set of write drivers coupled to the silicon substrate and the memory tiles and disposed along the second side of the array block; having The memory circuit includes: a first set of global input / output signals coupled to the silicon substrate and disposed on the array block from memory tiles along the second side of the array block to the first set of global amplifiers; a second set of global input / output signals coupled to the silicon substrate and disposed on the array block from memory tiles along the first side of the array block to a second set of global amplifiers; and The memory circuit includes: a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and to a first subset of the first set of global amplifiers; a first subset of the second set of global input / output signals respectively coupled to the first memory tiles of the array block and to a first subset of the second set of global amplifiers; Further comprising electronic equipment.

2. 2. The electronic device of claim 1, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and wherein the array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte.

3. 3. The electronic device of claim 2, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, a ratio of P to W being less than or equal to 8 to 1.

4. 4. An electronic device according to claim 1, wherein the memory tiles comprise dynamic random access memories.

5. A plurality of through silicon vias configured to couple to another substrate The electronic device of claim 1 , further comprising: an array block of memory tiles; a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block; a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block; a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block; a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block; a first set of global input / output signals distributed from memory tiles along the second side of the array block to the first set of global amplifiers; a second set of global input / output signals distributed from memory tiles along the first side of the array block to a second set of global amplifiers; a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and to a first subset of the first set of global amplifiers; a first subset of the second set of global input / output signals respectively coupled to the first memory tiles of the array block and to a first subset of the second set of global amplifiers; A memory device comprising:

7. 7. The memory device of claim 6, wherein the array block has a matrix of M rows and N columns arranged in a general rectangular shape with M rows of memory tiles arranged substantially linearly in a first direction and N columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, and the array block provides a page size P of data when activated by an access command, where P is greater than or equal to 1 kilobyte.

8. 8. The memory device of claim 7, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size W bits, a ratio of P to W being less than or equal to 8:

1.

9. 9. A memory device according to claim 6, wherein the memory tiles comprise random access memories.

10. 10. A memory device as claimed in claim 6, wherein the memory tiles comprise dynamic random access memories.

11. An interposer; a processor coupled to the interposer; at least one wide prefetch memory stack device coupled to the interposer and communicatively coupled to the processor through the interposer; Equipped with the at least one wide prefetch memory stack device has a die stack including at least one logic die and at least two wide prefetch memory dies; each of the at least two wide prefetch memory dies includes a plurality of wide prefetch memory blocks; Each of the plurality of wide prefetch memory blocks includes: an array block having memory tiles arranged in rows and columns along two perpendicular directions; a first set of global amplifiers coupled to the memory tiles and arranged along a first side of the matrix; a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the matrix opposite the first side of the matrix; Including, Each of the plurality of wide prefetch memory blocks includes: a first set of global input / output signals distributed from memory tiles along the second side of the matrix to the first set of global amplifiers; a second set of global input / output signals distributed from memory tiles along the first side of the matrix to a second set of global amplifiers; Further comprising: Each of the plurality of wide prefetch memory blocks includes: a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the matrix and to a first subset of the first set of global amplifiers; a first subset of the second set of global input / output signals coupled to the first memory tile of the matrix and to a first subset of the second set of global amplifiers, respectively; Further comprising: electronic equipment.

12. 12. The electronic device of claim 11, wherein the matrix includes a 9 row by 11 column matrix arranged in a general rectangular shape with 9 rows of memory tiles arranged substantially linearly in a first direction and 11 columns of memory tiles arranged substantially linearly in a second direction substantially perpendicular to the first direction, the matrix providing a page size of 1 kilobyte of data when activated by an access command.

13. 13. The electronic device of claim 12, wherein the first set of global input / output signals and the second set of global input / output signals provide a combined prefetch size for the matrix having a data width of at least 1024 bits.

14. Each of the plurality of wide prefetch memory blocks includes: a first set of write drivers coupled to the memory tiles and arranged along the first side of the matrix; a second set of write drivers coupled to the memory tiles and arranged along the second side of the matrix; Further comprising:

14. An electronic device according to any one of claims 11 to 13.

15. 15. An electronic device according to any one of claims 11 to 14, wherein the memory tiles comprise dynamic random access memories.

16. providing an array block of memory tiles; providing a first set of global amplifiers coupled to the memory tiles and disposed along a first side of the array block; providing a second set of global amplifiers coupled to the memory tiles and disposed along a second side of the array block opposite the first side of the array block; providing a first set of global input / output signals disposed from memory tiles along the second side of the array block to the first set of global amplifiers; providing a second set of global input / output signals distributed from memory tiles along the first side of the array block to a second set of global amplifiers; providing a first subset of the first set of global input / output signals respectively coupled to a first memory tile of the array block and to a first subset of the first set of global amplifiers; providing a first subset of the second set of global input / output signals respectively coupled to the first memory tiles of the array block and to a first subset of the second set of global amplifiers; 13. A method for increasing memory bandwidth comprising:

17. providing a first set of write drivers coupled to the memory tiles and disposed along the first side of the array block; providing a second set of write drivers coupled to the memory tiles and disposed along the second side of the array block; 20. The method of claim 16, further comprising:

Images