Hot Chips 2026: Samsung’s Processing-in-Memory (PIM)
Summary
Samsung reveals LPDDR5X-PIM with per-bank MAC units, delivering up to 614 GB/s internal bandwidth and enabling in-memory compute within DRAM banks. The article details the architecture, including per-bank PIM registers, AAM addressing, and the software and cache-coherence challenges that accompany memory-side compute. It also discusses adoption hurdles for multitasking systems and suggests hardware/software changes needed for practical use.