OpenAI unveils its first custom chip, built by Broadcom
Summary
OpenAI and Broadcom unveiled Jalapeño, a custom inference chip designed to accelerate OpenAI's models. Early results suggest improved performance per watt, potentially reducing reliance on Nvidia GPUs. OpenAI envisions architecture across the stack from chips to data centers to optimize speed, reliability, and cost.