The Hardware Lottery
Summary
This piece, The Hardware Lottery, argues that hardware constraints and software ecosystems heavily influence which AI research ideas succeed. It traces historical patterns from early computing to modern GPUs, discusses the von Neumann bottleneck, and advocates closer hardware-software co-design and domain-specific hardware to accelerate progress.