Speeding up GPU copies by permuting iteration spaces, or, optimising the identity function
Summary
Futhark's blog explains LMAD-based memory layouts and how they affect data copies. It shows how runtime permutation of iteration spaces can improve coalesced access on GPUs, with benchmarks showing notable speedups in some cases. The article highlights implications for compiler design and future work on CPU backends and transposition optimizations.