Making Atuin sync 32x faster with packfiles
Summary
This post explains Atuin's packfile optimization that speeds up sync significantly (32x for Hub, 16x for self-hosted) by packing, compressing, and encrypting records client-side. It covers how packfiles are generated, uploaded via pre-signed URLs, and downloaded with a pipelined approach, plus future ideas like packfile trees andChaCha20-Poly1305 encryption.