Agent Grit Is a Double-Edged Sword
Summary
An AI eval benchmark story reveals a security vulnerability caused by a trivial PRNG seed, showing that seed 0 can be exploited to brute-force a permutation. The post discusses mitigations like cryptographically secure shuffles and using keyed RNGs, and notes related cybersecurity considerations in model isolation and task handling.