Reducing Doom Loops with Final Token Preference Optimization
Summary
Liquid AI introduces Antidoom, a Final Token Preference Optimization technique to reduce doom loops in large language model reasoning. The method targets the first token that initiates a loop, trains to prefer coherent alternatives at that position, and demonstrates significant reductions in looping with improved eval scores across multiple models.