PTP: Previous-Token Prediction based LLM Inversion for Near-Exact Prompt Reconstruction
Summary
PTP introduces a black-box inversion approach for large language models by training an inverse language model from scratch using previous-token prediction to reconstruct prompts from observed outputs. The method aims for near-exact prompt reconstruction and demonstrates broader generalization and transferability across datasets and models, outperforming prior work on token-based evaluation metrics.