Cache-to-Cache: Direct Semantic Communication Between Large Language Models
Summary
A research paper proposing Cache-to-Cache (C2C), a paradigm for direct semantic communication between large language models by aligning and fusing KV-cache representations. It claims improvements in accuracy and latency over text-based inter-model communication, and provides a GitHub reference for the implementation.