Mesh LLM: distributed AI computing on iroh
Summary
Mesh LLM introduces a distributed AI computing model where GPUs across multiple machines form a mesh that can run OpenAI-compatible models. It emphasizes control over models, privacy, and cost by avoiding centralized servers and enabling local, peer, or split-model inference using iroh's NAT-traversal for direct QUIC connections.