ashhart/TensorFold
Summary
TensorFold is an open-source LLM inference engine that runs on Metal, CUDA, and Vulkan. The repository provides extensive setup guides, model recipes, and deployment options for Mac, Linux, and Windows, along with enterprise features and contributor guidance. It emphasizes local, hardware-accelerated AI inference with a permissive Apache-2.0 license.