llama.cpp is an MIT-licensed C/C++ LLM inference engine that runs large language and vision models locally or in the cloud with minimal setup and no dependencies.
