Get up and running with large language models, locally.
Ollama turned local LLM inference into `ollama run llama3` — model management, serving, and a clean API in one Go binary. The fastest path from curiosity to a working local model.
LLM inference in plain C/C++ — run capable models on everyday hardware.
llama.cpp made large language models runnable on a laptop CPU with no GPU, no framework, no cluster. The quantization formats it pioneered (GGUF) became the de facto standard for local inference.
NotVibesCoded