#llama.cpp

Run an Open Model on the Machine You Already Own, Integrated Graphics Included

What decides whether an open model loads is memory, not the badge on your GPU. Sizing the model, picking a quantisation, setting context deliberately, and knowing which jobs still belong to a hosted model.