The documentation includes local running and startup examples.

Qwen announces: Qwen3-VL is now available on llama.cpp, with GGUF weights ranging from 2B to 235B.

Qwen officially announced that its visual language model, Qwen3-VL, is now natively supported in llama.cpp, and a full range of GGUF weights have been...