Model
Harness
Hardware
Interface
Use cases

Showing 4/4 recipes

by @Aukejw
+1

Great for vision, strong improvement over the non-QAT version

chat vision
HardwareRunsWorks
M4 Pro(24GB)
easily
certainly
1x
by @Aukejw
+1

Great at image understanding but can hallucinate

chat reasoning vision
HardwareRunsWorks
M4 Pro(24GB)
easily
likely
1x
by @Aukejw
+1
bartowski/Qwen_Qwen3.5-2B-GGUF Q4_K_M
llama-server

Good tool-calling model for limited compute settings

chat tool-use
HardwareRunsWorks
Cortex-A76
barely
likely
1x
by @Aukejw
+1
lmstudio-community/Qwen3.5-9B-GGUF Q4_K_M
LM Studio Pi

Decent coding model, can run on a 24GB macbook

coding
HardwareRunsWorks
M4 Pro(24GB)
easily
likely
1x