Skip to content

/DEV/URANDOM

  • Home
  • Disclaimer / Privacy Policy
  • Home
  • Disclaimer / Privacy Policy

llama.cpp

2026

GGUF, Q4_K_M and Other Things That Look Like Wi-Fi Passwords: A Field Guide to Running AI Locally

Same model, eight files, names like hotel Wi-Fi passwords. Here’s what GGUF, Q4_K_M, K-quants and i-quants actually mean, how much dumber each one makes your model, and the napkin maths to know if it’ll fit before you hit download.

Comic illustration: a sweating man at 3:17 am tries to zip a giant glowing AI brain into a small suitcase tagged Q4_K_M, while his gaming PC smokes and a robot sommelier offers a file from a monitor listing Q2_K, Q4_K_M and Q8_0.
11 October 2026
Tech / Tutorials

/DEV/URANDOM © 2026. All Rights Reserved.