AI & Local Models
KV Cache Quantization in llama.cpp for Consumer VRAM
Calculate llama.cpp KV-cache memory with block overhead, configure K/V types, and test fit and quality on your GPU with an illustrative 32k/64k example.
Tagged
local AI
RSS Tag2 articles
AI & Local Models
Faster-Whisper vs whisper.cpp for Local Speech-to-Text
Compare Faster-Whisper and whisper.cpp with current installation commands, built-in VAD options, hardware backends, and a repeatable audio test plan.