AI & Local Models
Llama 3.1 8B Quant Shootout: 4‑bit to 6‑bit on RTX 3060
On an RTX 3060, Q5_K_M runs Llama 3.1 8B nearly as fast as 4-bit with better output. See the numbers for Q4, Q5, Q6.
Hands-on writing about local AI models, the software built on them, and the machines you run it all on.
AI & Local Models
Local PDF Q&A Without Hallucinations: Ollama + LangChain
Build a local document Q&A system that doesn't lie. Exact chunking strategies, retrieval setup, and prompt constraints to stop LLM fabrications cold.
Local Speech-to-Text with Whisper: Faster-Whisper vs whisper.cpp for Dictation and Subtitles
There's something quietly magical about speaking to your computer and watching your words appear on screen — no cloud required, no subscription, no data
Self-Hosting
Stop Running AI on Your Laptop: Build a $24 Cloud Inference Server
A sleeping laptop kills your model. Run Ollama on a cheap DigitalOcean droplet for always-on inference—$200 free credit with referral link.
Running Open-Source LLMs on a $300 Mini PC: Intel N100 vs. Ryzen 5 with Ollama
For $300, you can run a capable 7–8 billion parameter model on your desk—but the hardware you pick determines whether that feels like a conversation or a
AI & Local Models
RTX 4070 GPU Showdown: Llama 3.1 8B vs Mistral 7B vs Phi-3 Medium
Head-to-head local LLM benchmarks: Llama 3.1 8B, Mistral 7B, and Phi-3 Medium on RTX 4070 12GB. Tokens/sec, VRAM, and quantization trade-offs—see which mod
Hardware
The SMR Drive Trap: Slow ZFS and How to Avoid It
Shingled magnetic recording drives can silently cripple ZFS pools with timeouts, faults, and multi-day resilvers. Here's how to spot and avoid them.
Self-Hosting
Self-Host Your Bookmarks with Linkwarden: Beat Link Rot
Set up Linkwarden to self-host bookmarks with automatic page archiving. A step-by-step guide to a permanent, private archive you control on your own hardwa
Homelab
NUT UPS Shutdowns: USB Passthrough & Graceful Script
Get your Proxmox host to shut down cleanly before the UPS battery dies. NUT config, USB passthrough, and a shutdown script that actually fires.
Self-Hosting
Build a Private Search Engine with SearXNG
Ditch tracking and ads by self-hosting SearXNG, a metasearch engine that aggregates results privately. Step-by-step guide for your homelab.
Cheap 10GbE for Homelabs: Used NICs, DACs, & Driver Gotchas
Unlock reliable 10GbE in your homelab without breaking the bank. Learn which used NICs, DACs, and kernel tweaks actually work (and what to avoid).
Homelab
Tailscale on Proxmox: Secure Access Without Open Ports
Ditch risky port forwarding. Use Tailscale's WireGuard mesh VPN on Proxmox to access your homelab securely from anywhere—no open ports required.