My AMD GPU Has a New Job: Running llama.cpp Without Guessing What Fits
How I run llama.cpp on an AMD GPU with HIP, verified GGUF weights, a private API and measured context limits instead of optimistic VRAM maths.

Karl Machleidt
Security research, self-hosting, and the things I learn by taking things apart.
Read the blogHow I run llama.cpp on an AMD GPU with HIP, verified GGUF weights, a private API and measured context limits instead of optimistic VRAM maths.

How Ghostwire uses a native Windows WebView bridge for local exports and authenticated webhooks, with session, compatibility and queue limits.

How I use self-hosted Infisical, machine identities and selected credential injection for AI tools, with reproducible examples and honest permission boundaries.

Vane, SearXNG and local inference: searchable sources, honest engine failures, document conversion and a reproducible way to check the answers.

The caching setup I used before Astro: anonymous HTML at Cloudflare, an origin page cache, Redis limits and tests for private-content bypass.

A technical tour of my OPNsense nginx reverse proxy, NAXSI policies, Elastic evidence and guarded n8n response, including tuning, tests and current limitations.

Why I built a low-interaction NetScaler honeypot, how its capture-only stack works, and what real payloads and the private evidence console actually show.

How I moved Karl.Fail to Astro and Cloudflare Pages, kept WordPress private, and built automatic publishing, local search and a faster reading…
