Kubernetes

GIE 1.4: the framework release (and what it means for llm-d)

Gateway API Inference Extension v1.4 landed with 101 commits from 54 contributors. The headline isn’t a single feature, it’s that GIE became a real plugin framework. Here’s what changed and why it matters if you’re building on top of it.

Fine-tuning a Go expert: does it actually work? (Part 2)

The v2 adapter trained overnight on 41k samples. Loss 0.918, accuracy 82.7%. I loaded it into vLLM and ran the same prompts. Here’s what came out.

Fine-tuning a Go expert: LoRA on a $300 GPU (Part 1)

I trained a LoRA adapter on 41k Go code examples from the Kubernetes and etcd source trees. The first run produced 600 tab characters. Here’s what I learned.

DRANet: the fix for bare metal RDMA in Kubernetes

hostNetwork is the default recommendation for RDMA in Kubernetes. It breaks disaggregated inference. DRANet replaces it with DRA-based NIC assignment and fixes the problem cleanly.