Tech Notes

3 Posts Collection
Dense, MoE, and the SSE Bug That Ate My Chat Stream
Aug 23, 2026

Dense, MoE, and the SSE Bug That Ate My Chat Stream

I had three vllm serve processes running on the H200 cluster, one prompt piped into all three through the same OpenAI-compatible client, and I was watching what should have...

Read Article
Four Sparks and a Closet
Aug 19, 2026 Featured

Four Sparks and a Closet

Part of my job is keeping an H200 cluster alive for research projects and workloads heavy enough to need it. Eight of those GPUs wired into one NVLink domain can...

Read Article
Attention is All You Need: The Paper That Sparked a Trillion-Dollar Industry
May 31, 2026 Featured

Attention is All You Need: The Paper That Sparked a Trillion-Dollar Industry

In the summer of 2017, a team of researchers from Google Brain and the University of Toronto published a paper to the arXiv preprint server titled Attention Is All You...

Read Article