All Posts
An archive of my writing and explorations.
Dense, MoE, and the SSE Bug That Ate My Chat Stream
I had three vllm serve processes running on the H200 cluster, one prompt piped into all three through the same OpenAI-compatible client, and I was watching what should have...
Read Article
Four Sparks and a Closet
Part of my job is keeping an H200 cluster alive for research projects and workloads heavy enough to need it. Eight of those GPUs wired into one NVLink domain can...
Read Article
The Dual Nature of Reality: Waves, Particles, and Quantum States
Human intuition is strictly macroscopic. We evolved in a world governed by classical mechanics. In this world, a rock is a solid, localized object. A ripple in a pond is...
Read Article
Architecting A H200 HPC Cluster for AI Research
AI training is massively GPU intensive. Until recently, our institution's AI lab operated on dozens of standalone desktops equipped with consumer RTX graphics cards for teaching and research....
Read Article
Attention is All You Need: The Paper That Sparked a Trillion-Dollar Industry
In the summer of 2017, a team of researchers from Google Brain and the University of Toronto published a paper to the arXiv preprint server titled Attention Is All You...
Read Article
Real-time Robot Control with Leap Motion
Using Leap Motion Sensor to Control a Robotic Arm in Real-time....
Read Article
Quantum Computing 101: A Quick Guide for Busy Minds
In the ever-evolving landscape of technology, quantum computing stands as a revolutionary force, promising to transform the way we process information and solve complex problems. While traditional computers rely...
Read Article
Understanding Prompt Engineering: The Art of Guiding AI Models
In the realm of artificial intelligence, prompt engineering plays a pivotal role in shaping the outcomes generated by language models. As we delve into the intricate world of AI, understanding prompt engineering becomes essential for fine-tuning models and harnessing their potential effectively....
Read Article
A Spark and a Virus
2020 has been widely and unofficially considered as the worst year in many decades. If you are reading this, you have internet and of course you know what happens around...
Read Article
The cosmic perspective on life
Our relationship with the cosmos is not just spiritual. But in a way, physical. We are special not because we are different from each other, but the same....
Read Article
Story of a Simple Blob: A Humbling Perspective on a Human Centric World
Once upon a time, there was a tiny, smart, lively, and lonely blob on a rock floating in space entirely covered in water. Upon gathering enough energy from nearby sources,...
Read Article
Order in the Chaos: The Butterfly Effect
Just a mere few thousand years ago, we looked towards the sun to know what time of the day it is in the part of the world we live in....
Read Article