How I Do Systems Research.
I build systems.
1. I do care about GPU systems and their future, but that does not mean I care any less about CPU systems.
2. I do open research. I make everything open whenever possible.
3. I do care about industry applications and highly value research that can be useful in industry to ultimately benefit people. I build systems for people to use, not only for academic records or novelty.
4. I do my best to write educational papers. In this effort, I feel responsible for openly sharing my insights with others building similar systems.
5. I often ask whether a system is "Speed-of-Light." By this, I mean asking whether it approaches the limits of the underlying hardware and where its bottleneck lies. I use back-of-the-envelope calculations to assess both.
It's the disease of thinking that a really great idea is 90% of the work, and if you just tell all these other people "here's this great idea" then of course they can go off and make it happen.
And the problem with that is that there is just a tremendous amount of craftsmanship in between a great idea and a great product. And as you evolve that great idea it changes and grows. It never comes out like it starts because you learn a lot more as you get in the subtleties of it.
And you also find there's tremendous trade-offs that you have to make. There are just certain things you can't make electrons do. There are certain things you can't make plastic do or glass do. ...
And as you get in to all these things, designing a product is keeping 5000 things in your brain, these concepts. And fitting them all together and kind of continuing to push to fit them together in new and different ways to get what you want. And every day you discover something new that is a new problem or a new opportunity to fit these things together a little differently.
It's that process that is the magic.
© 2026 Powered by Astro Aria