Harsh Menon

Designing the machines that think.

I work on machine learning systems end to end: models and inference at scale, the compilers and kernels beneath them, and the accelerators they run on. Most of all I care about designing those layers together.

Fig. 1. Lowering, one plane at a time: a model graph becomes tiled loops, then instructions, then work on silicon.
§ 02 — Talks

Lectures & tutorials

Fig. 4. The GEMM iteration space. One workgroup owns a C tile and streams its A and B panels along K.
  • High Performance Matrix Multiplication on RDNA3 GPUs Sep 2023 Slides Video
  • High-dimensional layouts for vector distribution May 2023 Slides Video
  • Decomposable Operators in IREEC4ML Feb 2023 Slides
  • Optimizing Winograd Convolutions in MLIRMLIR Summit Nov 2022 Slides
  • MLIR Code Generation TutorialHot Chips 34 Aug 2022 Slides Video
§ 04 — About

Where I’ve worked

  1. 2023 — now

    AMD

    Senior Fellow

    Machine learning systems across the whole stack: how models and inference map through compilers and kernels onto AMD hardware, and how those layers should be designed together.

  2. 2013 — 2023

    nod.ai

    Co-founder & CTO

    Built the company’s technology end to end: the infrastructure that took machine learning models from frameworks to fast execution on a wide range of hardware. Acquired by AMD.

  3. Earlier

    Wisk Aero

    Engineering

    Autonomous systems for electric vertical takeoff and landing aircraft.